2024-04-01T01:41:42.019 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-04-01T01:41:42.019 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --archive /home/teuthworker/archive/teuthology-2024-03-31_21:24:02-fs-squid-distro-default-smithi/7633248 --description fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu/{overrides ubuntu_latest}} mount/fuse objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/1 tasks/dbench validater/lockdep} --name teuthology-2024-03-31_21:24:02-fs-squid-distro-default-smithi --owner scheduled_teuthology@teuthology -- /home/teuthworker/archive/teuthology-2024-03-31_21:24:02-fs-squid-distro-default-smithi/7633248/orig.config.yaml 2024-04-01T01:41:42.060 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T01:41:42.141 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-03-31_21:24:02-fs-squid-distro-default-smithi/7633248 branch: squid description: fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu/{overrides ubuntu_latest}} mount/fuse objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/1 tasks/dbench validater/lockdep} email: ceph-qa@ceph.com first_in_suite: false job_id: '7633248' kernel: kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: teuthology-2024-03-31_21:24:02-fs-squid-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: squid ceph: cephfs: session_timeout: 300 conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: lockdep: true mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 384f31f3d3aee7f8ba3f60846b8844c049165583 valgrind: exit_on_first_error: false ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: 384f31f3d3aee7f8ba3f60846b8844c049165583 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: 384f31f3d3aee7f8ba3f60846b8844c049165583 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.y - mds.a - mds.c - mds.e - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - mds.f - osd.4 - osd.5 - osd.6 - osd.7 seed: 8238 sha1: 384f31f3d3aee7f8ba3f60846b8844c049165583 sleep_before_teardown: 0 subset: 361/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_384f31f3d3aee7f8ba3f60846b8844c049165583/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 384f31f3d3aee7f8ba3f60846b8844c049165583 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi050.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIaIIMFIyz/Ym4ph/Q4OtlkmlRL7pbJF7YwUBjImiShD3B4vun9tltsG3mXt4pnng1dlVm8JKT7VtrxGKASVLH4= smithi097.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPVwbYRyhjH4QnGesHGUZYOKzTOLyLuMi+GEeyKY0Kc2YplZEwScTcl3SRxWbgK3ftkTwsgEMG2VnWK1dks9f0I= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - ceph-fuse: null - workunit: clients: all: - suites/dbench.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: e691533f9cbb33d85b2187bba20d7102f098636d timestamp: 2024-03-31_21:24:02 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-01T01:41:42.142 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_384f31f3d3aee7f8ba3f60846b8844c049165583/qa; will attempt to use it 2024-04-01T01:41:42.142 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_384f31f3d3aee7f8ba3f60846b8844c049165583/qa/tasks 2024-04-01T01:41:42.143 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-01T01:41:42.144 INFO:teuthology.task.internal:Checking packages... 2024-04-01T01:41:42.167 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '384f31f3d3aee7f8ba3f60846b8844c049165583' 2024-04-01T01:41:42.168 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-01T01:41:42.168 INFO:teuthology.packaging:ref: None 2024-04-01T01:41:42.168 INFO:teuthology.packaging:tag: None 2024-04-01T01:41:42.168 INFO:teuthology.packaging:branch: squid 2024-04-01T01:41:42.168 INFO:teuthology.packaging:sha1: 384f31f3d3aee7f8ba3f60846b8844c049165583 2024-04-01T01:41:42.168 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=squid 2024-04-01T01:41:42.419 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-1977-g384f31f3-1jammy 2024-04-01T01:41:42.420 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-01T01:41:42.427 INFO:teuthology.task.internal:no buildpackages task found 2024-04-01T01:41:42.427 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-01T01:41:42.444 INFO:teuthology.task.internal:Saving configuration 2024-04-01T01:41:42.460 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-01T01:41:42.466 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-01T01:41:42.491 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi050.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-03-31_21:24:02-fs-squid-distro-default-smithi/7633248', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-01 01:36:10.378691', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIMBoX+2mgijPvlfdNIJhgBxA0r35xzDXLytm0WikiSie'} 2024-04-01T01:41:42.518 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi097.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-03-31_21:24:02-fs-squid-distro-default-smithi/7633248', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-01 01:36:10.380292', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIEJQd3tPXus37JpZRbd8QpjzZSJUh1YYgQcErpk67Lq7'} 2024-04-01T01:41:42.518 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-01T01:41:42.526 INFO:teuthology.task.internal:roles: ubuntu@smithi050.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-04-01T01:41:42.526 INFO:teuthology.task.internal:roles: ubuntu@smithi097.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2024-04-01T01:41:42.526 INFO:teuthology.run_tasks:Running task console_log... 2024-04-01T01:41:42.594 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fa83f402ee0>, signals=[15]) 2024-04-01T01:41:42.594 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-01T01:41:42.600 INFO:teuthology.task.internal:Opening connections... 2024-04-01T01:41:42.600 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi050.front.sepia.ceph.com 2024-04-01T01:41:42.602 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T01:41:42.689 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi097.front.sepia.ceph.com 2024-04-01T01:41:42.690 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T01:41:42.768 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-01T01:41:42.774 DEBUG:teuthology.orchestra.run.smithi050:> uname -m 2024-04-01T01:41:42.779 INFO:teuthology.orchestra.run.smithi050.stdout:x86_64 2024-04-01T01:41:42.779 DEBUG:teuthology.orchestra.run.smithi050:> cat /etc/os-release 2024-04-01T01:41:42.824 INFO:teuthology.orchestra.run.smithi050.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-01T01:41:42.824 INFO:teuthology.orchestra.run.smithi050.stdout:NAME="Ubuntu" 2024-04-01T01:41:42.824 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION_ID="22.04" 2024-04-01T01:41:42.824 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-01T01:41:42.825 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION_CODENAME=jammy 2024-04-01T01:41:42.825 INFO:teuthology.orchestra.run.smithi050.stdout:ID=ubuntu 2024-04-01T01:41:42.825 INFO:teuthology.orchestra.run.smithi050.stdout:ID_LIKE=debian 2024-04-01T01:41:42.825 INFO:teuthology.orchestra.run.smithi050.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-01T01:41:42.825 INFO:teuthology.orchestra.run.smithi050.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-01T01:41:42.825 INFO:teuthology.orchestra.run.smithi050.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-01T01:41:42.825 INFO:teuthology.orchestra.run.smithi050.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-01T01:41:42.825 INFO:teuthology.orchestra.run.smithi050.stdout:UBUNTU_CODENAME=jammy 2024-04-01T01:41:42.826 INFO:teuthology.lock.ops:Updating smithi050.front.sepia.ceph.com on lock server 2024-04-01T01:41:42.849 DEBUG:teuthology.orchestra.run.smithi097:> uname -m 2024-04-01T01:41:42.854 INFO:teuthology.orchestra.run.smithi097.stdout:x86_64 2024-04-01T01:41:42.854 DEBUG:teuthology.orchestra.run.smithi097:> cat /etc/os-release 2024-04-01T01:41:42.903 INFO:teuthology.orchestra.run.smithi097.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-01T01:41:42.903 INFO:teuthology.orchestra.run.smithi097.stdout:NAME="Ubuntu" 2024-04-01T01:41:42.904 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION_ID="22.04" 2024-04-01T01:41:42.904 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-01T01:41:42.904 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION_CODENAME=jammy 2024-04-01T01:41:42.904 INFO:teuthology.orchestra.run.smithi097.stdout:ID=ubuntu 2024-04-01T01:41:42.904 INFO:teuthology.orchestra.run.smithi097.stdout:ID_LIKE=debian 2024-04-01T01:41:42.904 INFO:teuthology.orchestra.run.smithi097.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-01T01:41:42.904 INFO:teuthology.orchestra.run.smithi097.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-01T01:41:42.904 INFO:teuthology.orchestra.run.smithi097.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-01T01:41:42.904 INFO:teuthology.orchestra.run.smithi097.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-01T01:41:42.904 INFO:teuthology.orchestra.run.smithi097.stdout:UBUNTU_CODENAME=jammy 2024-04-01T01:41:42.904 INFO:teuthology.lock.ops:Updating smithi097.front.sepia.ceph.com on lock server 2024-04-01T01:41:42.924 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-01T01:41:42.934 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-01T01:41:42.938 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-01T01:41:42.939 DEBUG:teuthology.orchestra.run.smithi050:> test '!' -e /home/ubuntu/cephtest 2024-04-01T01:41:42.941 DEBUG:teuthology.orchestra.run.smithi097:> test '!' -e /home/ubuntu/cephtest 2024-04-01T01:41:42.951 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-01T01:41:42.957 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-01T01:41:42.957 DEBUG:teuthology.orchestra.run.smithi050:> test -z $(ls -A /var/lib/ceph) 2024-04-01T01:41:42.990 DEBUG:teuthology.orchestra.run.smithi097:> test -z $(ls -A /var/lib/ceph) 2024-04-01T01:41:43.076 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-01T01:41:43.131 INFO:teuthology.run_tasks:Running task kernel... 2024-04-01T01:41:43.146 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-04-01T01:41:43.146 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-04-01T01:41:43.146 DEBUG:teuthology.orchestra.run.smithi050:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-01T01:41:43.147 DEBUG:teuthology.orchestra.run.smithi097:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-01T01:41:43.151 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-01T01:41:43.151 DEBUG:teuthology.orchestra.run.smithi097:> uname -r 2024-04-01T01:41:43.152 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-01T01:41:43.152 DEBUG:teuthology.orchestra.run.smithi050:> uname -r 2024-04-01T01:41:43.200 INFO:teuthology.orchestra.run.smithi097.stdout:5.15.0-56-generic 2024-04-01T01:41:43.200 INFO:teuthology.task.kernel:Running kernel on smithi097: 5.15.0-56-generic 2024-04-01T01:41:43.201 DEBUG:teuthology.orchestra.run.smithi097:> sudo apt-get clean 2024-04-01T01:41:43.202 INFO:teuthology.orchestra.run.smithi050.stdout:5.15.0-56-generic 2024-04-01T01:41:43.202 INFO:teuthology.task.kernel:Running kernel on smithi050: 5.15.0-56-generic 2024-04-01T01:41:43.202 DEBUG:teuthology.orchestra.run.smithi050:> sudo apt-get clean 2024-04-01T01:41:43.328 DEBUG:teuthology.orchestra.run.smithi097:> sudo apt-get update 2024-04-01T01:41:43.347 DEBUG:teuthology.orchestra.run.smithi050:> sudo apt-get update 2024-04-01T01:41:43.559 INFO:teuthology.orchestra.run.smithi097.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-01T01:41:43.569 INFO:teuthology.orchestra.run.smithi097.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-04-01T01:41:43.579 INFO:teuthology.orchestra.run.smithi050.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-01T01:41:43.579 INFO:teuthology.orchestra.run.smithi050.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-04-01T01:41:43.579 INFO:teuthology.orchestra.run.smithi050.stdout:Get:3 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-04-01T01:41:43.656 INFO:teuthology.orchestra.run.smithi097.stdout:Get:3 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-04-01T01:41:43.668 INFO:teuthology.orchestra.run.smithi097.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-04-01T01:41:43.673 INFO:teuthology.orchestra.run.smithi050.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-04-01T01:41:43.797 INFO:teuthology.orchestra.run.smithi097.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [602 kB] 2024-04-01T01:41:43.821 INFO:teuthology.orchestra.run.smithi050.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,303 kB] 2024-04-01T01:41:43.880 INFO:teuthology.orchestra.run.smithi097.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,518 kB] 2024-04-01T01:41:43.898 INFO:teuthology.orchestra.run.smithi050.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [602 kB] 2024-04-01T01:41:43.918 INFO:teuthology.orchestra.run.smithi097.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [293 kB] 2024-04-01T01:41:43.925 INFO:teuthology.orchestra.run.smithi097.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-04-01T01:41:43.926 INFO:teuthology.orchestra.run.smithi097.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,644 kB] 2024-04-01T01:41:43.946 INFO:teuthology.orchestra.run.smithi050.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [436 kB] 2024-04-01T01:41:43.951 INFO:teuthology.orchestra.run.smithi097.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [35.3 kB] 2024-04-01T01:41:43.951 INFO:teuthology.orchestra.run.smithi097.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [274 kB] 2024-04-01T01:41:43.954 INFO:teuthology.orchestra.run.smithi050.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [233 kB] 2024-04-01T01:41:43.955 INFO:teuthology.orchestra.run.smithi097.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-04-01T01:41:43.955 INFO:teuthology.orchestra.run.smithi097.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [698 kB] 2024-04-01T01:41:43.961 INFO:teuthology.orchestra.run.smithi050.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-04-01T01:41:43.962 INFO:teuthology.orchestra.run.smithi050.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [33.7 kB] 2024-04-01T01:41:43.962 INFO:teuthology.orchestra.run.smithi050.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,616 kB] 2024-04-01T01:41:43.982 INFO:teuthology.orchestra.run.smithi050.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [271 kB] 2024-04-01T01:41:43.984 INFO:teuthology.orchestra.run.smithi050.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-04-01T01:41:43.985 INFO:teuthology.orchestra.run.smithi050.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [599 kB] 2024-04-01T01:41:43.985 INFO:teuthology.orchestra.run.smithi097.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,060 kB] 2024-04-01T01:41:43.988 INFO:teuthology.orchestra.run.smithi050.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,518 kB] 2024-04-01T01:41:43.991 INFO:teuthology.orchestra.run.smithi050.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [852 kB] 2024-04-01T01:41:43.992 INFO:teuthology.orchestra.run.smithi097.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [241 kB] 2024-04-01T01:41:43.994 INFO:teuthology.orchestra.run.smithi097.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-04-01T01:41:43.995 INFO:teuthology.orchestra.run.smithi097.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [6,028 B] 2024-04-01T01:41:43.995 INFO:teuthology.orchestra.run.smithi097.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [49.6 kB] 2024-04-01T01:41:44.000 INFO:teuthology.orchestra.run.smithi097.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [12.0 kB] 2024-04-01T01:41:44.000 INFO:teuthology.orchestra.run.smithi097.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-04-01T01:41:44.000 INFO:teuthology.orchestra.run.smithi097.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.2 kB] 2024-04-01T01:41:44.001 INFO:teuthology.orchestra.run.smithi050.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [163 kB] 2024-04-01T01:41:44.001 INFO:teuthology.orchestra.run.smithi097.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-04-01T01:41:44.004 INFO:teuthology.orchestra.run.smithi050.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-04-01T01:41:44.004 INFO:teuthology.orchestra.run.smithi050.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-04-01T01:41:44.005 INFO:teuthology.orchestra.run.smithi050.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.1 kB] 2024-04-01T01:41:44.016 INFO:teuthology.orchestra.run.smithi097.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-04-01T01:41:44.016 INFO:teuthology.orchestra.run.smithi097.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-04-01T01:41:44.016 INFO:teuthology.orchestra.run.smithi097.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.2 kB] 2024-04-01T01:41:44.016 INFO:teuthology.orchestra.run.smithi097.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.4 kB] 2024-04-01T01:41:44.016 INFO:teuthology.orchestra.run.smithi097.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-04-01T01:41:44.017 INFO:teuthology.orchestra.run.smithi050.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,476 B] 2024-04-01T01:41:44.019 INFO:teuthology.orchestra.run.smithi097.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-04-01T01:41:44.025 INFO:teuthology.orchestra.run.smithi050.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-04-01T01:41:44.038 INFO:teuthology.orchestra.run.smithi050.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [293 kB] 2024-04-01T01:41:44.043 INFO:teuthology.orchestra.run.smithi050.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-04-01T01:41:44.043 INFO:teuthology.orchestra.run.smithi050.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,644 kB] 2024-04-01T01:41:44.067 INFO:teuthology.orchestra.run.smithi050.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [35.3 kB] 2024-04-01T01:41:44.068 INFO:teuthology.orchestra.run.smithi050.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [274 kB] 2024-04-01T01:41:44.072 INFO:teuthology.orchestra.run.smithi050.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-04-01T01:41:44.072 INFO:teuthology.orchestra.run.smithi050.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,060 kB] 2024-04-01T01:41:44.085 INFO:teuthology.orchestra.run.smithi050.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [698 kB] 2024-04-01T01:41:44.092 INFO:teuthology.orchestra.run.smithi097.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [436 kB] 2024-04-01T01:41:44.093 INFO:teuthology.orchestra.run.smithi050.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [241 kB] 2024-04-01T01:41:44.096 INFO:teuthology.orchestra.run.smithi050.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-04-01T01:41:44.098 INFO:teuthology.orchestra.run.smithi050.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [49.6 kB] 2024-04-01T01:41:44.099 INFO:teuthology.orchestra.run.smithi050.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [6,028 B] 2024-04-01T01:41:44.099 INFO:teuthology.orchestra.run.smithi050.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [12.0 kB] 2024-04-01T01:41:44.099 INFO:teuthology.orchestra.run.smithi050.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-04-01T01:41:44.117 INFO:teuthology.orchestra.run.smithi050.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-04-01T01:41:44.118 INFO:teuthology.orchestra.run.smithi050.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.2 kB] 2024-04-01T01:41:44.119 INFO:teuthology.orchestra.run.smithi050.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-04-01T01:41:44.120 INFO:teuthology.orchestra.run.smithi050.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-04-01T01:41:44.120 INFO:teuthology.orchestra.run.smithi050.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.4 kB] 2024-04-01T01:41:44.120 INFO:teuthology.orchestra.run.smithi050.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.2 kB] 2024-04-01T01:41:44.139 INFO:teuthology.orchestra.run.smithi050.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-04-01T01:41:44.140 INFO:teuthology.orchestra.run.smithi050.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-04-01T01:41:44.373 INFO:teuthology.orchestra.run.smithi097.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,303 kB] 2024-04-01T01:41:44.538 INFO:teuthology.orchestra.run.smithi097.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [233 kB] 2024-04-01T01:41:44.550 INFO:teuthology.orchestra.run.smithi097.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-04-01T01:41:44.551 INFO:teuthology.orchestra.run.smithi097.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,616 kB] 2024-04-01T01:41:44.631 INFO:teuthology.orchestra.run.smithi097.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [33.7 kB] 2024-04-01T01:41:44.632 INFO:teuthology.orchestra.run.smithi097.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [271 kB] 2024-04-01T01:41:44.640 INFO:teuthology.orchestra.run.smithi097.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-04-01T01:41:44.641 INFO:teuthology.orchestra.run.smithi097.stdout:Get:37 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [599 kB] 2024-04-01T01:41:44.657 INFO:teuthology.orchestra.run.smithi097.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [852 kB] 2024-04-01T01:41:44.841 INFO:teuthology.orchestra.run.smithi097.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [163 kB] 2024-04-01T01:41:45.248 INFO:teuthology.orchestra.run.smithi097.stdout:Get:40 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-04-01T01:41:45.253 INFO:teuthology.orchestra.run.smithi097.stdout:Get:41 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.1 kB] 2024-04-01T01:41:45.267 INFO:teuthology.orchestra.run.smithi097.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-04-01T01:41:45.267 INFO:teuthology.orchestra.run.smithi097.stdout:Get:43 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,476 B] 2024-04-01T01:41:45.270 INFO:teuthology.orchestra.run.smithi097.stdout:Get:44 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-04-01T01:41:49.452 INFO:teuthology.orchestra.run.smithi097.stdout:Fetched 12.6 MB in 2s (6,679 kB/s) 2024-04-01T01:41:50.035 INFO:teuthology.orchestra.run.smithi050.stdout:Fetched 12.6 MB in 2s (6,359 kB/s) 2024-04-01T01:41:50.780 INFO:teuthology.orchestra.run.smithi097.stdout:Reading package lists... 2024-04-01T01:41:50.797 DEBUG:teuthology.orchestra.run.smithi097:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-01T01:41:50.858 INFO:teuthology.orchestra.run.smithi097.stdout:Reading package lists... 2024-04-01T01:41:51.055 INFO:teuthology.orchestra.run.smithi097.stdout:Building dependency tree... 2024-04-01T01:41:51.055 INFO:teuthology.orchestra.run.smithi097.stdout:Reading state information... 2024-04-01T01:41:51.228 INFO:teuthology.orchestra.run.smithi097.stdout:The following packages were automatically installed and are no longer required: 2024-04-01T01:41:51.228 INFO:teuthology.orchestra.run.smithi097.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-01T01:41:51.228 INFO:teuthology.orchestra.run.smithi097.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-01T01:41:51.229 INFO:teuthology.orchestra.run.smithi097.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-01T01:41:51.229 INFO:teuthology.orchestra.run.smithi097.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-04-01T01:41:51.229 INFO:teuthology.orchestra.run.smithi097.stdout: python2.7-minimal 2024-04-01T01:41:51.229 INFO:teuthology.orchestra.run.smithi097.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-01T01:41:51.230 INFO:teuthology.orchestra.run.smithi097.stdout:The following additional packages will be installed: 2024-04-01T01:41:51.230 INFO:teuthology.orchestra.run.smithi097.stdout: linux-generic linux-headers-5.15.0-101 linux-headers-5.15.0-101-generic 2024-04-01T01:41:51.230 INFO:teuthology.orchestra.run.smithi097.stdout: linux-headers-generic linux-image-5.15.0-101-generic 2024-04-01T01:41:51.230 INFO:teuthology.orchestra.run.smithi097.stdout: linux-modules-5.15.0-101-generic linux-modules-extra-5.15.0-101-generic 2024-04-01T01:41:51.231 INFO:teuthology.orchestra.run.smithi097.stdout:Suggested packages: 2024-04-01T01:41:51.232 INFO:teuthology.orchestra.run.smithi097.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-04-01T01:41:51.232 INFO:teuthology.orchestra.run.smithi097.stdout:Recommended packages: 2024-04-01T01:41:51.232 INFO:teuthology.orchestra.run.smithi097.stdout: thermald 2024-04-01T01:41:51.281 INFO:teuthology.orchestra.run.smithi097.stdout:The following NEW packages will be installed: 2024-04-01T01:41:51.281 INFO:teuthology.orchestra.run.smithi097.stdout: linux-headers-5.15.0-101 linux-headers-5.15.0-101-generic 2024-04-01T01:41:51.281 INFO:teuthology.orchestra.run.smithi097.stdout: linux-image-5.15.0-101-generic linux-modules-5.15.0-101-generic 2024-04-01T01:41:51.282 INFO:teuthology.orchestra.run.smithi097.stdout: linux-modules-extra-5.15.0-101-generic 2024-04-01T01:41:51.283 INFO:teuthology.orchestra.run.smithi097.stdout:The following packages will be upgraded: 2024-04-01T01:41:51.283 INFO:teuthology.orchestra.run.smithi097.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-01T01:41:51.340 INFO:teuthology.orchestra.run.smithi097.stdout:3 upgraded, 5 newly installed, 0 to remove and 311 not upgraded. 2024-04-01T01:41:51.340 INFO:teuthology.orchestra.run.smithi097.stdout:Need to get 113 MB of archives. 2024-04-01T01:41:51.341 INFO:teuthology.orchestra.run.smithi097.stdout:After this operation, 582 MB of additional disk space will be used. 2024-04-01T01:41:51.341 INFO:teuthology.orchestra.run.smithi097.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-101-generic amd64 5.15.0-101.111 [22.6 MB] 2024-04-01T01:41:51.477 INFO:teuthology.orchestra.run.smithi050.stdout:Reading package lists... 2024-04-01T01:41:51.494 DEBUG:teuthology.orchestra.run.smithi050:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-01T01:41:51.558 INFO:teuthology.orchestra.run.smithi050.stdout:Reading package lists... 2024-04-01T01:41:51.742 INFO:teuthology.orchestra.run.smithi050.stdout:Building dependency tree... 2024-04-01T01:41:51.742 INFO:teuthology.orchestra.run.smithi050.stdout:Reading state information... 2024-04-01T01:41:51.839 INFO:teuthology.orchestra.run.smithi097.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-101-generic amd64 5.15.0-101.111 [11.5 MB] 2024-04-01T01:41:51.901 INFO:teuthology.orchestra.run.smithi050.stdout:The following packages were automatically installed and are no longer required: 2024-04-01T01:41:51.901 INFO:teuthology.orchestra.run.smithi050.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-01T01:41:51.902 INFO:teuthology.orchestra.run.smithi050.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-01T01:41:51.902 INFO:teuthology.orchestra.run.smithi050.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-01T01:41:51.902 INFO:teuthology.orchestra.run.smithi050.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-04-01T01:41:51.902 INFO:teuthology.orchestra.run.smithi050.stdout: python2.7-minimal 2024-04-01T01:41:51.902 INFO:teuthology.orchestra.run.smithi050.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-01T01:41:51.903 INFO:teuthology.orchestra.run.smithi050.stdout:The following additional packages will be installed: 2024-04-01T01:41:51.903 INFO:teuthology.orchestra.run.smithi050.stdout: linux-generic linux-headers-5.15.0-101 linux-headers-5.15.0-101-generic 2024-04-01T01:41:51.903 INFO:teuthology.orchestra.run.smithi050.stdout: linux-headers-generic linux-image-5.15.0-101-generic 2024-04-01T01:41:51.904 INFO:teuthology.orchestra.run.smithi050.stdout: linux-modules-5.15.0-101-generic linux-modules-extra-5.15.0-101-generic 2024-04-01T01:41:51.905 INFO:teuthology.orchestra.run.smithi050.stdout:Suggested packages: 2024-04-01T01:41:51.905 INFO:teuthology.orchestra.run.smithi050.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-04-01T01:41:51.905 INFO:teuthology.orchestra.run.smithi050.stdout:Recommended packages: 2024-04-01T01:41:51.905 INFO:teuthology.orchestra.run.smithi050.stdout: thermald 2024-04-01T01:41:51.958 INFO:teuthology.orchestra.run.smithi050.stdout:The following NEW packages will be installed: 2024-04-01T01:41:51.958 INFO:teuthology.orchestra.run.smithi050.stdout: linux-headers-5.15.0-101 linux-headers-5.15.0-101-generic 2024-04-01T01:41:51.958 INFO:teuthology.orchestra.run.smithi050.stdout: linux-image-5.15.0-101-generic linux-modules-5.15.0-101-generic 2024-04-01T01:41:51.958 INFO:teuthology.orchestra.run.smithi050.stdout: linux-modules-extra-5.15.0-101-generic 2024-04-01T01:41:51.959 INFO:teuthology.orchestra.run.smithi050.stdout:The following packages will be upgraded: 2024-04-01T01:41:51.959 INFO:teuthology.orchestra.run.smithi050.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-01T01:41:51.961 INFO:teuthology.orchestra.run.smithi097.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-101-generic amd64 5.15.0-101.111 [63.9 MB] 2024-04-01T01:41:52.027 INFO:teuthology.orchestra.run.smithi050.stdout:3 upgraded, 5 newly installed, 0 to remove and 311 not upgraded. 2024-04-01T01:41:52.028 INFO:teuthology.orchestra.run.smithi050.stdout:Need to get 113 MB of archives. 2024-04-01T01:41:52.028 INFO:teuthology.orchestra.run.smithi050.stdout:After this operation, 582 MB of additional disk space will be used. 2024-04-01T01:41:52.028 INFO:teuthology.orchestra.run.smithi050.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-101-generic amd64 5.15.0-101.111 [22.6 MB] 2024-04-01T01:41:52.846 INFO:teuthology.orchestra.run.smithi050.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-101-generic amd64 5.15.0-101.111 [11.5 MB] 2024-04-01T01:41:53.048 INFO:teuthology.orchestra.run.smithi050.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-101-generic amd64 5.15.0-101.111 [63.9 MB] 2024-04-01T01:41:53.217 INFO:teuthology.orchestra.run.smithi097.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.101.98 [1,698 B] 2024-04-01T01:41:53.218 INFO:teuthology.orchestra.run.smithi097.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.101.98 [2,486 B] 2024-04-01T01:41:53.218 INFO:teuthology.orchestra.run.smithi097.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-101 all 5.15.0-101.111 [12.3 MB] 2024-04-01T01:41:53.969 INFO:teuthology.orchestra.run.smithi097.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-101-generic amd64 5.15.0-101.111 [2,876 kB] 2024-04-01T01:41:54.286 INFO:teuthology.orchestra.run.smithi097.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.101.98 [2,332 B] 2024-04-01T01:41:54.327 INFO:teuthology.orchestra.run.smithi050.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.101.98 [1,698 B] 2024-04-01T01:41:54.327 INFO:teuthology.orchestra.run.smithi050.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.101.98 [2,486 B] 2024-04-01T01:41:54.327 INFO:teuthology.orchestra.run.smithi050.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-101 all 5.15.0-101.111 [12.3 MB] 2024-04-01T01:41:54.697 INFO:teuthology.orchestra.run.smithi097.stdout:Fetched 113 MB in 3s (37.8 MB/s) 2024-04-01T01:41:54.776 INFO:teuthology.orchestra.run.smithi050.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-101-generic amd64 5.15.0-101.111 [2,876 kB] 2024-04-01T01:41:54.881 INFO:teuthology.orchestra.run.smithi050.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.101.98 [2,332 B] 2024-04-01T01:41:54.885 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package linux-modules-5.15.0-101-generic. 2024-04-01T01:41:55.337 INFO:teuthology.orchestra.run.smithi050.stdout:Fetched 113 MB in 3s (38.8 MB/s) 2024-04-01T01:41:55.539 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package linux-modules-5.15.0-101-generic. 2024-04-01T01:41:56.871 INFO:teuthology.orchestra.run.smithi097.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-04-01T01:41:56.876 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../0-linux-modules-5.15.0-101-generic_5.15.0-101.111_amd64.deb ... 2024-04-01T01:41:56.950 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking linux-modules-5.15.0-101-generic (5.15.0-101.111) ... 2024-04-01T01:41:57.614 INFO:teuthology.orchestra.run.smithi050.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-04-01T01:41:57.619 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../0-linux-modules-5.15.0-101-generic_5.15.0-101.111_amd64.deb ... 2024-04-01T01:41:57.739 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking linux-modules-5.15.0-101-generic (5.15.0-101.111) ... 2024-04-01T01:41:59.027 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package linux-image-5.15.0-101-generic. 2024-04-01T01:41:59.048 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../1-linux-image-5.15.0-101-generic_5.15.0-101.111_amd64.deb ... 2024-04-01T01:41:59.132 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking linux-image-5.15.0-101-generic (5.15.0-101.111) ... 2024-04-01T01:41:59.580 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-101-generic. 2024-04-01T01:41:59.593 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-101-generic_5.15.0-101.111_amd64.deb ... 2024-04-01T01:41:59.622 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking linux-modules-extra-5.15.0-101-generic (5.15.0-101.111) ... 2024-04-01T01:41:59.890 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package linux-image-5.15.0-101-generic. 2024-04-01T01:41:59.911 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../1-linux-image-5.15.0-101-generic_5.15.0-101.111_amd64.deb ... 2024-04-01T01:42:00.005 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking linux-image-5.15.0-101-generic (5.15.0-101.111) ... 2024-04-01T01:42:00.510 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-101-generic. 2024-04-01T01:42:00.530 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-101-generic_5.15.0-101.111_amd64.deb ... 2024-04-01T01:42:00.574 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking linux-modules-extra-5.15.0-101-generic (5.15.0-101.111) ... 2024-04-01T01:42:06.367 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../3-linux-generic_5.15.0.101.98_amd64.deb ... 2024-04-01T01:42:06.492 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking linux-generic (5.15.0.101.98) over (5.15.0.56.54) ... 2024-04-01T01:42:06.817 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.101.98_amd64.deb ... 2024-04-01T01:42:06.946 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking linux-image-generic (5.15.0.101.98) over (5.15.0.56.54) ... 2024-04-01T01:42:07.266 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package linux-headers-5.15.0-101. 2024-04-01T01:42:07.288 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../5-linux-headers-5.15.0-101_5.15.0-101.111_all.deb ... 2024-04-01T01:42:07.332 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking linux-headers-5.15.0-101 (5.15.0-101.111) ... 2024-04-01T01:42:07.595 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../3-linux-generic_5.15.0.101.98_amd64.deb ... 2024-04-01T01:42:07.727 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking linux-generic (5.15.0.101.98) over (5.15.0.56.54) ... 2024-04-01T01:42:08.070 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.101.98_amd64.deb ... 2024-04-01T01:42:08.198 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking linux-image-generic (5.15.0.101.98) over (5.15.0.56.54) ... 2024-04-01T01:42:08.534 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package linux-headers-5.15.0-101. 2024-04-01T01:42:08.557 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../5-linux-headers-5.15.0-101_5.15.0-101.111_all.deb ... 2024-04-01T01:42:08.600 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking linux-headers-5.15.0-101 (5.15.0-101.111) ... 2024-04-01T01:42:12.990 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package linux-headers-5.15.0-101-generic. 2024-04-01T01:42:13.026 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../6-linux-headers-5.15.0-101-generic_5.15.0-101.111_amd64.deb ... 2024-04-01T01:42:13.064 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking linux-headers-5.15.0-101-generic (5.15.0-101.111) ... 2024-04-01T01:42:14.367 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package linux-headers-5.15.0-101-generic. 2024-04-01T01:42:14.404 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../6-linux-headers-5.15.0-101-generic_5.15.0-101.111_amd64.deb ... 2024-04-01T01:42:14.442 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking linux-headers-5.15.0-101-generic (5.15.0-101.111) ... 2024-04-01T01:42:15.651 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.101.98_amd64.deb ... 2024-04-01T01:42:15.777 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking linux-headers-generic (5.15.0.101.98) over (5.15.0.56.54) ... 2024-04-01T01:42:16.111 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up linux-headers-5.15.0-101 (5.15.0-101.111) ... 2024-04-01T01:42:16.232 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up linux-headers-5.15.0-101-generic (5.15.0-101.111) ... 2024-04-01T01:42:16.358 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up linux-headers-generic (5.15.0.101.98) ... 2024-04-01T01:42:16.462 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up linux-image-5.15.0-101-generic (5.15.0-101.111) ... 2024-04-01T01:42:17.754 INFO:teuthology.orchestra.run.smithi097.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-04-01T01:42:17.754 INFO:teuthology.orchestra.run.smithi097.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-04-01T01:42:17.755 INFO:teuthology.orchestra.run.smithi097.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-101-generic 2024-04-01T01:42:17.755 INFO:teuthology.orchestra.run.smithi097.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-101-generic 2024-04-01T01:42:17.898 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.101.98_amd64.deb ... 2024-04-01T01:42:17.923 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up linux-modules-extra-5.15.0-101-generic (5.15.0-101.111) ... 2024-04-01T01:42:18.019 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking linux-headers-generic (5.15.0.101.98) over (5.15.0.56.54) ... 2024-04-01T01:42:18.395 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up linux-headers-5.15.0-101 (5.15.0-101.111) ... 2024-04-01T01:42:18.516 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up linux-headers-5.15.0-101-generic (5.15.0-101.111) ... 2024-04-01T01:42:18.660 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up linux-headers-generic (5.15.0.101.98) ... 2024-04-01T01:42:19.255 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up linux-image-5.15.0-101-generic (5.15.0-101.111) ... 2024-04-01T01:42:19.641 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up linux-modules-5.15.0-101-generic (5.15.0-101.111) ... 2024-04-01T01:42:21.020 INFO:teuthology.orchestra.run.smithi050.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-04-01T01:42:21.020 INFO:teuthology.orchestra.run.smithi050.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-04-01T01:42:21.020 INFO:teuthology.orchestra.run.smithi050.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-101-generic 2024-04-01T01:42:21.021 INFO:teuthology.orchestra.run.smithi050.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-101-generic 2024-04-01T01:42:21.084 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up linux-image-generic (5.15.0.101.98) ... 2024-04-01T01:42:21.174 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up linux-modules-extra-5.15.0-101-generic (5.15.0-101.111) ... 2024-04-01T01:42:21.210 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up linux-generic (5.15.0.101.98) ... 2024-04-01T01:42:21.336 INFO:teuthology.orchestra.run.smithi097.stdout:Processing triggers for linux-image-5.15.0-101-generic (5.15.0-101.111) ... 2024-04-01T01:42:21.403 INFO:teuthology.orchestra.run.smithi097.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-01T01:42:21.404 INFO:teuthology.orchestra.run.smithi097.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-101-generic 2024-04-01T01:42:22.599 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up linux-modules-5.15.0-101-generic (5.15.0-101.111) ... 2024-04-01T01:42:24.067 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up linux-image-generic (5.15.0.101.98) ... 2024-04-01T01:42:24.210 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up linux-generic (5.15.0.101.98) ... 2024-04-01T01:42:24.336 INFO:teuthology.orchestra.run.smithi050.stdout:Processing triggers for linux-image-5.15.0-101-generic (5.15.0-101.111) ... 2024-04-01T01:42:24.428 INFO:teuthology.orchestra.run.smithi050.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-01T01:42:24.428 INFO:teuthology.orchestra.run.smithi050.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-101-generic 2024-04-01T01:42:36.106 INFO:teuthology.orchestra.run.smithi097.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-01T01:42:36.106 INFO:teuthology.orchestra.run.smithi097.stdout:Sourcing file `/etc/default/grub' 2024-04-01T01:42:36.120 INFO:teuthology.orchestra.run.smithi097.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-01T01:42:36.143 INFO:teuthology.orchestra.run.smithi097.stdout:Generating grub configuration file ... 2024-04-01T01:42:36.417 INFO:teuthology.orchestra.run.smithi097.stdout:Found linux image: /boot/vmlinuz-5.15.0-101-generic 2024-04-01T01:42:36.432 INFO:teuthology.orchestra.run.smithi097.stdout:Found initrd image: /boot/initrd.img-5.15.0-101-generic 2024-04-01T01:42:36.724 INFO:teuthology.orchestra.run.smithi097.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-01T01:42:36.730 INFO:teuthology.orchestra.run.smithi097.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-01T01:42:36.799 INFO:teuthology.orchestra.run.smithi097.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-01T01:42:36.805 INFO:teuthology.orchestra.run.smithi097.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-01T01:42:36.974 INFO:teuthology.orchestra.run.smithi097.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-01T01:42:36.974 INFO:teuthology.orchestra.run.smithi097.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-04-01T01:42:36.974 INFO:teuthology.orchestra.run.smithi097.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-01T01:42:37.009 INFO:teuthology.orchestra.run.smithi097.stdout:done 2024-04-01T01:42:37.473 DEBUG:teuthology.orchestra.run.smithi097:> dpkg -s linux-image-generic 2024-04-01T01:42:37.497 INFO:teuthology.orchestra.run.smithi097.stdout:Package: linux-image-generic 2024-04-01T01:42:37.497 INFO:teuthology.orchestra.run.smithi097.stdout:Status: install ok installed 2024-04-01T01:42:37.497 INFO:teuthology.orchestra.run.smithi097.stdout:Priority: optional 2024-04-01T01:42:37.497 INFO:teuthology.orchestra.run.smithi097.stdout:Section: kernel 2024-04-01T01:42:37.498 INFO:teuthology.orchestra.run.smithi097.stdout:Installed-Size: 21 2024-04-01T01:42:37.498 INFO:teuthology.orchestra.run.smithi097.stdout:Maintainer: Ubuntu Kernel Team 2024-04-01T01:42:37.498 INFO:teuthology.orchestra.run.smithi097.stdout:Architecture: amd64 2024-04-01T01:42:37.498 INFO:teuthology.orchestra.run.smithi097.stdout:Source: linux-meta 2024-04-01T01:42:37.498 INFO:teuthology.orchestra.run.smithi097.stdout:Version: 5.15.0.101.98 2024-04-01T01:42:37.498 INFO:teuthology.orchestra.run.smithi097.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-101), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-01T01:42:37.498 INFO:teuthology.orchestra.run.smithi097.stdout:Depends: linux-image-5.15.0-101-generic, linux-modules-extra-5.15.0-101-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-01T01:42:37.498 INFO:teuthology.orchestra.run.smithi097.stdout:Recommends: thermald 2024-04-01T01:42:37.498 INFO:teuthology.orchestra.run.smithi097.stdout:Description: Generic Linux kernel image 2024-04-01T01:42:37.498 INFO:teuthology.orchestra.run.smithi097.stdout: This package will always depend on the latest generic kernel image 2024-04-01T01:42:37.498 INFO:teuthology.orchestra.run.smithi097.stdout: available. 2024-04-01T01:42:37.499 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-101-generic 2024-04-01T01:42:37.499 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-01T01:42:37.499 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-01T01:42:37.499 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-04-01T01:42:37.499 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi097.front.sepia.ceph.com, path=None, version=distro) 2024-04-01T01:42:37.499 DEBUG:teuthology.orchestra.run.smithi097:> sudo apt-get clean 2024-04-01T01:42:37.653 DEBUG:teuthology.orchestra.run.smithi097:> sudo apt-get update 2024-04-01T01:42:37.778 INFO:teuthology.orchestra.run.smithi097.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-01T01:42:37.778 INFO:teuthology.orchestra.run.smithi097.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-01T01:42:37.790 INFO:teuthology.orchestra.run.smithi097.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-01T01:42:37.811 INFO:teuthology.orchestra.run.smithi097.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-01T01:42:39.118 INFO:teuthology.orchestra.run.smithi097.stdout:Reading package lists... 2024-04-01T01:42:39.127 INFO:teuthology.orchestra.run.smithi050.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-01T01:42:39.127 INFO:teuthology.orchestra.run.smithi050.stdout:Sourcing file `/etc/default/grub' 2024-04-01T01:42:39.137 DEBUG:teuthology.orchestra.run.smithi097:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-01T01:42:39.144 INFO:teuthology.orchestra.run.smithi050.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-01T01:42:39.171 INFO:teuthology.orchestra.run.smithi050.stdout:Generating grub configuration file ... 2024-04-01T01:42:39.198 INFO:teuthology.orchestra.run.smithi097.stdout:Reading package lists... 2024-04-01T01:42:39.396 INFO:teuthology.orchestra.run.smithi097.stdout:Building dependency tree... 2024-04-01T01:42:39.397 INFO:teuthology.orchestra.run.smithi097.stdout:Reading state information... 2024-04-01T01:42:39.489 INFO:teuthology.orchestra.run.smithi050.stdout:Found linux image: /boot/vmlinuz-5.15.0-101-generic 2024-04-01T01:42:39.512 INFO:teuthology.orchestra.run.smithi050.stdout:Found initrd image: /boot/initrd.img-5.15.0-101-generic 2024-04-01T01:42:39.569 INFO:teuthology.orchestra.run.smithi097.stdout:linux-image-generic is already the newest version (5.15.0.101.98). 2024-04-01T01:42:39.569 INFO:teuthology.orchestra.run.smithi097.stdout:The following packages were automatically installed and are no longer required: 2024-04-01T01:42:39.569 INFO:teuthology.orchestra.run.smithi097.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-01T01:42:39.570 INFO:teuthology.orchestra.run.smithi097.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-01T01:42:39.570 INFO:teuthology.orchestra.run.smithi097.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-01T01:42:39.570 INFO:teuthology.orchestra.run.smithi097.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-01T01:42:39.570 INFO:teuthology.orchestra.run.smithi097.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-01T01:42:39.570 INFO:teuthology.orchestra.run.smithi097.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-01T01:42:39.608 INFO:teuthology.orchestra.run.smithi097.stdout:0 upgraded, 0 newly installed, 0 to remove and 311 not upgraded. 2024-04-01T01:42:39.610 DEBUG:teuthology.orchestra.run.smithi097:> dpkg -s linux-image-generic 2024-04-01T01:42:39.625 INFO:teuthology.orchestra.run.smithi097.stdout:Package: linux-image-generic 2024-04-01T01:42:39.625 INFO:teuthology.orchestra.run.smithi097.stdout:Status: install ok installed 2024-04-01T01:42:39.625 INFO:teuthology.orchestra.run.smithi097.stdout:Priority: optional 2024-04-01T01:42:39.626 INFO:teuthology.orchestra.run.smithi097.stdout:Section: kernel 2024-04-01T01:42:39.626 INFO:teuthology.orchestra.run.smithi097.stdout:Installed-Size: 21 2024-04-01T01:42:39.626 INFO:teuthology.orchestra.run.smithi097.stdout:Maintainer: Ubuntu Kernel Team 2024-04-01T01:42:39.626 INFO:teuthology.orchestra.run.smithi097.stdout:Architecture: amd64 2024-04-01T01:42:39.626 INFO:teuthology.orchestra.run.smithi097.stdout:Source: linux-meta 2024-04-01T01:42:39.626 INFO:teuthology.orchestra.run.smithi097.stdout:Version: 5.15.0.101.98 2024-04-01T01:42:39.626 INFO:teuthology.orchestra.run.smithi097.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-101), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-01T01:42:39.626 INFO:teuthology.orchestra.run.smithi097.stdout:Depends: linux-image-5.15.0-101-generic, linux-modules-extra-5.15.0-101-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-01T01:42:39.626 INFO:teuthology.orchestra.run.smithi097.stdout:Recommends: thermald 2024-04-01T01:42:39.626 INFO:teuthology.orchestra.run.smithi097.stdout:Description: Generic Linux kernel image 2024-04-01T01:42:39.626 INFO:teuthology.orchestra.run.smithi097.stdout: This package will always depend on the latest generic kernel image 2024-04-01T01:42:39.626 INFO:teuthology.orchestra.run.smithi097.stdout: available. 2024-04-01T01:42:39.627 DEBUG:teuthology.orchestra.run.smithi097:> mktemp 2024-04-01T01:42:39.675 INFO:teuthology.orchestra.run.smithi097.stdout:/tmp/tmp.36UdCnlwfG 2024-04-01T01:42:39.675 DEBUG:teuthology.orchestra.run.smithi097:> sudo cp /boot/grub/grub.cfg /tmp/tmp.36UdCnlwfG 2024-04-01T01:42:39.731 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod 0666 /tmp/tmp.36UdCnlwfG 2024-04-01T01:42:39.852 DEBUG:teuthology.orchestra.remote:smithi097:/tmp/tmp.36UdCnlwfG is 10KB 2024-04-01T01:42:39.865 DEBUG:teuthology.orchestra.run.smithi097:> rm -fr /tmp/tmp.36UdCnlwfG 2024-04-01T01:42:39.870 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-01T01:42:39.923 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-04-01T01:42:39.923 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-01T01:42:39.923 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-01T01:42:40.005 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-101-generic 2024-04-01T01:42:40.005 DEBUG:teuthology.orchestra.run.smithi097:> sudo update-grub 2024-04-01T01:42:40.094 INFO:teuthology.orchestra.run.smithi050.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-01T01:42:40.099 INFO:teuthology.orchestra.run.smithi050.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-01T01:42:40.174 INFO:teuthology.orchestra.run.smithi050.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-01T01:42:40.180 INFO:teuthology.orchestra.run.smithi050.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-01T01:42:40.350 INFO:teuthology.orchestra.run.smithi050.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-01T01:42:40.350 INFO:teuthology.orchestra.run.smithi050.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-04-01T01:42:40.350 INFO:teuthology.orchestra.run.smithi050.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-01T01:42:40.391 INFO:teuthology.orchestra.run.smithi050.stdout:done 2024-04-01T01:42:40.833 DEBUG:teuthology.orchestra.run.smithi050:> dpkg -s linux-image-generic 2024-04-01T01:42:40.849 INFO:teuthology.orchestra.run.smithi050.stdout:Package: linux-image-generic 2024-04-01T01:42:40.850 INFO:teuthology.orchestra.run.smithi050.stdout:Status: install ok installed 2024-04-01T01:42:40.850 INFO:teuthology.orchestra.run.smithi050.stdout:Priority: optional 2024-04-01T01:42:40.850 INFO:teuthology.orchestra.run.smithi050.stdout:Section: kernel 2024-04-01T01:42:40.850 INFO:teuthology.orchestra.run.smithi050.stdout:Installed-Size: 21 2024-04-01T01:42:40.850 INFO:teuthology.orchestra.run.smithi050.stdout:Maintainer: Ubuntu Kernel Team 2024-04-01T01:42:40.850 INFO:teuthology.orchestra.run.smithi050.stdout:Architecture: amd64 2024-04-01T01:42:40.850 INFO:teuthology.orchestra.run.smithi050.stdout:Source: linux-meta 2024-04-01T01:42:40.850 INFO:teuthology.orchestra.run.smithi050.stdout:Version: 5.15.0.101.98 2024-04-01T01:42:40.850 INFO:teuthology.orchestra.run.smithi050.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-101), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-01T01:42:40.850 INFO:teuthology.orchestra.run.smithi050.stdout:Depends: linux-image-5.15.0-101-generic, linux-modules-extra-5.15.0-101-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-01T01:42:40.851 INFO:teuthology.orchestra.run.smithi050.stdout:Recommends: thermald 2024-04-01T01:42:40.851 INFO:teuthology.orchestra.run.smithi050.stdout:Description: Generic Linux kernel image 2024-04-01T01:42:40.851 INFO:teuthology.orchestra.run.smithi050.stdout: This package will always depend on the latest generic kernel image 2024-04-01T01:42:40.851 INFO:teuthology.orchestra.run.smithi050.stdout: available. 2024-04-01T01:42:40.851 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-101-generic 2024-04-01T01:42:40.851 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-01T01:42:40.851 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-01T01:42:40.851 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-04-01T01:42:40.851 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi050.front.sepia.ceph.com, path=None, version=distro) 2024-04-01T01:42:40.851 DEBUG:teuthology.orchestra.run.smithi050:> sudo apt-get clean 2024-04-01T01:42:41.016 DEBUG:teuthology.orchestra.run.smithi050:> sudo apt-get update 2024-04-01T01:42:41.144 INFO:teuthology.orchestra.run.smithi050.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-01T01:42:41.179 INFO:teuthology.orchestra.run.smithi097.stderr:Sourcing file `/etc/default/grub' 2024-04-01T01:42:41.181 INFO:teuthology.orchestra.run.smithi097.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-01T01:42:41.183 INFO:teuthology.orchestra.run.smithi097.stderr:Generating grub configuration file ... 2024-04-01T01:42:41.261 INFO:teuthology.orchestra.run.smithi050.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-01T01:42:41.347 INFO:teuthology.orchestra.run.smithi050.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-01T01:42:41.366 INFO:teuthology.orchestra.run.smithi097.stderr:Found linux image: /boot/vmlinuz-5.15.0-101-generic 2024-04-01T01:42:41.372 INFO:teuthology.orchestra.run.smithi097.stderr:Found initrd image: /boot/initrd.img-5.15.0-101-generic 2024-04-01T01:42:41.439 INFO:teuthology.orchestra.run.smithi050.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-01T01:42:41.618 INFO:teuthology.orchestra.run.smithi097.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-01T01:42:41.623 INFO:teuthology.orchestra.run.smithi097.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-01T01:42:41.664 INFO:teuthology.orchestra.run.smithi097.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-01T01:42:41.669 INFO:teuthology.orchestra.run.smithi097.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-01T01:42:41.780 INFO:teuthology.orchestra.run.smithi097.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-01T01:42:41.780 INFO:teuthology.orchestra.run.smithi097.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-01T01:42:41.780 INFO:teuthology.orchestra.run.smithi097.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-01T01:42:41.791 INFO:teuthology.orchestra.run.smithi097.stderr:done 2024-04-01T01:42:41.805 DEBUG:teuthology.orchestra.run.smithi097:> sudo shutdown -r now 2024-04-01T01:42:42.566 INFO:teuthology.orchestra.run.smithi050.stdout:Reading package lists... 2024-04-01T01:42:42.585 DEBUG:teuthology.orchestra.run.smithi050:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-01T01:42:42.646 INFO:teuthology.orchestra.run.smithi050.stdout:Reading package lists... 2024-04-01T01:42:42.847 INFO:teuthology.orchestra.run.smithi050.stdout:Building dependency tree... 2024-04-01T01:42:42.847 INFO:teuthology.orchestra.run.smithi050.stdout:Reading state information... 2024-04-01T01:42:43.031 INFO:teuthology.orchestra.run.smithi050.stdout:linux-image-generic is already the newest version (5.15.0.101.98). 2024-04-01T01:42:43.031 INFO:teuthology.orchestra.run.smithi050.stdout:The following packages were automatically installed and are no longer required: 2024-04-01T01:42:43.031 INFO:teuthology.orchestra.run.smithi050.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-01T01:42:43.031 INFO:teuthology.orchestra.run.smithi050.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-01T01:42:43.031 INFO:teuthology.orchestra.run.smithi050.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-01T01:42:43.032 INFO:teuthology.orchestra.run.smithi050.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-01T01:42:43.032 INFO:teuthology.orchestra.run.smithi050.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-01T01:42:43.032 INFO:teuthology.orchestra.run.smithi050.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-01T01:42:43.073 INFO:teuthology.orchestra.run.smithi050.stdout:0 upgraded, 0 newly installed, 0 to remove and 311 not upgraded. 2024-04-01T01:42:43.075 DEBUG:teuthology.orchestra.run.smithi050:> dpkg -s linux-image-generic 2024-04-01T01:42:43.091 INFO:teuthology.orchestra.run.smithi050.stdout:Package: linux-image-generic 2024-04-01T01:42:43.091 INFO:teuthology.orchestra.run.smithi050.stdout:Status: install ok installed 2024-04-01T01:42:43.091 INFO:teuthology.orchestra.run.smithi050.stdout:Priority: optional 2024-04-01T01:42:43.091 INFO:teuthology.orchestra.run.smithi050.stdout:Section: kernel 2024-04-01T01:42:43.091 INFO:teuthology.orchestra.run.smithi050.stdout:Installed-Size: 21 2024-04-01T01:42:43.091 INFO:teuthology.orchestra.run.smithi050.stdout:Maintainer: Ubuntu Kernel Team 2024-04-01T01:42:43.091 INFO:teuthology.orchestra.run.smithi050.stdout:Architecture: amd64 2024-04-01T01:42:43.092 INFO:teuthology.orchestra.run.smithi050.stdout:Source: linux-meta 2024-04-01T01:42:43.092 INFO:teuthology.orchestra.run.smithi050.stdout:Version: 5.15.0.101.98 2024-04-01T01:42:43.092 INFO:teuthology.orchestra.run.smithi050.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-101), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-01T01:42:43.092 INFO:teuthology.orchestra.run.smithi050.stdout:Depends: linux-image-5.15.0-101-generic, linux-modules-extra-5.15.0-101-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-01T01:42:43.092 INFO:teuthology.orchestra.run.smithi050.stdout:Recommends: thermald 2024-04-01T01:42:43.092 INFO:teuthology.orchestra.run.smithi050.stdout:Description: Generic Linux kernel image 2024-04-01T01:42:43.092 INFO:teuthology.orchestra.run.smithi050.stdout: This package will always depend on the latest generic kernel image 2024-04-01T01:42:43.092 INFO:teuthology.orchestra.run.smithi050.stdout: available. 2024-04-01T01:42:43.092 DEBUG:teuthology.orchestra.run.smithi050:> mktemp 2024-04-01T01:42:43.139 INFO:teuthology.orchestra.run.smithi050.stdout:/tmp/tmp.KVxHeGH0D6 2024-04-01T01:42:43.139 DEBUG:teuthology.orchestra.run.smithi050:> sudo cp /boot/grub/grub.cfg /tmp/tmp.KVxHeGH0D6 2024-04-01T01:42:43.207 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 0666 /tmp/tmp.KVxHeGH0D6 2024-04-01T01:42:43.324 DEBUG:teuthology.orchestra.remote:smithi050:/tmp/tmp.KVxHeGH0D6 is 10KB 2024-04-01T01:42:43.338 DEBUG:teuthology.orchestra.run.smithi050:> rm -fr /tmp/tmp.KVxHeGH0D6 2024-04-01T01:42:43.344 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-01T01:42:43.399 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-04-01T01:42:43.400 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-01T01:42:43.400 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-01T01:42:43.475 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-101-generic 2024-04-01T01:42:43.475 DEBUG:teuthology.orchestra.run.smithi050:> sudo update-grub 2024-04-01T01:42:44.778 INFO:teuthology.orchestra.run.smithi050.stderr:Sourcing file `/etc/default/grub' 2024-04-01T01:42:44.779 INFO:teuthology.orchestra.run.smithi050.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-01T01:42:44.782 INFO:teuthology.orchestra.run.smithi050.stderr:Generating grub configuration file ... 2024-04-01T01:42:45.042 INFO:teuthology.orchestra.run.smithi050.stderr:Found linux image: /boot/vmlinuz-5.15.0-101-generic 2024-04-01T01:42:45.049 INFO:teuthology.orchestra.run.smithi050.stderr:Found initrd image: /boot/initrd.img-5.15.0-101-generic 2024-04-01T01:42:45.401 INFO:teuthology.orchestra.run.smithi050.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-01T01:42:45.407 INFO:teuthology.orchestra.run.smithi050.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-01T01:42:45.453 INFO:teuthology.orchestra.run.smithi050.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-01T01:42:45.459 INFO:teuthology.orchestra.run.smithi050.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-01T01:42:45.629 INFO:teuthology.orchestra.run.smithi050.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-01T01:42:45.630 INFO:teuthology.orchestra.run.smithi050.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-01T01:42:45.630 INFO:teuthology.orchestra.run.smithi050.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-01T01:42:45.659 INFO:teuthology.orchestra.run.smithi050.stderr:done 2024-04-01T01:42:45.668 DEBUG:teuthology.orchestra.run.smithi050:> sudo shutdown -r now 2024-04-01T01:43:11.828 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-04-01T01:43:11.829 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi097.front.sepia.ceph.com' 2024-04-01T01:43:11.830 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T01:43:15.675 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-01T01:43:15.675 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2024-04-01T01:43:15.675 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T01:43:30.335 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.97 2024-04-01T01:43:34.174 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.50 2024-04-01T01:43:39.341 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi097.front.sepia.ceph.com' 2024-04-01T01:43:39.342 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T01:43:42.398 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.97 2024-04-01T01:43:43.176 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2024-04-01T01:43:43.177 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T01:43:54.410 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi097.front.sepia.ceph.com' 2024-04-01T01:43:54.411 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T01:44:12.830 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.97 2024-04-01T01:44:27.842 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi097.front.sepia.ceph.com' 2024-04-01T01:44:27.844 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T01:44:27.846 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.97 2024-04-01T01:44:43.194 DEBUG:teuthology.orchestra.remote:timed out 2024-04-01T01:44:45.849 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi097.front.sepia.ceph.com' 2024-04-01T01:44:45.851 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T01:44:46.097 DEBUG:teuthology.orchestra.run.smithi097:> true 2024-04-01T01:44:46.692 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi097.front.sepia.ceph.com' 2024-04-01T01:44:46.692 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-101-generic"... 2024-04-01T01:44:46.692 DEBUG:teuthology.orchestra.run.smithi097:> uname -r 2024-04-01T01:44:46.739 INFO:teuthology.orchestra.run.smithi097.stdout:5.15.0-101-generic 2024-04-01T01:44:46.740 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-101-generic vs 5.15.0-101-generic 2024-04-01T01:44:46.740 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-01T01:44:46.740 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-01T01:44:47.740 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-04-01T01:44:47.741 DEBUG:teuthology.orchestra.run.smithi097:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-01T01:44:48.060 INFO:teuthology.orchestra.run.smithi097.stdout:ttyS1 2024-04-01T01:44:48.081 DEBUG:teuthology.parallel:result is None 2024-04-01T01:44:55.195 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2024-04-01T01:44:55.196 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T01:44:55.464 DEBUG:teuthology.orchestra.run.smithi050:> true 2024-04-01T01:44:56.037 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi050.front.sepia.ceph.com' 2024-04-01T01:44:56.038 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-101-generic"... 2024-04-01T01:44:56.038 DEBUG:teuthology.orchestra.run.smithi050:> uname -r 2024-04-01T01:44:56.083 INFO:teuthology.orchestra.run.smithi050.stdout:5.15.0-101-generic 2024-04-01T01:44:56.083 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-101-generic vs 5.15.0-101-generic 2024-04-01T01:44:56.083 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-01T01:44:56.083 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-01T01:44:57.085 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-04-01T01:44:57.085 DEBUG:teuthology.orchestra.run.smithi050:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-01T01:44:57.165 INFO:teuthology.orchestra.run.smithi050.stdout:ttyS1 2024-04-01T01:44:57.185 DEBUG:teuthology.parallel:result is None 2024-04-01T01:44:57.185 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-01T01:44:57.196 INFO:teuthology.task.internal:Creating test directory... 2024-04-01T01:44:57.197 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-01T01:44:57.199 DEBUG:teuthology.orchestra.run.smithi097:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-01T01:44:57.206 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-01T01:44:57.214 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-01T01:44:57.220 INFO:teuthology.task.internal:Creating archive directory... 2024-04-01T01:44:57.220 DEBUG:teuthology.orchestra.run.smithi050:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-01T01:44:57.249 DEBUG:teuthology.orchestra.run.smithi097:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-01T01:44:57.266 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-01T01:44:57.273 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-01T01:44:57.273 DEBUG:teuthology.orchestra.run.smithi050:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-01T01:44:57.301 DEBUG:teuthology.orchestra.run.smithi097:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-01T01:44:57.322 INFO:teuthology.orchestra.run.smithi050.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-01T01:44:57.327 INFO:teuthology.orchestra.run.smithi097.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-01T01:44:57.330 INFO:teuthology.orchestra.run.smithi050.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-01T01:44:57.335 INFO:teuthology.orchestra.run.smithi097.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-01T01:44:57.336 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-01T01:44:57.343 INFO:teuthology.task.internal:Configuring sudo... 2024-04-01T01:44:57.344 DEBUG:teuthology.orchestra.run.smithi050:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-01T01:44:57.377 DEBUG:teuthology.orchestra.run.smithi097:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-01T01:44:57.391 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-01T01:44:57.399 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-01T01:44:57.399 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-01T01:44:57.433 DEBUG:teuthology.orchestra.run.smithi097:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-01T01:44:57.439 DEBUG:teuthology.orchestra.run.smithi050:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-01T01:44:57.484 DEBUG:teuthology.orchestra.run.smithi050:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-01T01:44:57.532 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-04-01T01:44:57.532 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-01T01:44:57.591 DEBUG:teuthology.orchestra.run.smithi097:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-01T01:44:57.597 DEBUG:teuthology.orchestra.run.smithi097:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-01T01:44:57.644 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-04-01T01:44:57.644 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-01T01:44:57.715 DEBUG:teuthology.orchestra.run.smithi050:> sudo service rsyslog restart 2024-04-01T01:44:57.717 DEBUG:teuthology.orchestra.run.smithi097:> sudo service rsyslog restart 2024-04-01T01:44:57.795 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-01T01:44:57.803 INFO:teuthology.task.internal:Starting timer... 2024-04-01T01:44:57.803 INFO:teuthology.run_tasks:Running task pcp... 2024-04-01T01:44:57.813 INFO:teuthology.run_tasks:Running task selinux... 2024-04-01T01:44:57.821 DEBUG:teuthology.task.selinux:Excluding smithi050: OS 'ubuntu' does not support SELinux 2024-04-01T01:44:57.821 DEBUG:teuthology.task.selinux:Excluding smithi097: OS 'ubuntu' does not support SELinux 2024-04-01T01:44:57.821 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-01T01:44:57.821 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-04-01T01:44:57.822 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-01T01:44:57.822 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-01T01:44:57.834 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-01T01:44:57.850 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-01T01:44:57.852 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi050.front.sepia.ceph.com,smithi097.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-01T01:52:02.210 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi050.front.sepia.ceph.com'), Remote(name='ubuntu@smithi097.front.sepia.ceph.com')] 2024-04-01T01:52:02.212 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2024-04-01T01:52:02.213 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T01:52:02.299 DEBUG:teuthology.orchestra.run.smithi050:> true 2024-04-01T01:52:02.382 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi050.front.sepia.ceph.com' 2024-04-01T01:52:02.383 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi097.front.sepia.ceph.com' 2024-04-01T01:52:02.383 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T01:52:02.468 DEBUG:teuthology.orchestra.run.smithi097:> true 2024-04-01T01:52:02.546 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi097.front.sepia.ceph.com' 2024-04-01T01:52:02.547 INFO:teuthology.run_tasks:Running task clock... 2024-04-01T01:52:02.558 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-01T01:52:02.558 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-01T01:52:02.558 DEBUG:teuthology.orchestra.run.smithi050:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-01T01:52:02.561 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-01T01:52:02.561 DEBUG:teuthology.orchestra.run.smithi097:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-01T01:52:02.589 INFO:teuthology.orchestra.run.smithi050.stdout: 1 Apr 01:52:02 ntpd[17061]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-01T01:52:02.590 INFO:teuthology.orchestra.run.smithi050.stdout: 1 Apr 01:52:02 ntpd[17061]: Command line: ntpd -gq 2024-04-01T01:52:02.590 INFO:teuthology.orchestra.run.smithi050.stdout: 1 Apr 01:52:02 ntpd[17061]: ---------------------------------------------------- 2024-04-01T01:52:02.590 INFO:teuthology.orchestra.run.smithi050.stdout: 1 Apr 01:52:02 ntpd[17061]: ntp-4 is maintained by Network Time Foundation, 2024-04-01T01:52:02.590 INFO:teuthology.orchestra.run.smithi050.stdout: 1 Apr 01:52:02 ntpd[17061]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-01T01:52:02.590 INFO:teuthology.orchestra.run.smithi050.stdout: 1 Apr 01:52:02 ntpd[17061]: corporation. Support and training for ntp-4 are 2024-04-01T01:52:02.590 INFO:teuthology.orchestra.run.smithi050.stdout: 1 Apr 01:52:02 ntpd[17061]: available at https://www.nwtime.org/support 2024-04-01T01:52:02.590 INFO:teuthology.orchestra.run.smithi050.stdout: 1 Apr 01:52:02 ntpd[17061]: ---------------------------------------------------- 2024-04-01T01:52:02.592 INFO:teuthology.orchestra.run.smithi050.stdout: 1 Apr 01:52:02 ntpd[17061]: proto: precision = 0.066 usec (-24) 2024-04-01T01:52:02.592 INFO:teuthology.orchestra.run.smithi050.stdout: 1 Apr 01:52:02 ntpd[17061]: basedate set to 2022-02-04 2024-04-01T01:52:02.592 INFO:teuthology.orchestra.run.smithi050.stdout: 1 Apr 01:52:02 ntpd[17061]: gps base set to 2022-02-06 (week 2196) 2024-04-01T01:52:02.592 INFO:teuthology.orchestra.run.smithi050.stdout: 1 Apr 01:52:02 ntpd[17061]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-01T01:52:02.592 INFO:teuthology.orchestra.run.smithi050.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-01T01:52:02.592 INFO:teuthology.orchestra.run.smithi050.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-01T01:52:02.593 INFO:teuthology.orchestra.run.smithi050.stdout: 1 Apr 01:52:02 ntpd[17061]: restrict ::: KOD does nothing without LIMITED. 2024-04-01T01:52:02.593 INFO:teuthology.orchestra.run.smithi050.stdout: 1 Apr 01:52:02 ntpd[17061]: Listen and drop on 0 v6wildcard [::]:123 2024-04-01T01:52:02.593 INFO:teuthology.orchestra.run.smithi050.stdout: 1 Apr 01:52:02 ntpd[17061]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-01T01:52:02.593 INFO:teuthology.orchestra.run.smithi050.stdout: 1 Apr 01:52:02 ntpd[17061]: Listen normally on 2 lo 127.0.0.1:123 2024-04-01T01:52:02.594 INFO:teuthology.orchestra.run.smithi050.stdout: 1 Apr 01:52:02 ntpd[17061]: Listen normally on 3 ens1f0 172.21.15.50:123 2024-04-01T01:52:02.594 INFO:teuthology.orchestra.run.smithi050.stdout: 1 Apr 01:52:02 ntpd[17061]: Listen normally on 4 lo [::1]:123 2024-04-01T01:52:02.594 INFO:teuthology.orchestra.run.smithi050.stdout: 1 Apr 01:52:02 ntpd[17061]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:1584%4]:123 2024-04-01T01:52:02.594 INFO:teuthology.orchestra.run.smithi050.stdout: 1 Apr 01:52:02 ntpd[17061]: Listening on routing socket on fd #22 for interface updates 2024-04-01T01:52:02.613 INFO:teuthology.orchestra.run.smithi097.stdout: 1 Apr 01:52:02 ntpd[17177]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-01T01:52:02.613 INFO:teuthology.orchestra.run.smithi097.stdout: 1 Apr 01:52:02 ntpd[17177]: Command line: ntpd -gq 2024-04-01T01:52:02.613 INFO:teuthology.orchestra.run.smithi097.stdout: 1 Apr 01:52:02 ntpd[17177]: ---------------------------------------------------- 2024-04-01T01:52:02.614 INFO:teuthology.orchestra.run.smithi097.stdout: 1 Apr 01:52:02 ntpd[17177]: ntp-4 is maintained by Network Time Foundation, 2024-04-01T01:52:02.614 INFO:teuthology.orchestra.run.smithi097.stdout: 1 Apr 01:52:02 ntpd[17177]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-01T01:52:02.614 INFO:teuthology.orchestra.run.smithi097.stdout: 1 Apr 01:52:02 ntpd[17177]: corporation. Support and training for ntp-4 are 2024-04-01T01:52:02.614 INFO:teuthology.orchestra.run.smithi097.stdout: 1 Apr 01:52:02 ntpd[17177]: available at https://www.nwtime.org/support 2024-04-01T01:52:02.614 INFO:teuthology.orchestra.run.smithi097.stdout: 1 Apr 01:52:02 ntpd[17177]: ---------------------------------------------------- 2024-04-01T01:52:02.614 INFO:teuthology.orchestra.run.smithi097.stdout: 1 Apr 01:52:02 ntpd[17177]: proto: precision = 0.061 usec (-24) 2024-04-01T01:52:02.615 INFO:teuthology.orchestra.run.smithi097.stdout: 1 Apr 01:52:02 ntpd[17177]: basedate set to 2022-02-04 2024-04-01T01:52:02.615 INFO:teuthology.orchestra.run.smithi097.stdout: 1 Apr 01:52:02 ntpd[17177]: gps base set to 2022-02-06 (week 2196) 2024-04-01T01:52:02.615 INFO:teuthology.orchestra.run.smithi097.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-01T01:52:02.615 INFO:teuthology.orchestra.run.smithi097.stdout: 1 Apr 01:52:02 ntpd[17177]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-01T01:52:02.615 INFO:teuthology.orchestra.run.smithi097.stdout: 1 Apr 01:52:02 ntpd[17177]: restrict ::: KOD does nothing without LIMITED. 2024-04-01T01:52:02.616 INFO:teuthology.orchestra.run.smithi097.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-01T01:52:02.616 INFO:teuthology.orchestra.run.smithi097.stdout: 1 Apr 01:52:02 ntpd[17177]: Listen and drop on 0 v6wildcard [::]:123 2024-04-01T01:52:02.617 INFO:teuthology.orchestra.run.smithi097.stdout: 1 Apr 01:52:02 ntpd[17177]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-01T01:52:02.617 INFO:teuthology.orchestra.run.smithi097.stdout: 1 Apr 01:52:02 ntpd[17177]: Listen normally on 2 lo 127.0.0.1:123 2024-04-01T01:52:02.617 INFO:teuthology.orchestra.run.smithi097.stdout: 1 Apr 01:52:02 ntpd[17177]: Listen normally on 3 enp3s0f1 172.21.15.97:123 2024-04-01T01:52:02.617 INFO:teuthology.orchestra.run.smithi097.stdout: 1 Apr 01:52:02 ntpd[17177]: Listen normally on 4 lo [::1]:123 2024-04-01T01:52:02.617 INFO:teuthology.orchestra.run.smithi097.stdout: 1 Apr 01:52:02 ntpd[17177]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d805%5]:123 2024-04-01T01:52:02.617 INFO:teuthology.orchestra.run.smithi097.stdout: 1 Apr 01:52:02 ntpd[17177]: Listening on routing socket on fd #22 for interface updates 2024-04-01T01:52:03.591 INFO:teuthology.orchestra.run.smithi050.stderr: 1 Apr 01:52:03 ntpd[17061]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-01T01:52:03.591 INFO:teuthology.orchestra.run.smithi050.stderr: 1 Apr 01:52:03 ntpd[17061]: can't open /var/log/ntpstats/rawstats.20240401: Permission denied 2024-04-01T01:52:03.591 INFO:teuthology.orchestra.run.smithi050.stderr: 1 Apr 01:52:03 ntpd[17061]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-01T01:52:03.591 INFO:teuthology.orchestra.run.smithi050.stderr: 1 Apr 01:52:03 ntpd[17061]: can't open /var/log/ntpstats/rawstats.20240401: Permission denied 2024-04-01T01:52:03.591 INFO:teuthology.orchestra.run.smithi050.stderr: 1 Apr 01:52:03 ntpd[17061]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-01T01:52:03.591 INFO:teuthology.orchestra.run.smithi050.stderr: 1 Apr 01:52:03 ntpd[17061]: can't open /var/log/ntpstats/rawstats.20240401: Permission denied 2024-04-01T01:52:03.591 INFO:teuthology.orchestra.run.smithi050.stderr: 1 Apr 01:52:03 ntpd[17061]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-01T01:52:03.591 INFO:teuthology.orchestra.run.smithi050.stderr: 1 Apr 01:52:03 ntpd[17061]: can't open /var/log/ntpstats/peerstats.20240401: Permission denied 2024-04-01T01:52:03.591 INFO:teuthology.orchestra.run.smithi050.stderr: 1 Apr 01:52:03 ntpd[17061]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-01T01:52:03.592 INFO:teuthology.orchestra.run.smithi050.stderr: 1 Apr 01:52:03 ntpd[17061]: can't open /var/log/ntpstats/rawstats.20240401: Permission denied 2024-04-01T01:52:03.592 INFO:teuthology.orchestra.run.smithi050.stderr: 1 Apr 01:52:03 ntpd[17061]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-01T01:52:03.592 INFO:teuthology.orchestra.run.smithi050.stderr: 1 Apr 01:52:03 ntpd[17061]: can't open /var/log/ntpstats/peerstats.20240401: Permission denied 2024-04-01T01:52:03.614 INFO:teuthology.orchestra.run.smithi097.stderr: 1 Apr 01:52:03 ntpd[17177]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-01T01:52:03.614 INFO:teuthology.orchestra.run.smithi097.stderr: 1 Apr 01:52:03 ntpd[17177]: can't open /var/log/ntpstats/rawstats.20240401: Permission denied 2024-04-01T01:52:03.614 INFO:teuthology.orchestra.run.smithi097.stderr: 1 Apr 01:52:03 ntpd[17177]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-01T01:52:03.614 INFO:teuthology.orchestra.run.smithi097.stderr: 1 Apr 01:52:03 ntpd[17177]: can't open /var/log/ntpstats/rawstats.20240401: Permission denied 2024-04-01T01:52:03.614 INFO:teuthology.orchestra.run.smithi097.stderr: 1 Apr 01:52:03 ntpd[17177]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-01T01:52:03.615 INFO:teuthology.orchestra.run.smithi097.stderr: 1 Apr 01:52:03 ntpd[17177]: can't open /var/log/ntpstats/rawstats.20240401: Permission denied 2024-04-01T01:52:03.615 INFO:teuthology.orchestra.run.smithi097.stderr: 1 Apr 01:52:03 ntpd[17177]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-01T01:52:03.615 INFO:teuthology.orchestra.run.smithi097.stderr: 1 Apr 01:52:03 ntpd[17177]: can't open /var/log/ntpstats/peerstats.20240401: Permission denied 2024-04-01T01:52:04.614 INFO:teuthology.orchestra.run.smithi097.stderr: 1 Apr 01:52:04 ntpd[17177]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-01T01:52:04.614 INFO:teuthology.orchestra.run.smithi097.stderr: 1 Apr 01:52:04 ntpd[17177]: can't open /var/log/ntpstats/rawstats.20240401: Permission denied 2024-04-01T01:52:04.614 INFO:teuthology.orchestra.run.smithi097.stderr: 1 Apr 01:52:04 ntpd[17177]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-01T01:52:04.614 INFO:teuthology.orchestra.run.smithi097.stderr: 1 Apr 01:52:04 ntpd[17177]: can't open /var/log/ntpstats/rawstats.20240401: Permission denied 2024-04-01T01:52:04.614 INFO:teuthology.orchestra.run.smithi097.stderr: 1 Apr 01:52:04 ntpd[17177]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-01T01:52:04.614 INFO:teuthology.orchestra.run.smithi097.stderr: 1 Apr 01:52:04 ntpd[17177]: can't open /var/log/ntpstats/peerstats.20240401: Permission denied 2024-04-01T01:52:05.592 INFO:teuthology.orchestra.run.smithi050.stderr: 1 Apr 01:52:05 ntpd[17061]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-01T01:52:05.593 INFO:teuthology.orchestra.run.smithi050.stderr: 1 Apr 01:52:05 ntpd[17061]: can't open /var/log/ntpstats/rawstats.20240401: Permission denied 2024-04-01T01:52:05.593 INFO:teuthology.orchestra.run.smithi050.stderr: 1 Apr 01:52:05 ntpd[17061]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-01T01:52:05.593 INFO:teuthology.orchestra.run.smithi050.stderr: 1 Apr 01:52:05 ntpd[17061]: can't open /var/log/ntpstats/rawstats.20240401: Permission denied 2024-04-01T01:52:05.593 INFO:teuthology.orchestra.run.smithi050.stderr: 1 Apr 01:52:05 ntpd[17061]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-01T01:52:05.593 INFO:teuthology.orchestra.run.smithi050.stderr: 1 Apr 01:52:05 ntpd[17061]: can't open /var/log/ntpstats/rawstats.20240401: Permission denied 2024-04-01T01:52:05.593 INFO:teuthology.orchestra.run.smithi050.stderr: 1 Apr 01:52:05 ntpd[17061]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-01T01:52:05.593 INFO:teuthology.orchestra.run.smithi050.stderr: 1 Apr 01:52:05 ntpd[17061]: can't open /var/log/ntpstats/rawstats.20240401: Permission denied 2024-04-01T01:52:05.593 INFO:teuthology.orchestra.run.smithi050.stderr: 1 Apr 01:52:05 ntpd[17061]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-01T01:52:05.593 INFO:teuthology.orchestra.run.smithi050.stderr: 1 Apr 01:52:05 ntpd[17061]: can't open /var/log/ntpstats/rawstats.20240401: Permission denied 2024-04-01T01:52:05.593 INFO:teuthology.orchestra.run.smithi050.stderr: 1 Apr 01:52:05 ntpd[17061]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-01T01:52:05.593 INFO:teuthology.orchestra.run.smithi050.stderr: 1 Apr 01:52:05 ntpd[17061]: can't open /var/log/ntpstats/peerstats.20240401: Permission denied 2024-04-01T01:52:05.593 INFO:teuthology.orchestra.run.smithi050.stderr: 1 Apr 01:52:05 ntpd[17061]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-01T01:52:05.594 INFO:teuthology.orchestra.run.smithi050.stderr: 1 Apr 01:52:05 ntpd[17061]: can't open /var/log/ntpstats/rawstats.20240401: Permission denied 2024-04-01T01:52:05.594 INFO:teuthology.orchestra.run.smithi050.stderr: 1 Apr 01:52:05 ntpd[17061]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-01T01:52:05.594 INFO:teuthology.orchestra.run.smithi050.stderr: 1 Apr 01:52:05 ntpd[17061]: can't open /var/log/ntpstats/peerstats.20240401: Permission denied 2024-04-01T01:52:05.594 INFO:teuthology.orchestra.run.smithi050.stderr: 1 Apr 01:52:05 ntpd[17061]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-01T01:52:05.594 INFO:teuthology.orchestra.run.smithi050.stderr: 1 Apr 01:52:05 ntpd[17061]: can't open /var/log/ntpstats/rawstats.20240401: Permission denied 2024-04-01T01:52:05.594 INFO:teuthology.orchestra.run.smithi050.stderr: 1 Apr 01:52:05 ntpd[17061]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-01T01:52:05.594 INFO:teuthology.orchestra.run.smithi050.stderr: 1 Apr 01:52:05 ntpd[17061]: can't open /var/log/ntpstats/peerstats.20240401: Permission denied 2024-04-01T01:52:05.614 INFO:teuthology.orchestra.run.smithi097.stderr: 1 Apr 01:52:05 ntpd[17177]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-01T01:52:05.614 INFO:teuthology.orchestra.run.smithi097.stderr: 1 Apr 01:52:05 ntpd[17177]: can't open /var/log/ntpstats/rawstats.20240401: Permission denied 2024-04-01T01:52:05.614 INFO:teuthology.orchestra.run.smithi097.stderr: 1 Apr 01:52:05 ntpd[17177]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-01T01:52:05.614 INFO:teuthology.orchestra.run.smithi097.stderr: 1 Apr 01:52:05 ntpd[17177]: can't open /var/log/ntpstats/rawstats.20240401: Permission denied 2024-04-01T01:52:05.614 INFO:teuthology.orchestra.run.smithi097.stderr: 1 Apr 01:52:05 ntpd[17177]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-01T01:52:05.614 INFO:teuthology.orchestra.run.smithi097.stderr: 1 Apr 01:52:05 ntpd[17177]: can't open /var/log/ntpstats/peerstats.20240401: Permission denied 2024-04-01T01:52:06.614 INFO:teuthology.orchestra.run.smithi097.stderr: 1 Apr 01:52:06 ntpd[17177]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-01T01:52:06.614 INFO:teuthology.orchestra.run.smithi097.stderr: 1 Apr 01:52:06 ntpd[17177]: can't open /var/log/ntpstats/rawstats.20240401: Permission denied 2024-04-01T01:52:06.615 INFO:teuthology.orchestra.run.smithi097.stderr: 1 Apr 01:52:06 ntpd[17177]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-01T01:52:06.615 INFO:teuthology.orchestra.run.smithi097.stderr: 1 Apr 01:52:06 ntpd[17177]: can't open /var/log/ntpstats/rawstats.20240401: Permission denied 2024-04-01T01:52:06.615 INFO:teuthology.orchestra.run.smithi097.stderr: 1 Apr 01:52:06 ntpd[17177]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-01T01:52:06.615 INFO:teuthology.orchestra.run.smithi097.stderr: 1 Apr 01:52:06 ntpd[17177]: can't open /var/log/ntpstats/peerstats.20240401: Permission denied 2024-04-01T01:52:07.592 INFO:teuthology.orchestra.run.smithi050.stderr: 1 Apr 01:52:07 ntpd[17061]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-01T01:52:07.592 INFO:teuthology.orchestra.run.smithi050.stderr: 1 Apr 01:52:07 ntpd[17061]: can't open /var/log/ntpstats/rawstats.20240401: Permission denied 2024-04-01T01:52:07.592 INFO:teuthology.orchestra.run.smithi050.stderr: 1 Apr 01:52:07 ntpd[17061]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-01T01:52:07.592 INFO:teuthology.orchestra.run.smithi050.stderr: 1 Apr 01:52:07 ntpd[17061]: can't open /var/log/ntpstats/rawstats.20240401: Permission denied 2024-04-01T01:52:07.592 INFO:teuthology.orchestra.run.smithi050.stderr: 1 Apr 01:52:07 ntpd[17061]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-01T01:52:07.592 INFO:teuthology.orchestra.run.smithi050.stderr: 1 Apr 01:52:07 ntpd[17061]: can't open /var/log/ntpstats/rawstats.20240401: Permission denied 2024-04-01T01:52:07.592 INFO:teuthology.orchestra.run.smithi050.stderr: 1 Apr 01:52:07 ntpd[17061]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-01T01:52:07.592 INFO:teuthology.orchestra.run.smithi050.stderr: 1 Apr 01:52:07 ntpd[17061]: can't open /var/log/ntpstats/rawstats.20240401: Permission denied 2024-04-01T01:52:07.593 INFO:teuthology.orchestra.run.smithi050.stderr: 1 Apr 01:52:07 ntpd[17061]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-01T01:52:07.593 INFO:teuthology.orchestra.run.smithi050.stderr: 1 Apr 01:52:07 ntpd[17061]: can't open /var/log/ntpstats/peerstats.20240401: Permission denied 2024-04-01T01:52:07.593 INFO:teuthology.orchestra.run.smithi050.stderr: 1 Apr 01:52:07 ntpd[17061]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-01T01:52:07.593 INFO:teuthology.orchestra.run.smithi050.stderr: 1 Apr 01:52:07 ntpd[17061]: can't open /var/log/ntpstats/rawstats.20240401: Permission denied 2024-04-01T01:52:07.593 INFO:teuthology.orchestra.run.smithi050.stderr: 1 Apr 01:52:07 ntpd[17061]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-01T01:52:07.593 INFO:teuthology.orchestra.run.smithi050.stderr: 1 Apr 01:52:07 ntpd[17061]: can't open /var/log/ntpstats/peerstats.20240401: Permission denied 2024-04-01T01:52:07.593 INFO:teuthology.orchestra.run.smithi050.stderr: 1 Apr 01:52:07 ntpd[17061]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-01T01:52:07.593 INFO:teuthology.orchestra.run.smithi050.stderr: 1 Apr 01:52:07 ntpd[17061]: can't open /var/log/ntpstats/rawstats.20240401: Permission denied 2024-04-01T01:52:07.593 INFO:teuthology.orchestra.run.smithi050.stderr: 1 Apr 01:52:07 ntpd[17061]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-01T01:52:07.593 INFO:teuthology.orchestra.run.smithi050.stderr: 1 Apr 01:52:07 ntpd[17061]: can't open /var/log/ntpstats/peerstats.20240401: Permission denied 2024-04-01T01:52:07.614 INFO:teuthology.orchestra.run.smithi097.stderr: 1 Apr 01:52:07 ntpd[17177]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-01T01:52:07.614 INFO:teuthology.orchestra.run.smithi097.stderr: 1 Apr 01:52:07 ntpd[17177]: can't open /var/log/ntpstats/rawstats.20240401: Permission denied 2024-04-01T01:52:07.615 INFO:teuthology.orchestra.run.smithi097.stderr: 1 Apr 01:52:07 ntpd[17177]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-01T01:52:07.615 INFO:teuthology.orchestra.run.smithi097.stderr: 1 Apr 01:52:07 ntpd[17177]: can't open /var/log/ntpstats/rawstats.20240401: Permission denied 2024-04-01T01:52:07.615 INFO:teuthology.orchestra.run.smithi097.stderr: 1 Apr 01:52:07 ntpd[17177]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-01T01:52:07.615 INFO:teuthology.orchestra.run.smithi097.stderr: 1 Apr 01:52:07 ntpd[17177]: can't open /var/log/ntpstats/rawstats.20240401: Permission denied 2024-04-01T01:52:07.615 INFO:teuthology.orchestra.run.smithi097.stderr: 1 Apr 01:52:07 ntpd[17177]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-01T01:52:07.615 INFO:teuthology.orchestra.run.smithi097.stderr: 1 Apr 01:52:07 ntpd[17177]: can't open /var/log/ntpstats/peerstats.20240401: Permission denied 2024-04-01T01:52:07.615 INFO:teuthology.orchestra.run.smithi097.stderr: 1 Apr 01:52:07 ntpd[17177]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-01T01:52:07.615 INFO:teuthology.orchestra.run.smithi097.stderr: 1 Apr 01:52:07 ntpd[17177]: can't open /var/log/ntpstats/rawstats.20240401: Permission denied 2024-04-01T01:52:07.615 INFO:teuthology.orchestra.run.smithi097.stderr: 1 Apr 01:52:07 ntpd[17177]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-01T01:52:07.615 INFO:teuthology.orchestra.run.smithi097.stderr: 1 Apr 01:52:07 ntpd[17177]: can't open /var/log/ntpstats/peerstats.20240401: Permission denied 2024-04-01T01:52:08.614 INFO:teuthology.orchestra.run.smithi097.stderr: 1 Apr 01:52:08 ntpd[17177]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-01T01:52:08.614 INFO:teuthology.orchestra.run.smithi097.stderr: 1 Apr 01:52:08 ntpd[17177]: can't open /var/log/ntpstats/rawstats.20240401: Permission denied 2024-04-01T01:52:08.614 INFO:teuthology.orchestra.run.smithi097.stderr: 1 Apr 01:52:08 ntpd[17177]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-01T01:52:08.615 INFO:teuthology.orchestra.run.smithi097.stderr: 1 Apr 01:52:08 ntpd[17177]: can't open /var/log/ntpstats/rawstats.20240401: Permission denied 2024-04-01T01:52:08.615 INFO:teuthology.orchestra.run.smithi097.stderr: 1 Apr 01:52:08 ntpd[17177]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-01T01:52:08.615 INFO:teuthology.orchestra.run.smithi097.stderr: 1 Apr 01:52:08 ntpd[17177]: can't open /var/log/ntpstats/peerstats.20240401: Permission denied 2024-04-01T01:52:09.591 INFO:teuthology.orchestra.run.smithi050.stderr: 1 Apr 01:52:09 ntpd[17061]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-01T01:52:09.591 INFO:teuthology.orchestra.run.smithi050.stderr: 1 Apr 01:52:09 ntpd[17061]: can't open /var/log/ntpstats/rawstats.20240401: Permission denied 2024-04-01T01:52:09.591 INFO:teuthology.orchestra.run.smithi050.stderr: 1 Apr 01:52:09 ntpd[17061]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-01T01:52:09.591 INFO:teuthology.orchestra.run.smithi050.stderr: 1 Apr 01:52:09 ntpd[17061]: can't open /var/log/ntpstats/rawstats.20240401: Permission denied 2024-04-01T01:52:09.591 INFO:teuthology.orchestra.run.smithi050.stderr: 1 Apr 01:52:09 ntpd[17061]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-01T01:52:09.591 INFO:teuthology.orchestra.run.smithi050.stderr: 1 Apr 01:52:09 ntpd[17061]: can't open /var/log/ntpstats/rawstats.20240401: Permission denied 2024-04-01T01:52:09.591 INFO:teuthology.orchestra.run.smithi050.stderr: 1 Apr 01:52:09 ntpd[17061]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-01T01:52:09.592 INFO:teuthology.orchestra.run.smithi050.stderr: 1 Apr 01:52:09 ntpd[17061]: can't open /var/log/ntpstats/rawstats.20240401: Permission denied 2024-04-01T01:52:09.592 INFO:teuthology.orchestra.run.smithi050.stderr: 1 Apr 01:52:09 ntpd[17061]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-01T01:52:09.592 INFO:teuthology.orchestra.run.smithi050.stderr: 1 Apr 01:52:09 ntpd[17061]: can't open /var/log/ntpstats/peerstats.20240401: Permission denied 2024-04-01T01:52:09.592 INFO:teuthology.orchestra.run.smithi050.stdout: 1 Apr 01:52:09 ntpd[17061]: ntpd: time slew -0.002281 s 2024-04-01T01:52:09.592 INFO:teuthology.orchestra.run.smithi050.stdout:ntpd: time slew -0.002281s 2024-04-01T01:52:09.593 INFO:teuthology.orchestra.run.smithi050.stderr: 1 Apr 01:52:09 ntpd[17061]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-01T01:52:09.593 INFO:teuthology.orchestra.run.smithi050.stderr: 1 Apr 01:52:09 ntpd[17061]: can't open /var/log/ntpstats/loopstats.20240401: Permission denied 2024-04-01T01:52:09.615 INFO:teuthology.orchestra.run.smithi097.stderr: 1 Apr 01:52:09 ntpd[17177]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-01T01:52:09.615 INFO:teuthology.orchestra.run.smithi097.stderr: 1 Apr 01:52:09 ntpd[17177]: can't open /var/log/ntpstats/rawstats.20240401: Permission denied 2024-04-01T01:52:09.615 INFO:teuthology.orchestra.run.smithi097.stderr: 1 Apr 01:52:09 ntpd[17177]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-01T01:52:09.615 INFO:teuthology.orchestra.run.smithi097.stderr: 1 Apr 01:52:09 ntpd[17177]: can't open /var/log/ntpstats/rawstats.20240401: Permission denied 2024-04-01T01:52:09.615 INFO:teuthology.orchestra.run.smithi097.stderr: 1 Apr 01:52:09 ntpd[17177]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-01T01:52:09.615 INFO:teuthology.orchestra.run.smithi097.stderr: 1 Apr 01:52:09 ntpd[17177]: can't open /var/log/ntpstats/rawstats.20240401: Permission denied 2024-04-01T01:52:09.615 INFO:teuthology.orchestra.run.smithi097.stderr: 1 Apr 01:52:09 ntpd[17177]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-01T01:52:09.616 INFO:teuthology.orchestra.run.smithi097.stderr: 1 Apr 01:52:09 ntpd[17177]: can't open /var/log/ntpstats/peerstats.20240401: Permission denied 2024-04-01T01:52:09.616 INFO:teuthology.orchestra.run.smithi097.stderr: 1 Apr 01:52:09 ntpd[17177]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-01T01:52:09.616 INFO:teuthology.orchestra.run.smithi097.stderr: 1 Apr 01:52:09 ntpd[17177]: can't open /var/log/ntpstats/rawstats.20240401: Permission denied 2024-04-01T01:52:09.616 INFO:teuthology.orchestra.run.smithi097.stderr: 1 Apr 01:52:09 ntpd[17177]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-01T01:52:09.616 INFO:teuthology.orchestra.run.smithi097.stderr: 1 Apr 01:52:09 ntpd[17177]: can't open /var/log/ntpstats/peerstats.20240401: Permission denied 2024-04-01T01:52:09.616 INFO:teuthology.orchestra.run.smithi097.stdout: 1 Apr 01:52:09 ntpd[17177]: ntpd: time slew -0.000501 s 2024-04-01T01:52:09.616 INFO:teuthology.orchestra.run.smithi097.stdout:ntpd: time slew -0.000501s 2024-04-01T01:52:09.616 INFO:teuthology.orchestra.run.smithi097.stderr: 1 Apr 01:52:09 ntpd[17177]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-01T01:52:09.617 INFO:teuthology.orchestra.run.smithi097.stderr: 1 Apr 01:52:09 ntpd[17177]: can't open /var/log/ntpstats/loopstats.20240401: Permission denied 2024-04-01T01:52:09.647 INFO:teuthology.orchestra.run.smithi050.stdout: remote refid st t when poll reach delay offset jitter 2024-04-01T01:52:09.647 INFO:teuthology.orchestra.run.smithi050.stdout:============================================================================== 2024-04-01T01:52:09.647 INFO:teuthology.orchestra.run.smithi050.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-01T01:52:09.647 INFO:teuthology.orchestra.run.smithi050.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-01T01:52:09.647 INFO:teuthology.orchestra.run.smithi050.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-01T01:52:09.647 INFO:teuthology.orchestra.run.smithi050.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-01T01:52:09.674 INFO:teuthology.orchestra.run.smithi097.stdout: remote refid st t when poll reach delay offset jitter 2024-04-01T01:52:09.674 INFO:teuthology.orchestra.run.smithi097.stdout:============================================================================== 2024-04-01T01:52:09.674 INFO:teuthology.orchestra.run.smithi097.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-01T01:52:09.674 INFO:teuthology.orchestra.run.smithi097.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-01T01:52:09.674 INFO:teuthology.orchestra.run.smithi097.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-01T01:52:09.674 INFO:teuthology.orchestra.run.smithi097.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-01T01:52:09.675 INFO:teuthology.run_tasks:Running task install... 2024-04-01T01:52:09.684 DEBUG:teuthology.task.install:project ceph 2024-04-01T01:52:09.684 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '384f31f3d3aee7f8ba3f60846b8844c049165583'}} 2024-04-01T01:52:09.684 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '384f31f3d3aee7f8ba3f60846b8844c049165583'} 2024-04-01T01:52:09.684 INFO:teuthology.task.install:Using flavor: default 2024-04-01T01:52:09.692 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-01T01:52:09.692 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-04-01T01:52:09.692 DEBUG:teuthology.orchestra.run.smithi050:> sudo apt-key list | grep Ceph 2024-04-01T01:52:09.693 DEBUG:teuthology.orchestra.run.smithi097:> sudo apt-key list | grep Ceph 2024-04-01T01:52:09.750 INFO:teuthology.orchestra.run.smithi050.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-01T01:52:09.774 INFO:teuthology.orchestra.run.smithi097.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-01T01:52:09.777 INFO:teuthology.orchestra.run.smithi050.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-01T01:52:09.777 INFO:teuthology.orchestra.run.smithi050.stdout:uid [ unknown] Ceph.com (release key) 2024-04-01T01:52:09.778 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-04-01T01:52:09.778 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-04-01T01:52:09.779 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=384f31f3d3aee7f8ba3f60846b8844c049165583 2024-04-01T01:52:09.802 INFO:teuthology.orchestra.run.smithi097.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-01T01:52:09.802 INFO:teuthology.orchestra.run.smithi097.stdout:uid [ unknown] Ceph.com (release key) 2024-04-01T01:52:09.802 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-04-01T01:52:09.802 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-04-01T01:52:09.803 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=384f31f3d3aee7f8ba3f60846b8844c049165583 2024-04-01T01:52:09.930 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/squid/384f31f3d3aee7f8ba3f60846b8844c049165583/ubuntu/jammy/flavors/default/ 2024-04-01T01:52:09.930 INFO:teuthology.task.install.deb:Package version is 19.0.0-1977-g384f31f3-1jammy 2024-04-01T01:52:10.103 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/squid/384f31f3d3aee7f8ba3f60846b8844c049165583/ubuntu/jammy/flavors/default/ 2024-04-01T01:52:10.103 INFO:teuthology.task.install.deb:Package version is 19.0.0-1977-g384f31f3-1jammy 2024-04-01T01:52:10.179 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-04-01T01:52:10.180 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-01T01:52:10.195 DEBUG:teuthology.orchestra.run.smithi050:> sudo apt-get update 2024-04-01T01:52:10.296 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-04-01T01:52:10.297 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-01T01:52:10.311 DEBUG:teuthology.orchestra.run.smithi097:> sudo apt-get update 2024-04-01T01:52:10.374 INFO:teuthology.orchestra.run.smithi050.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-01T01:52:10.388 INFO:teuthology.orchestra.run.smithi050.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-01T01:52:10.409 INFO:teuthology.orchestra.run.smithi050.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-01T01:52:10.424 INFO:teuthology.orchestra.run.smithi050.stdout:Ign:4 https://3.chacra.ceph.com/r/ceph/squid/384f31f3d3aee7f8ba3f60846b8844c049165583/ubuntu/jammy/flavors/default jammy InRelease 2024-04-01T01:52:10.446 INFO:teuthology.orchestra.run.smithi050.stdout:Get:5 https://3.chacra.ceph.com/r/ceph/squid/384f31f3d3aee7f8ba3f60846b8844c049165583/ubuntu/jammy/flavors/default jammy Release [6,978 B] 2024-04-01T01:52:10.467 INFO:teuthology.orchestra.run.smithi050.stdout:Ign:6 https://3.chacra.ceph.com/r/ceph/squid/384f31f3d3aee7f8ba3f60846b8844c049165583/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-01T01:52:10.479 INFO:teuthology.orchestra.run.smithi097.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-01T01:52:10.488 INFO:teuthology.orchestra.run.smithi050.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/squid/384f31f3d3aee7f8ba3f60846b8844c049165583/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,409 B] 2024-04-01T01:52:10.493 INFO:teuthology.orchestra.run.smithi097.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-01T01:52:10.494 INFO:teuthology.orchestra.run.smithi050.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-04-01T01:52:10.513 INFO:teuthology.orchestra.run.smithi097.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-01T01:52:10.516 INFO:teuthology.orchestra.run.smithi050.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/squid/384f31f3d3aee7f8ba3f60846b8844c049165583/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.8 kB] 2024-04-01T01:52:10.527 INFO:teuthology.orchestra.run.smithi097.stdout:Ign:4 https://3.chacra.ceph.com/r/ceph/squid/384f31f3d3aee7f8ba3f60846b8844c049165583/ubuntu/jammy/flavors/default jammy InRelease 2024-04-01T01:52:10.549 INFO:teuthology.orchestra.run.smithi097.stdout:Get:5 https://3.chacra.ceph.com/r/ceph/squid/384f31f3d3aee7f8ba3f60846b8844c049165583/ubuntu/jammy/flavors/default jammy Release [6,978 B] 2024-04-01T01:52:10.570 INFO:teuthology.orchestra.run.smithi097.stdout:Ign:6 https://3.chacra.ceph.com/r/ceph/squid/384f31f3d3aee7f8ba3f60846b8844c049165583/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-01T01:52:10.594 INFO:teuthology.orchestra.run.smithi097.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/squid/384f31f3d3aee7f8ba3f60846b8844c049165583/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,409 B] 2024-04-01T01:52:10.597 INFO:teuthology.orchestra.run.smithi097.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-04-01T01:52:10.619 INFO:teuthology.orchestra.run.smithi097.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/squid/384f31f3d3aee7f8ba3f60846b8844c049165583/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.8 kB] 2024-04-01T01:52:10.943 INFO:teuthology.orchestra.run.smithi050.stdout:Fetched 139 kB in 1s (250 kB/s) 2024-04-01T01:52:11.041 INFO:teuthology.orchestra.run.smithi097.stdout:Fetched 139 kB in 1s (254 kB/s) 2024-04-01T01:52:11.926 INFO:teuthology.orchestra.run.smithi050.stdout:Reading package lists... 2024-04-01T01:52:11.941 DEBUG:teuthology.orchestra.run.smithi050:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-1977-g384f31f3-1jammy cephadm=19.0.0-1977-g384f31f3-1jammy ceph-mds=19.0.0-1977-g384f31f3-1jammy ceph-mgr=19.0.0-1977-g384f31f3-1jammy ceph-common=19.0.0-1977-g384f31f3-1jammy ceph-fuse=19.0.0-1977-g384f31f3-1jammy ceph-test=19.0.0-1977-g384f31f3-1jammy ceph-volume=19.0.0-1977-g384f31f3-1jammy radosgw=19.0.0-1977-g384f31f3-1jammy python3-rados=19.0.0-1977-g384f31f3-1jammy python3-rgw=19.0.0-1977-g384f31f3-1jammy python3-cephfs=19.0.0-1977-g384f31f3-1jammy python3-rbd=19.0.0-1977-g384f31f3-1jammy libcephfs2=19.0.0-1977-g384f31f3-1jammy libcephfs-dev=19.0.0-1977-g384f31f3-1jammy librados2=19.0.0-1977-g384f31f3-1jammy librbd1=19.0.0-1977-g384f31f3-1jammy rbd-fuse=19.0.0-1977-g384f31f3-1jammy python3-cephfs=19.0.0-1977-g384f31f3-1jammy cephfs-shell=19.0.0-1977-g384f31f3-1jammy cephfs-top=19.0.0-1977-g384f31f3-1jammy cephfs-mirror=19.0.0-1977-g384f31f3-1jammy 2024-04-01T01:52:11.982 INFO:teuthology.orchestra.run.smithi097.stdout:Reading package lists... 2024-04-01T01:52:11.998 DEBUG:teuthology.orchestra.run.smithi097:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-1977-g384f31f3-1jammy cephadm=19.0.0-1977-g384f31f3-1jammy ceph-mds=19.0.0-1977-g384f31f3-1jammy ceph-mgr=19.0.0-1977-g384f31f3-1jammy ceph-common=19.0.0-1977-g384f31f3-1jammy ceph-fuse=19.0.0-1977-g384f31f3-1jammy ceph-test=19.0.0-1977-g384f31f3-1jammy ceph-volume=19.0.0-1977-g384f31f3-1jammy radosgw=19.0.0-1977-g384f31f3-1jammy python3-rados=19.0.0-1977-g384f31f3-1jammy python3-rgw=19.0.0-1977-g384f31f3-1jammy python3-cephfs=19.0.0-1977-g384f31f3-1jammy python3-rbd=19.0.0-1977-g384f31f3-1jammy libcephfs2=19.0.0-1977-g384f31f3-1jammy libcephfs-dev=19.0.0-1977-g384f31f3-1jammy librados2=19.0.0-1977-g384f31f3-1jammy librbd1=19.0.0-1977-g384f31f3-1jammy rbd-fuse=19.0.0-1977-g384f31f3-1jammy python3-cephfs=19.0.0-1977-g384f31f3-1jammy cephfs-shell=19.0.0-1977-g384f31f3-1jammy cephfs-top=19.0.0-1977-g384f31f3-1jammy cephfs-mirror=19.0.0-1977-g384f31f3-1jammy 2024-04-01T01:52:12.005 INFO:teuthology.orchestra.run.smithi050.stdout:Reading package lists... 2024-04-01T01:52:12.060 INFO:teuthology.orchestra.run.smithi097.stdout:Reading package lists... 2024-04-01T01:52:12.213 INFO:teuthology.orchestra.run.smithi050.stdout:Building dependency tree... 2024-04-01T01:52:12.214 INFO:teuthology.orchestra.run.smithi050.stdout:Reading state information... 2024-04-01T01:52:12.253 INFO:teuthology.orchestra.run.smithi097.stdout:Building dependency tree... 2024-04-01T01:52:12.253 INFO:teuthology.orchestra.run.smithi097.stdout:Reading state information... 2024-04-01T01:52:12.421 INFO:teuthology.orchestra.run.smithi050.stdout:The following packages were automatically installed and are no longer required: 2024-04-01T01:52:12.422 INFO:teuthology.orchestra.run.smithi050.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-01T01:52:12.422 INFO:teuthology.orchestra.run.smithi050.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-01T01:52:12.422 INFO:teuthology.orchestra.run.smithi050.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-01T01:52:12.422 INFO:teuthology.orchestra.run.smithi050.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-01T01:52:12.422 INFO:teuthology.orchestra.run.smithi050.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-01T01:52:12.422 INFO:teuthology.orchestra.run.smithi050.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-01T01:52:12.423 INFO:teuthology.orchestra.run.smithi050.stdout:The following additional packages will be installed: 2024-04-01T01:52:12.423 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-01T01:52:12.423 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-01T01:52:12.423 INFO:teuthology.orchestra.run.smithi050.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-01T01:52:12.424 INFO:teuthology.orchestra.run.smithi050.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-01T01:52:12.424 INFO:teuthology.orchestra.run.smithi050.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-01T01:52:12.425 INFO:teuthology.orchestra.run.smithi050.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-01T01:52:12.425 INFO:teuthology.orchestra.run.smithi050.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-01T01:52:12.425 INFO:teuthology.orchestra.run.smithi050.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-01T01:52:12.425 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-01T01:52:12.425 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-04-01T01:52:12.425 INFO:teuthology.orchestra.run.smithi050.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-04-01T01:52:12.425 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-04-01T01:52:12.425 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-04-01T01:52:12.425 INFO:teuthology.orchestra.run.smithi050.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-04-01T01:52:12.425 INFO:teuthology.orchestra.run.smithi050.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-04-01T01:52:12.425 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-04-01T01:52:12.425 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-04-01T01:52:12.426 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-04-01T01:52:12.426 INFO:teuthology.orchestra.run.smithi050.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-04-01T01:52:12.426 INFO:teuthology.orchestra.run.smithi050.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-04-01T01:52:12.426 INFO:teuthology.orchestra.run.smithi050.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-04-01T01:52:12.426 INFO:teuthology.orchestra.run.smithi050.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-04-01T01:52:12.426 INFO:teuthology.orchestra.run.smithi050.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-04-01T01:52:12.426 INFO:teuthology.orchestra.run.smithi050.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-04-01T01:52:12.426 INFO:teuthology.orchestra.run.smithi050.stdout:Suggested packages: 2024-04-01T01:52:12.426 INFO:teuthology.orchestra.run.smithi050.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-01T01:52:12.426 INFO:teuthology.orchestra.run.smithi050.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-01T01:52:12.427 INFO:teuthology.orchestra.run.smithi050.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-01T01:52:12.427 INFO:teuthology.orchestra.run.smithi050.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-01T01:52:12.427 INFO:teuthology.orchestra.run.smithi050.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-01T01:52:12.427 INFO:teuthology.orchestra.run.smithi050.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-01T01:52:12.427 INFO:teuthology.orchestra.run.smithi050.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-01T01:52:12.427 INFO:teuthology.orchestra.run.smithi050.stdout:Recommended packages: 2024-04-01T01:52:12.427 INFO:teuthology.orchestra.run.smithi050.stdout: btrfs-tools 2024-04-01T01:52:12.431 INFO:teuthology.orchestra.run.smithi097.stdout:The following packages were automatically installed and are no longer required: 2024-04-01T01:52:12.431 INFO:teuthology.orchestra.run.smithi097.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-01T01:52:12.431 INFO:teuthology.orchestra.run.smithi097.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-01T01:52:12.432 INFO:teuthology.orchestra.run.smithi097.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-01T01:52:12.432 INFO:teuthology.orchestra.run.smithi097.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-01T01:52:12.432 INFO:teuthology.orchestra.run.smithi097.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-01T01:52:12.432 INFO:teuthology.orchestra.run.smithi097.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-01T01:52:12.433 INFO:teuthology.orchestra.run.smithi097.stdout:The following additional packages will be installed: 2024-04-01T01:52:12.433 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-01T01:52:12.433 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-01T01:52:12.433 INFO:teuthology.orchestra.run.smithi097.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-01T01:52:12.433 INFO:teuthology.orchestra.run.smithi097.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-01T01:52:12.434 INFO:teuthology.orchestra.run.smithi097.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-01T01:52:12.434 INFO:teuthology.orchestra.run.smithi097.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-01T01:52:12.434 INFO:teuthology.orchestra.run.smithi097.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-01T01:52:12.434 INFO:teuthology.orchestra.run.smithi097.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-01T01:52:12.434 INFO:teuthology.orchestra.run.smithi097.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-01T01:52:12.434 INFO:teuthology.orchestra.run.smithi097.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-04-01T01:52:12.435 INFO:teuthology.orchestra.run.smithi097.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-04-01T01:52:12.435 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-04-01T01:52:12.435 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-04-01T01:52:12.435 INFO:teuthology.orchestra.run.smithi097.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-04-01T01:52:12.435 INFO:teuthology.orchestra.run.smithi097.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-04-01T01:52:12.435 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-04-01T01:52:12.435 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-04-01T01:52:12.435 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-04-01T01:52:12.435 INFO:teuthology.orchestra.run.smithi097.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-04-01T01:52:12.435 INFO:teuthology.orchestra.run.smithi097.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-04-01T01:52:12.435 INFO:teuthology.orchestra.run.smithi097.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-04-01T01:52:12.435 INFO:teuthology.orchestra.run.smithi097.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-04-01T01:52:12.435 INFO:teuthology.orchestra.run.smithi097.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-04-01T01:52:12.435 INFO:teuthology.orchestra.run.smithi097.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-04-01T01:52:12.436 INFO:teuthology.orchestra.run.smithi097.stdout:Suggested packages: 2024-04-01T01:52:12.436 INFO:teuthology.orchestra.run.smithi097.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-01T01:52:12.436 INFO:teuthology.orchestra.run.smithi097.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-01T01:52:12.436 INFO:teuthology.orchestra.run.smithi097.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-01T01:52:12.436 INFO:teuthology.orchestra.run.smithi097.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-01T01:52:12.436 INFO:teuthology.orchestra.run.smithi097.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-01T01:52:12.436 INFO:teuthology.orchestra.run.smithi097.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-01T01:52:12.436 INFO:teuthology.orchestra.run.smithi097.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-01T01:52:12.436 INFO:teuthology.orchestra.run.smithi097.stdout:Recommended packages: 2024-04-01T01:52:12.436 INFO:teuthology.orchestra.run.smithi097.stdout: btrfs-tools 2024-04-01T01:52:12.539 INFO:teuthology.orchestra.run.smithi050.stdout:The following NEW packages will be installed: 2024-04-01T01:52:12.539 INFO:teuthology.orchestra.run.smithi050.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-01T01:52:12.539 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-01T01:52:12.539 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-04-01T01:52:12.539 INFO:teuthology.orchestra.run.smithi050.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-04-01T01:52:12.539 INFO:teuthology.orchestra.run.smithi050.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-01T01:52:12.539 INFO:teuthology.orchestra.run.smithi050.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-04-01T01:52:12.539 INFO:teuthology.orchestra.run.smithi050.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-04-01T01:52:12.540 INFO:teuthology.orchestra.run.smithi050.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-04-01T01:52:12.541 INFO:teuthology.orchestra.run.smithi050.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-04-01T01:52:12.541 INFO:teuthology.orchestra.run.smithi050.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-04-01T01:52:12.541 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-04-01T01:52:12.541 INFO:teuthology.orchestra.run.smithi050.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-04-01T01:52:12.541 INFO:teuthology.orchestra.run.smithi050.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-04-01T01:52:12.541 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-01T01:52:12.541 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-01T01:52:12.541 INFO:teuthology.orchestra.run.smithi050.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-01T01:52:12.541 INFO:teuthology.orchestra.run.smithi050.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-01T01:52:12.541 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-01T01:52:12.541 INFO:teuthology.orchestra.run.smithi050.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-01T01:52:12.541 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-04-01T01:52:12.542 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-04-01T01:52:12.542 INFO:teuthology.orchestra.run.smithi050.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-04-01T01:52:12.542 INFO:teuthology.orchestra.run.smithi050.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-01T01:52:12.542 INFO:teuthology.orchestra.run.smithi050.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-01T01:52:12.542 INFO:teuthology.orchestra.run.smithi050.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-01T01:52:12.542 INFO:teuthology.orchestra.run.smithi050.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-01T01:52:12.542 INFO:teuthology.orchestra.run.smithi050.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-04-01T01:52:12.542 INFO:teuthology.orchestra.run.smithi050.stdout: socat unzip xmlstarlet zip 2024-04-01T01:52:12.543 INFO:teuthology.orchestra.run.smithi097.stdout:The following NEW packages will be installed: 2024-04-01T01:52:12.543 INFO:teuthology.orchestra.run.smithi097.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-01T01:52:12.543 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-01T01:52:12.543 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-04-01T01:52:12.544 INFO:teuthology.orchestra.run.smithi097.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-04-01T01:52:12.544 INFO:teuthology.orchestra.run.smithi097.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-01T01:52:12.544 INFO:teuthology.orchestra.run.smithi097.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-04-01T01:52:12.544 INFO:teuthology.orchestra.run.smithi097.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-04-01T01:52:12.545 INFO:teuthology.orchestra.run.smithi097.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-04-01T01:52:12.545 INFO:teuthology.orchestra.run.smithi097.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-04-01T01:52:12.545 INFO:teuthology.orchestra.run.smithi097.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-04-01T01:52:12.545 INFO:teuthology.orchestra.run.smithi097.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-04-01T01:52:12.545 INFO:teuthology.orchestra.run.smithi097.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-04-01T01:52:12.545 INFO:teuthology.orchestra.run.smithi097.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-04-01T01:52:12.545 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-01T01:52:12.545 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-01T01:52:12.545 INFO:teuthology.orchestra.run.smithi097.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-01T01:52:12.545 INFO:teuthology.orchestra.run.smithi097.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-01T01:52:12.545 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-01T01:52:12.545 INFO:teuthology.orchestra.run.smithi097.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-01T01:52:12.545 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-04-01T01:52:12.545 INFO:teuthology.orchestra.run.smithi097.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-04-01T01:52:12.546 INFO:teuthology.orchestra.run.smithi097.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-04-01T01:52:12.546 INFO:teuthology.orchestra.run.smithi097.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-01T01:52:12.546 INFO:teuthology.orchestra.run.smithi097.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-01T01:52:12.546 INFO:teuthology.orchestra.run.smithi097.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-01T01:52:12.546 INFO:teuthology.orchestra.run.smithi097.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-01T01:52:12.546 INFO:teuthology.orchestra.run.smithi097.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-04-01T01:52:12.546 INFO:teuthology.orchestra.run.smithi097.stdout: socat unzip xmlstarlet zip 2024-04-01T01:52:12.606 INFO:teuthology.orchestra.run.smithi050.stdout:0 upgraded, 124 newly installed, 0 to remove and 298 not upgraded. 2024-04-01T01:52:12.606 INFO:teuthology.orchestra.run.smithi050.stdout:Need to get 178 MB of archives. 2024-04-01T01:52:12.606 INFO:teuthology.orchestra.run.smithi050.stdout:After this operation, 817 MB of additional disk space will be used. 2024-04-01T01:52:12.606 INFO:teuthology.orchestra.run.smithi050.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-04-01T01:52:12.620 INFO:teuthology.orchestra.run.smithi097.stdout:0 upgraded, 124 newly installed, 0 to remove and 298 not upgraded. 2024-04-01T01:52:12.620 INFO:teuthology.orchestra.run.smithi097.stdout:Need to get 178 MB of archives. 2024-04-01T01:52:12.620 INFO:teuthology.orchestra.run.smithi097.stdout:After this operation, 817 MB of additional disk space will be used. 2024-04-01T01:52:12.621 INFO:teuthology.orchestra.run.smithi097.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-04-01T01:52:12.626 INFO:teuthology.orchestra.run.smithi050.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-01T01:52:12.638 INFO:teuthology.orchestra.run.smithi050.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-04-01T01:52:12.640 INFO:teuthology.orchestra.run.smithi097.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-01T01:52:12.652 INFO:teuthology.orchestra.run.smithi097.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-04-01T01:52:12.685 INFO:teuthology.orchestra.run.smithi050.stdout:Get:4 https://3.chacra.ceph.com/r/ceph/squid/384f31f3d3aee7f8ba3f60846b8844c049165583/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-1977-g384f31f3-1jammy [3,544 kB] 2024-04-01T01:52:12.685 INFO:teuthology.orchestra.run.smithi050.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-01T01:52:12.688 INFO:teuthology.orchestra.run.smithi097.stdout:Get:4 https://3.chacra.ceph.com/r/ceph/squid/384f31f3d3aee7f8ba3f60846b8844c049165583/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-1977-g384f31f3-1jammy [3,544 kB] 2024-04-01T01:52:12.699 INFO:teuthology.orchestra.run.smithi097.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-01T01:52:12.708 INFO:teuthology.orchestra.run.smithi050.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-01T01:52:12.712 INFO:teuthology.orchestra.run.smithi050.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-01T01:52:12.724 INFO:teuthology.orchestra.run.smithi097.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-01T01:52:12.725 INFO:teuthology.orchestra.run.smithi050.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-01T01:52:12.727 INFO:teuthology.orchestra.run.smithi097.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-01T01:52:12.742 INFO:teuthology.orchestra.run.smithi097.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-01T01:52:12.782 INFO:teuthology.orchestra.run.smithi050.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-01T01:52:12.786 INFO:teuthology.orchestra.run.smithi050.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-01T01:52:12.803 INFO:teuthology.orchestra.run.smithi050.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-01T01:52:12.808 INFO:teuthology.orchestra.run.smithi050.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-01T01:52:12.809 INFO:teuthology.orchestra.run.smithi050.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-01T01:52:12.819 INFO:teuthology.orchestra.run.smithi097.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-01T01:52:12.820 INFO:teuthology.orchestra.run.smithi050.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-01T01:52:12.824 INFO:teuthology.orchestra.run.smithi050.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-01T01:52:12.824 INFO:teuthology.orchestra.run.smithi097.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-01T01:52:12.826 INFO:teuthology.orchestra.run.smithi050.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-01T01:52:12.828 INFO:teuthology.orchestra.run.smithi050.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-01T01:52:12.834 INFO:teuthology.orchestra.run.smithi050.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-01T01:52:12.843 INFO:teuthology.orchestra.run.smithi097.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-01T01:52:12.849 INFO:teuthology.orchestra.run.smithi097.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-01T01:52:12.850 INFO:teuthology.orchestra.run.smithi097.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-01T01:52:12.862 INFO:teuthology.orchestra.run.smithi097.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-01T01:52:12.865 INFO:teuthology.orchestra.run.smithi097.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-01T01:52:12.867 INFO:teuthology.orchestra.run.smithi050.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-01T01:52:12.868 INFO:teuthology.orchestra.run.smithi097.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-01T01:52:12.870 INFO:teuthology.orchestra.run.smithi050.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-01T01:52:12.870 INFO:teuthology.orchestra.run.smithi097.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-01T01:52:12.870 INFO:teuthology.orchestra.run.smithi097.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-01T01:52:12.872 INFO:teuthology.orchestra.run.smithi050.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-01T01:52:12.873 INFO:teuthology.orchestra.run.smithi050.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-01T01:52:12.873 INFO:teuthology.orchestra.run.smithi050.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-01T01:52:12.875 INFO:teuthology.orchestra.run.smithi050.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-01T01:52:12.875 INFO:teuthology.orchestra.run.smithi050.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-01T01:52:12.875 INFO:teuthology.orchestra.run.smithi050.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-01T01:52:12.876 INFO:teuthology.orchestra.run.smithi050.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-01T01:52:12.889 INFO:teuthology.orchestra.run.smithi097.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-01T01:52:12.893 INFO:teuthology.orchestra.run.smithi097.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-01T01:52:12.895 INFO:teuthology.orchestra.run.smithi097.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-01T01:52:12.896 INFO:teuthology.orchestra.run.smithi097.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-01T01:52:12.897 INFO:teuthology.orchestra.run.smithi097.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-01T01:52:12.900 INFO:teuthology.orchestra.run.smithi050.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-01T01:52:12.901 INFO:teuthology.orchestra.run.smithi050.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-01T01:52:12.901 INFO:teuthology.orchestra.run.smithi050.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-01T01:52:12.913 INFO:teuthology.orchestra.run.smithi097.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-01T01:52:12.913 INFO:teuthology.orchestra.run.smithi097.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-01T01:52:12.914 INFO:teuthology.orchestra.run.smithi097.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-01T01:52:12.915 INFO:teuthology.orchestra.run.smithi097.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-01T01:52:12.915 INFO:teuthology.orchestra.run.smithi097.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-01T01:52:12.921 INFO:teuthology.orchestra.run.smithi050.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-01T01:52:12.922 INFO:teuthology.orchestra.run.smithi050.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-01T01:52:12.922 INFO:teuthology.orchestra.run.smithi050.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-01T01:52:12.923 INFO:teuthology.orchestra.run.smithi050.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-01T01:52:12.924 INFO:teuthology.orchestra.run.smithi050.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-01T01:52:12.924 INFO:teuthology.orchestra.run.smithi050.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-01T01:52:12.925 INFO:teuthology.orchestra.run.smithi050.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-01T01:52:12.932 INFO:teuthology.orchestra.run.smithi097.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-01T01:52:12.933 INFO:teuthology.orchestra.run.smithi097.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-01T01:52:12.939 INFO:teuthology.orchestra.run.smithi097.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-01T01:52:12.940 INFO:teuthology.orchestra.run.smithi097.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-01T01:52:12.941 INFO:teuthology.orchestra.run.smithi097.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-01T01:52:12.941 INFO:teuthology.orchestra.run.smithi050.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-01T01:52:12.945 INFO:teuthology.orchestra.run.smithi050.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-01T01:52:12.946 INFO:teuthology.orchestra.run.smithi050.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-01T01:52:12.947 INFO:teuthology.orchestra.run.smithi050.stdout:Get:41 https://3.chacra.ceph.com/r/ceph/squid/384f31f3d3aee7f8ba3f60846b8844c049165583/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-1977-g384f31f3-1jammy [3,217 kB] 2024-04-01T01:52:12.954 INFO:teuthology.orchestra.run.smithi097.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-01T01:52:12.956 INFO:teuthology.orchestra.run.smithi097.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-01T01:52:12.956 INFO:teuthology.orchestra.run.smithi097.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-01T01:52:12.957 INFO:teuthology.orchestra.run.smithi097.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-01T01:52:12.960 INFO:teuthology.orchestra.run.smithi097.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-01T01:52:12.962 INFO:teuthology.orchestra.run.smithi050.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-01T01:52:12.963 INFO:teuthology.orchestra.run.smithi050.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-01T01:52:12.963 INFO:teuthology.orchestra.run.smithi050.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-01T01:52:12.964 INFO:teuthology.orchestra.run.smithi050.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-01T01:52:12.966 INFO:teuthology.orchestra.run.smithi050.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-01T01:52:12.968 INFO:teuthology.orchestra.run.smithi050.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-01T01:52:12.969 INFO:teuthology.orchestra.run.smithi050.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-01T01:52:12.975 INFO:teuthology.orchestra.run.smithi097.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-01T01:52:12.976 INFO:teuthology.orchestra.run.smithi097.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-01T01:52:12.984 INFO:teuthology.orchestra.run.smithi050.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-01T01:52:12.985 INFO:teuthology.orchestra.run.smithi050.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-01T01:52:12.986 INFO:teuthology.orchestra.run.smithi097.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-01T01:52:12.987 INFO:teuthology.orchestra.run.smithi097.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-01T01:52:12.988 INFO:teuthology.orchestra.run.smithi097.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-01T01:52:12.989 INFO:teuthology.orchestra.run.smithi050.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-01T01:52:12.995 INFO:teuthology.orchestra.run.smithi097.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-01T01:52:12.997 INFO:teuthology.orchestra.run.smithi097.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-01T01:52:13.002 INFO:teuthology.orchestra.run.smithi097.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-01T01:52:13.003 INFO:teuthology.orchestra.run.smithi097.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-01T01:52:13.006 INFO:teuthology.orchestra.run.smithi050.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-01T01:52:13.006 INFO:teuthology.orchestra.run.smithi097.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-01T01:52:13.007 INFO:teuthology.orchestra.run.smithi050.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-01T01:52:13.010 INFO:teuthology.orchestra.run.smithi050.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-01T01:52:13.025 INFO:teuthology.orchestra.run.smithi097.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-01T01:52:13.031 INFO:teuthology.orchestra.run.smithi097.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-01T01:52:13.032 INFO:teuthology.orchestra.run.smithi097.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-01T01:52:13.034 INFO:teuthology.orchestra.run.smithi097.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-01T01:52:13.039 INFO:teuthology.orchestra.run.smithi097.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-01T01:52:13.056 INFO:teuthology.orchestra.run.smithi097.stdout:Get:54 https://3.chacra.ceph.com/r/ceph/squid/384f31f3d3aee7f8ba3f60846b8844c049165583/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-1977-g384f31f3-1jammy [3,217 kB] 2024-04-01T01:52:13.099 INFO:teuthology.orchestra.run.smithi050.stdout:Get:55 https://3.chacra.ceph.com/r/ceph/squid/384f31f3d3aee7f8ba3f60846b8844c049165583/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-1977-g384f31f3-1jammy [711 kB] 2024-04-01T01:52:13.117 INFO:teuthology.orchestra.run.smithi050.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-01T01:52:13.119 INFO:teuthology.orchestra.run.smithi050.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-01T01:52:13.121 INFO:teuthology.orchestra.run.smithi050.stdout:Get:58 https://3.chacra.ceph.com/r/ceph/squid/384f31f3d3aee7f8ba3f60846b8844c049165583/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-1977-g384f31f3-1jammy [356 kB] 2024-04-01T01:52:13.121 INFO:teuthology.orchestra.run.smithi050.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-01T01:52:13.122 INFO:teuthology.orchestra.run.smithi050.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-01T01:52:13.123 INFO:teuthology.orchestra.run.smithi050.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-01T01:52:13.160 INFO:teuthology.orchestra.run.smithi050.stdout:Get:62 https://3.chacra.ceph.com/r/ceph/squid/384f31f3d3aee7f8ba3f60846b8844c049165583/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-1977-g384f31f3-1jammy [32.8 kB] 2024-04-01T01:52:13.161 INFO:teuthology.orchestra.run.smithi050.stdout:Get:63 https://3.chacra.ceph.com/r/ceph/squid/384f31f3d3aee7f8ba3f60846b8844c049165583/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-1977-g384f31f3-1jammy [180 kB] 2024-04-01T01:52:13.166 INFO:teuthology.orchestra.run.smithi050.stdout:Get:64 https://3.chacra.ceph.com/r/ceph/squid/384f31f3d3aee7f8ba3f60846b8844c049165583/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-1977-g384f31f3-1jammy [64.6 kB] 2024-04-01T01:52:13.168 INFO:teuthology.orchestra.run.smithi050.stdout:Get:65 https://3.chacra.ceph.com/r/ceph/squid/384f31f3d3aee7f8ba3f60846b8844c049165583/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-1977-g384f31f3-1jammy [330 kB] 2024-04-01T01:52:13.180 INFO:teuthology.orchestra.run.smithi050.stdout:Get:66 https://3.chacra.ceph.com/r/ceph/squid/384f31f3d3aee7f8ba3f60846b8844c049165583/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-1977-g384f31f3-1jammy [6,577 kB] 2024-04-01T01:52:13.211 INFO:teuthology.orchestra.run.smithi097.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-01T01:52:13.213 INFO:teuthology.orchestra.run.smithi050.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-01T01:52:13.213 INFO:teuthology.orchestra.run.smithi097.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-01T01:52:13.216 INFO:teuthology.orchestra.run.smithi097.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-01T01:52:13.216 INFO:teuthology.orchestra.run.smithi050.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-01T01:52:13.217 INFO:teuthology.orchestra.run.smithi050.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-01T01:52:13.217 INFO:teuthology.orchestra.run.smithi097.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-01T01:52:13.219 INFO:teuthology.orchestra.run.smithi097.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-01T01:52:13.243 INFO:teuthology.orchestra.run.smithi050.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-01T01:52:13.244 INFO:teuthology.orchestra.run.smithi050.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-01T01:52:13.244 INFO:teuthology.orchestra.run.smithi050.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-01T01:52:13.245 INFO:teuthology.orchestra.run.smithi050.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-01T01:52:13.246 INFO:teuthology.orchestra.run.smithi050.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-01T01:52:13.247 INFO:teuthology.orchestra.run.smithi050.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-01T01:52:13.253 INFO:teuthology.orchestra.run.smithi050.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-01T01:52:13.253 INFO:teuthology.orchestra.run.smithi097.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-01T01:52:13.254 INFO:teuthology.orchestra.run.smithi050.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-01T01:52:13.256 INFO:teuthology.orchestra.run.smithi097.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-01T01:52:13.257 INFO:teuthology.orchestra.run.smithi097.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-01T01:52:13.258 INFO:teuthology.orchestra.run.smithi050.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-01T01:52:13.274 INFO:teuthology.orchestra.run.smithi050.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-01T01:52:13.276 INFO:teuthology.orchestra.run.smithi050.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-01T01:52:13.277 INFO:teuthology.orchestra.run.smithi050.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-01T01:52:13.277 INFO:teuthology.orchestra.run.smithi097.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-01T01:52:13.278 INFO:teuthology.orchestra.run.smithi097.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-01T01:52:13.279 INFO:teuthology.orchestra.run.smithi097.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-01T01:52:13.279 INFO:teuthology.orchestra.run.smithi097.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-01T01:52:13.280 INFO:teuthology.orchestra.run.smithi097.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-01T01:52:13.280 INFO:teuthology.orchestra.run.smithi097.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-01T01:52:13.282 INFO:teuthology.orchestra.run.smithi050.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-01T01:52:13.286 INFO:teuthology.orchestra.run.smithi050.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-04-01T01:52:13.286 INFO:teuthology.orchestra.run.smithi050.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-01T01:52:13.287 INFO:teuthology.orchestra.run.smithi050.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-01T01:52:13.292 INFO:teuthology.orchestra.run.smithi097.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-01T01:52:13.293 INFO:teuthology.orchestra.run.smithi097.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-01T01:52:13.296 INFO:teuthology.orchestra.run.smithi050.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-01T01:52:13.302 INFO:teuthology.orchestra.run.smithi097.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-01T01:52:13.303 INFO:teuthology.orchestra.run.smithi050.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-01T01:52:13.303 INFO:teuthology.orchestra.run.smithi050.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-01T01:52:13.314 INFO:teuthology.orchestra.run.smithi097.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-01T01:52:13.316 INFO:teuthology.orchestra.run.smithi097.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-01T01:52:13.317 INFO:teuthology.orchestra.run.smithi097.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-01T01:52:13.318 INFO:teuthology.orchestra.run.smithi050.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-01T01:52:13.318 INFO:teuthology.orchestra.run.smithi050.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-01T01:52:13.319 INFO:teuthology.orchestra.run.smithi050.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-01T01:52:13.319 INFO:teuthology.orchestra.run.smithi050.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-01T01:52:13.322 INFO:teuthology.orchestra.run.smithi050.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-01T01:52:13.323 INFO:teuthology.orchestra.run.smithi050.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-01T01:52:13.326 INFO:teuthology.orchestra.run.smithi097.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-01T01:52:13.334 INFO:teuthology.orchestra.run.smithi050.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-01T01:52:13.336 INFO:teuthology.orchestra.run.smithi097.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-04-01T01:52:13.337 INFO:teuthology.orchestra.run.smithi097.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-01T01:52:13.338 INFO:teuthology.orchestra.run.smithi097.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-01T01:52:13.340 INFO:teuthology.orchestra.run.smithi097.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-01T01:52:13.343 INFO:teuthology.orchestra.run.smithi050.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-01T01:52:13.344 INFO:teuthology.orchestra.run.smithi050.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-01T01:52:13.347 INFO:teuthology.orchestra.run.smithi050.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-01T01:52:13.349 INFO:teuthology.orchestra.run.smithi097.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-01T01:52:13.349 INFO:teuthology.orchestra.run.smithi097.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-01T01:52:13.361 INFO:teuthology.orchestra.run.smithi097.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-01T01:52:13.361 INFO:teuthology.orchestra.run.smithi097.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-01T01:52:13.362 INFO:teuthology.orchestra.run.smithi097.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-01T01:52:13.362 INFO:teuthology.orchestra.run.smithi097.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-01T01:52:13.364 INFO:teuthology.orchestra.run.smithi050.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-01T01:52:13.364 INFO:teuthology.orchestra.run.smithi097.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-01T01:52:13.367 INFO:teuthology.orchestra.run.smithi097.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-01T01:52:13.387 INFO:teuthology.orchestra.run.smithi097.stdout:Get:88 https://3.chacra.ceph.com/r/ceph/squid/384f31f3d3aee7f8ba3f60846b8844c049165583/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-1977-g384f31f3-1jammy [711 kB] 2024-04-01T01:52:13.395 INFO:teuthology.orchestra.run.smithi097.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-01T01:52:13.397 INFO:teuthology.orchestra.run.smithi097.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-01T01:52:13.397 INFO:teuthology.orchestra.run.smithi097.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-01T01:52:13.399 INFO:teuthology.orchestra.run.smithi097.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-01T01:52:13.401 INFO:teuthology.orchestra.run.smithi097.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/squid/384f31f3d3aee7f8ba3f60846b8844c049165583/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-1977-g384f31f3-1jammy [356 kB] 2024-04-01T01:52:13.417 INFO:teuthology.orchestra.run.smithi097.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-01T01:52:13.423 INFO:teuthology.orchestra.run.smithi097.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/squid/384f31f3d3aee7f8ba3f60846b8844c049165583/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-1977-g384f31f3-1jammy [32.8 kB] 2024-04-01T01:52:13.424 INFO:teuthology.orchestra.run.smithi097.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/squid/384f31f3d3aee7f8ba3f60846b8844c049165583/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-1977-g384f31f3-1jammy [180 kB] 2024-04-01T01:52:13.430 INFO:teuthology.orchestra.run.smithi097.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/squid/384f31f3d3aee7f8ba3f60846b8844c049165583/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-1977-g384f31f3-1jammy [64.6 kB] 2024-04-01T01:52:13.432 INFO:teuthology.orchestra.run.smithi097.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/squid/384f31f3d3aee7f8ba3f60846b8844c049165583/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-1977-g384f31f3-1jammy [330 kB] 2024-04-01T01:52:13.443 INFO:teuthology.orchestra.run.smithi097.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/squid/384f31f3d3aee7f8ba3f60846b8844c049165583/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-1977-g384f31f3-1jammy [6,577 kB] 2024-04-01T01:52:13.528 INFO:teuthology.orchestra.run.smithi050.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/squid/384f31f3d3aee7f8ba3f60846b8844c049165583/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-1977-g384f31f3-1jammy [112 kB] 2024-04-01T01:52:13.530 INFO:teuthology.orchestra.run.smithi050.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/squid/384f31f3d3aee7f8ba3f60846b8844c049165583/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-1977-g384f31f3-1jammy [466 kB] 2024-04-01T01:52:13.567 INFO:teuthology.orchestra.run.smithi050.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/squid/384f31f3d3aee7f8ba3f60846b8844c049165583/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-1977-g384f31f3-1jammy [25.2 MB] 2024-04-01T01:52:14.049 INFO:teuthology.orchestra.run.smithi097.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/squid/384f31f3d3aee7f8ba3f60846b8844c049165583/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-1977-g384f31f3-1jammy [112 kB] 2024-04-01T01:52:14.052 INFO:teuthology.orchestra.run.smithi097.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/squid/384f31f3d3aee7f8ba3f60846b8844c049165583/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-1977-g384f31f3-1jammy [466 kB] 2024-04-01T01:52:14.107 INFO:teuthology.orchestra.run.smithi097.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/squid/384f31f3d3aee7f8ba3f60846b8844c049165583/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-1977-g384f31f3-1jammy [25.2 MB] 2024-04-01T01:52:15.013 INFO:teuthology.orchestra.run.smithi050.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/squid/384f31f3d3aee7f8ba3f60846b8844c049165583/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-1977-g384f31f3-1jammy [5,077 kB] 2024-04-01T01:52:15.154 INFO:teuthology.orchestra.run.smithi050.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/squid/384f31f3d3aee7f8ba3f60846b8844c049165583/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-1977-g384f31f3-1jammy [244 kB] 2024-04-01T01:52:15.160 INFO:teuthology.orchestra.run.smithi050.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/squid/384f31f3d3aee7f8ba3f60846b8844c049165583/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-1977-g384f31f3-1jammy [124 kB] 2024-04-01T01:52:15.164 INFO:teuthology.orchestra.run.smithi050.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/squid/384f31f3d3aee7f8ba3f60846b8844c049165583/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-1977-g384f31f3-1jammy [1,526 kB] 2024-04-01T01:52:15.242 INFO:teuthology.orchestra.run.smithi050.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/squid/384f31f3d3aee7f8ba3f60846b8844c049165583/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-1977-g384f31f3-1jammy [6,247 kB] 2024-04-01T01:52:15.585 INFO:teuthology.orchestra.run.smithi050.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/squid/384f31f3d3aee7f8ba3f60846b8844c049165583/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-1977-g384f31f3-1jammy [22.7 MB] 2024-04-01T01:52:16.399 INFO:teuthology.orchestra.run.smithi097.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/squid/384f31f3d3aee7f8ba3f60846b8844c049165583/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-1977-g384f31f3-1jammy [5,077 kB] 2024-04-01T01:52:16.732 INFO:teuthology.orchestra.run.smithi097.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/squid/384f31f3d3aee7f8ba3f60846b8844c049165583/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-1977-g384f31f3-1jammy [244 kB] 2024-04-01T01:52:16.788 INFO:teuthology.orchestra.run.smithi097.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/squid/384f31f3d3aee7f8ba3f60846b8844c049165583/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-1977-g384f31f3-1jammy [124 kB] 2024-04-01T01:52:16.792 INFO:teuthology.orchestra.run.smithi097.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/squid/384f31f3d3aee7f8ba3f60846b8844c049165583/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-1977-g384f31f3-1jammy [1,526 kB] 2024-04-01T01:52:16.861 INFO:teuthology.orchestra.run.smithi050.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/squid/384f31f3d3aee7f8ba3f60846b8844c049165583/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-1977-g384f31f3-1jammy [14.1 kB] 2024-04-01T01:52:16.862 INFO:teuthology.orchestra.run.smithi050.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/squid/384f31f3d3aee7f8ba3f60846b8844c049165583/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-1977-g384f31f3-1jammy [869 kB] 2024-04-01T01:52:16.879 INFO:teuthology.orchestra.run.smithi050.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/squid/384f31f3d3aee7f8ba3f60846b8844c049165583/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-1977-g384f31f3-1jammy [2,437 kB] 2024-04-01T01:52:16.892 INFO:teuthology.orchestra.run.smithi097.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/squid/384f31f3d3aee7f8ba3f60846b8844c049165583/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-1977-g384f31f3-1jammy [6,247 kB] 2024-04-01T01:52:16.944 INFO:teuthology.orchestra.run.smithi050.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/squid/384f31f3d3aee7f8ba3f60846b8844c049165583/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-1977-g384f31f3-1jammy [777 kB] 2024-04-01T01:52:16.998 INFO:teuthology.orchestra.run.smithi050.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/squid/384f31f3d3aee7f8ba3f60846b8844c049165583/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-1977-g384f31f3-1jammy [145 kB] 2024-04-01T01:52:17.003 INFO:teuthology.orchestra.run.smithi050.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/squid/384f31f3d3aee7f8ba3f60846b8844c049165583/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-1977-g384f31f3-1jammy [2,282 kB] 2024-04-01T01:52:17.175 INFO:teuthology.orchestra.run.smithi050.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/squid/384f31f3d3aee7f8ba3f60846b8844c049165583/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-1977-g384f31f3-1jammy [8,625 kB] 2024-04-01T01:52:17.388 INFO:teuthology.orchestra.run.smithi097.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/squid/384f31f3d3aee7f8ba3f60846b8844c049165583/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-1977-g384f31f3-1jammy [22.7 MB] 2024-04-01T01:52:17.633 INFO:teuthology.orchestra.run.smithi050.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/squid/384f31f3d3aee7f8ba3f60846b8844c049165583/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-1977-g384f31f3-1jammy [14.2 kB] 2024-04-01T01:52:17.634 INFO:teuthology.orchestra.run.smithi050.stdout:Get:117 https://3.chacra.ceph.com/r/ceph/squid/384f31f3d3aee7f8ba3f60846b8844c049165583/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-1977-g384f31f3-1jammy [50.0 MB] 2024-04-01T01:52:19.134 INFO:teuthology.orchestra.run.smithi097.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/squid/384f31f3d3aee7f8ba3f60846b8844c049165583/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-1977-g384f31f3-1jammy [14.1 kB] 2024-04-01T01:52:19.134 INFO:teuthology.orchestra.run.smithi097.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/squid/384f31f3d3aee7f8ba3f60846b8844c049165583/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-1977-g384f31f3-1jammy [869 kB] 2024-04-01T01:52:19.151 INFO:teuthology.orchestra.run.smithi097.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/squid/384f31f3d3aee7f8ba3f60846b8844c049165583/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-1977-g384f31f3-1jammy [2,437 kB] 2024-04-01T01:52:19.322 INFO:teuthology.orchestra.run.smithi097.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/squid/384f31f3d3aee7f8ba3f60846b8844c049165583/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-1977-g384f31f3-1jammy [777 kB] 2024-04-01T01:52:19.346 INFO:teuthology.orchestra.run.smithi097.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/squid/384f31f3d3aee7f8ba3f60846b8844c049165583/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-1977-g384f31f3-1jammy [145 kB] 2024-04-01T01:52:19.391 INFO:teuthology.orchestra.run.smithi097.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/squid/384f31f3d3aee7f8ba3f60846b8844c049165583/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-1977-g384f31f3-1jammy [2,282 kB] 2024-04-01T01:52:19.546 INFO:teuthology.orchestra.run.smithi097.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/squid/384f31f3d3aee7f8ba3f60846b8844c049165583/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-1977-g384f31f3-1jammy [8,625 kB] 2024-04-01T01:52:20.194 INFO:teuthology.orchestra.run.smithi097.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/squid/384f31f3d3aee7f8ba3f60846b8844c049165583/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-1977-g384f31f3-1jammy [14.2 kB] 2024-04-01T01:52:20.194 INFO:teuthology.orchestra.run.smithi097.stdout:Get:117 https://3.chacra.ceph.com/r/ceph/squid/384f31f3d3aee7f8ba3f60846b8844c049165583/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-1977-g384f31f3-1jammy [50.0 MB] 2024-04-01T01:52:20.802 INFO:teuthology.orchestra.run.smithi050.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/squid/384f31f3d3aee7f8ba3f60846b8844c049165583/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-1977-g384f31f3-1jammy [121 kB] 2024-04-01T01:52:20.805 INFO:teuthology.orchestra.run.smithi050.stdout:Get:119 https://3.chacra.ceph.com/r/ceph/squid/384f31f3d3aee7f8ba3f60846b8844c049165583/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-1977-g384f31f3-1jammy [229 kB] 2024-04-01T01:52:20.809 INFO:teuthology.orchestra.run.smithi050.stdout:Get:120 https://3.chacra.ceph.com/r/ceph/squid/384f31f3d3aee7f8ba3f60846b8844c049165583/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-1977-g384f31f3-1jammy [34.0 kB] 2024-04-01T01:52:20.810 INFO:teuthology.orchestra.run.smithi050.stdout:Get:121 https://3.chacra.ceph.com/r/ceph/squid/384f31f3d3aee7f8ba3f60846b8844c049165583/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-1977-g384f31f3-1jammy [23.4 kB] 2024-04-01T01:52:20.811 INFO:teuthology.orchestra.run.smithi050.stdout:Get:122 https://3.chacra.ceph.com/r/ceph/squid/384f31f3d3aee7f8ba3f60846b8844c049165583/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-1977-g384f31f3-1jammy [38.9 kB] 2024-04-01T01:52:20.812 INFO:teuthology.orchestra.run.smithi050.stdout:Get:123 https://3.chacra.ceph.com/r/ceph/squid/384f31f3d3aee7f8ba3f60846b8844c049165583/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-1977-g384f31f3-1jammy [13.0 MB] 2024-04-01T01:52:21.432 INFO:teuthology.orchestra.run.smithi050.stdout:Get:124 https://3.chacra.ceph.com/r/ceph/squid/384f31f3d3aee7f8ba3f60846b8844c049165583/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-1977-g384f31f3-1jammy [91.5 kB] 2024-04-01T01:52:22.081 INFO:teuthology.orchestra.run.smithi050.stdout:Fetched 178 MB in 9s (20.1 MB/s) 2024-04-01T01:52:22.191 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-pyperclip. 2024-04-01T01:52:22.247 INFO:teuthology.orchestra.run.smithi050.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165997 files and directories currently installed.) 2024-04-01T01:52:22.252 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-04-01T01:52:22.290 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-04-01T01:52:22.701 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-01T01:52:22.728 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-01T01:52:22.746 INFO:teuthology.orchestra.run.smithi097.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/squid/384f31f3d3aee7f8ba3f60846b8844c049165583/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-1977-g384f31f3-1jammy [121 kB] 2024-04-01T01:52:22.749 INFO:teuthology.orchestra.run.smithi097.stdout:Get:119 https://3.chacra.ceph.com/r/ceph/squid/384f31f3d3aee7f8ba3f60846b8844c049165583/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-1977-g384f31f3-1jammy [229 kB] 2024-04-01T01:52:22.753 INFO:teuthology.orchestra.run.smithi097.stdout:Get:120 https://3.chacra.ceph.com/r/ceph/squid/384f31f3d3aee7f8ba3f60846b8844c049165583/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-1977-g384f31f3-1jammy [34.0 kB] 2024-04-01T01:52:22.755 INFO:teuthology.orchestra.run.smithi097.stdout:Get:121 https://3.chacra.ceph.com/r/ceph/squid/384f31f3d3aee7f8ba3f60846b8844c049165583/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-1977-g384f31f3-1jammy [23.4 kB] 2024-04-01T01:52:22.755 INFO:teuthology.orchestra.run.smithi097.stdout:Get:122 https://3.chacra.ceph.com/r/ceph/squid/384f31f3d3aee7f8ba3f60846b8844c049165583/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-1977-g384f31f3-1jammy [38.9 kB] 2024-04-01T01:52:22.756 INFO:teuthology.orchestra.run.smithi097.stdout:Get:123 https://3.chacra.ceph.com/r/ceph/squid/384f31f3d3aee7f8ba3f60846b8844c049165583/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-1977-g384f31f3-1jammy [13.0 MB] 2024-04-01T01:52:22.768 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-01T01:52:23.063 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-cmd2. 2024-04-01T01:52:23.076 INFO:teuthology.orchestra.run.smithi097.stdout:Get:124 https://3.chacra.ceph.com/r/ceph/squid/384f31f3d3aee7f8ba3f60846b8844c049165583/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-1977-g384f31f3-1jammy [91.5 kB] 2024-04-01T01:52:23.089 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-04-01T01:52:23.129 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-04-01T01:52:23.434 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-01T01:52:23.461 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-01T01:52:23.534 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-01T01:52:23.678 INFO:teuthology.orchestra.run.smithi097.stdout:Fetched 178 MB in 11s (16.9 MB/s) 2024-04-01T01:52:23.817 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-pyperclip. 2024-04-01T01:52:23.846 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-01T01:52:23.873 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-01T01:52:23.912 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-01T01:52:23.916 INFO:teuthology.orchestra.run.smithi097.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165997 files and directories currently installed.) 2024-04-01T01:52:23.921 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-04-01T01:52:23.973 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-04-01T01:52:24.226 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-01T01:52:24.241 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-01T01:52:24.249 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-01T01:52:24.276 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-01T01:52:24.276 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-01T01:52:24.316 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-01T01:52:24.579 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-cmd2. 2024-04-01T01:52:24.605 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-04-01T01:52:24.645 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-04-01T01:52:24.753 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-01T01:52:24.780 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-01T01:52:24.827 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-01T01:52:24.998 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-01T01:52:25.024 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-01T01:52:25.109 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-01T01:52:25.231 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-01T01:52:25.257 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-01T01:52:25.297 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-01T01:52:25.446 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-01T01:52:25.472 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-01T01:52:25.512 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-01T01:52:25.642 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-01T01:52:25.669 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-01T01:52:25.810 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-01T01:52:26.065 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-01T01:52:26.091 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-01T01:52:26.131 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-01T01:52:26.253 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-01T01:52:26.280 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-01T01:52:26.320 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-01T01:52:26.535 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-01T01:52:26.561 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-01T01:52:26.598 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package librados2. 2024-04-01T01:52:26.609 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-01T01:52:26.625 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../010-librados2_19.0.0-1977-g384f31f3-1jammy_amd64.deb ... 2024-04-01T01:52:26.664 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking librados2 (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:52:26.988 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-01T01:52:27.014 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-01T01:52:27.054 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-01T01:52:27.126 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package librbd1. 2024-04-01T01:52:27.153 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../011-librbd1_19.0.0-1977-g384f31f3-1jammy_amd64.deb ... 2024-04-01T01:52:27.192 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking librbd1 (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:52:27.408 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-01T01:52:27.434 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-01T01:52:27.474 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-01T01:52:27.653 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libcephfs2. 2024-04-01T01:52:27.680 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-1977-g384f31f3-1jammy_amd64.deb ... 2024-04-01T01:52:27.720 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libcephfs2 (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:52:27.802 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-01T01:52:27.828 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-01T01:52:27.868 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-01T01:52:27.997 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-rados. 2024-04-01T01:52:28.064 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../013-python3-rados_19.0.0-1977-g384f31f3-1jammy_amd64.deb ... 2024-04-01T01:52:28.064 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-rados (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:52:28.180 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package librados2. 2024-04-01T01:52:28.206 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../010-librados2_19.0.0-1977-g384f31f3-1jammy_amd64.deb ... 2024-04-01T01:52:28.246 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking librados2 (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:52:28.383 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-01T01:52:28.411 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-1977-g384f31f3-1jammy_all.deb ... 2024-04-01T01:52:28.450 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-ceph-argparse (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:52:28.699 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package librbd1. 2024-04-01T01:52:28.702 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-cephfs. 2024-04-01T01:52:28.725 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../011-librbd1_19.0.0-1977-g384f31f3-1jammy_amd64.deb ... 2024-04-01T01:52:28.729 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-1977-g384f31f3-1jammy_amd64.deb ... 2024-04-01T01:52:28.765 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking librbd1 (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:52:28.769 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-cephfs (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:52:29.097 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-01T01:52:29.124 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-1977-g384f31f3-1jammy_all.deb ... 2024-04-01T01:52:29.163 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-ceph-common (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:52:29.210 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libcephfs2. 2024-04-01T01:52:29.236 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-1977-g384f31f3-1jammy_amd64.deb ... 2024-04-01T01:52:29.276 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libcephfs2 (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:52:29.450 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-prettytable. 2024-04-01T01:52:29.477 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-04-01T01:52:29.508 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-01T01:52:29.554 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-rados. 2024-04-01T01:52:29.569 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../013-python3-rados_19.0.0-1977-g384f31f3-1jammy_amd64.deb ... 2024-04-01T01:52:29.604 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-rados (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:52:29.752 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-rbd. 2024-04-01T01:52:29.768 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-1977-g384f31f3-1jammy_amd64.deb ... 2024-04-01T01:52:29.810 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-rbd (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:52:29.898 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-01T01:52:29.924 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-1977-g384f31f3-1jammy_all.deb ... 2024-04-01T01:52:29.965 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-ceph-argparse (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:52:30.155 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-01T01:52:30.182 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-01T01:52:30.217 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-cephfs. 2024-04-01T01:52:30.221 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-01T01:52:30.232 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-1977-g384f31f3-1jammy_amd64.deb ... 2024-04-01T01:52:30.284 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-cephfs (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:52:30.499 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-01T01:52:30.515 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-01T01:52:30.557 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-01T01:52:30.603 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-01T01:52:30.629 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-1977-g384f31f3-1jammy_all.deb ... 2024-04-01T01:52:30.670 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-ceph-common (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:52:30.869 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-01T01:52:30.893 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-01T01:52:30.927 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-01T01:52:31.264 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package lua5.1. 2024-04-01T01:52:31.290 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-prettytable. 2024-04-01T01:52:31.291 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-01T01:52:31.305 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-04-01T01:52:31.330 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-01T01:52:31.340 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-01T01:52:31.592 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-rbd. 2024-04-01T01:52:31.608 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-1977-g384f31f3-1jammy_amd64.deb ... 2024-04-01T01:52:31.642 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package lua-any. 2024-04-01T01:52:31.650 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-rbd (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:52:31.669 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-04-01T01:52:31.708 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-01T01:52:31.961 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package zip. 2024-04-01T01:52:31.988 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-04-01T01:52:32.020 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-01T01:52:32.027 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking zip (3.0-12build2) ... 2024-04-01T01:52:32.046 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-01T01:52:32.086 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-01T01:52:32.322 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package unzip. 2024-04-01T01:52:32.349 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-01T01:52:32.372 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-01T01:52:32.388 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-01T01:52:32.388 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-01T01:52:32.431 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-01T01:52:32.725 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-01T01:52:32.740 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-01T01:52:32.751 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package luarocks. 2024-04-01T01:52:32.769 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-01T01:52:32.775 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-01T01:52:32.801 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-01T01:52:33.095 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package lua5.1. 2024-04-01T01:52:33.121 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-01T01:52:33.161 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-01T01:52:33.184 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package librgw2. 2024-04-01T01:52:33.211 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../027-librgw2_19.0.0-1977-g384f31f3-1jammy_amd64.deb ... 2024-04-01T01:52:33.250 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking librgw2 (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:52:33.489 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package lua-any. 2024-04-01T01:52:33.505 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-04-01T01:52:33.548 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-01T01:52:33.784 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package zip. 2024-04-01T01:52:33.803 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-rgw. 2024-04-01T01:52:33.810 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-04-01T01:52:33.830 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-1977-g384f31f3-1jammy_amd64.deb ... 2024-04-01T01:52:33.850 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking zip (3.0-12build2) ... 2024-04-01T01:52:33.869 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-rgw (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:52:34.120 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package unzip. 2024-04-01T01:52:34.146 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-01T01:52:34.178 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-01T01:52:34.205 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-01T01:52:34.233 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-01T01:52:34.272 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-01T01:52:34.533 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libradosstriper1. 2024-04-01T01:52:34.561 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-1977-g384f31f3-1jammy_amd64.deb ... 2024-04-01T01:52:34.608 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libradosstriper1 (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:52:34.665 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package luarocks. 2024-04-01T01:52:34.691 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-01T01:52:34.740 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-01T01:52:35.053 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-common. 2024-04-01T01:52:35.080 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../031-ceph-common_19.0.0-1977-g384f31f3-1jammy_amd64.deb ... 2024-04-01T01:52:35.119 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-common (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:52:35.139 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package librgw2. 2024-04-01T01:52:35.166 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../027-librgw2_19.0.0-1977-g384f31f3-1jammy_amd64.deb ... 2024-04-01T01:52:35.206 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking librgw2 (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:52:35.716 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-rgw. 2024-04-01T01:52:35.732 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-1977-g384f31f3-1jammy_amd64.deb ... 2024-04-01T01:52:35.766 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-rgw (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:52:36.094 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-01T01:52:36.121 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-01T01:52:36.353 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-01T01:52:36.608 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-base. 2024-04-01T01:52:36.635 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../032-ceph-base_19.0.0-1977-g384f31f3-1jammy_amd64.deb ... 2024-04-01T01:52:36.672 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libradosstriper1. 2024-04-01T01:52:36.693 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-base (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:52:36.698 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-1977-g384f31f3-1jammy_amd64.deb ... 2024-04-01T01:52:36.739 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libradosstriper1 (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:52:37.117 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-common. 2024-04-01T01:52:37.143 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../031-ceph-common_19.0.0-1977-g384f31f3-1jammy_amd64.deb ... 2024-04-01T01:52:37.183 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-common (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:52:37.271 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-01T01:52:37.298 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-01T01:52:37.337 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-01T01:52:37.598 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-cheroot. 2024-04-01T01:52:37.614 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-01T01:52:37.656 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-01T01:52:37.960 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-01T01:52:37.987 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-01T01:52:38.018 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-01T01:52:38.354 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-01T01:52:38.381 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-01T01:52:38.421 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-01T01:52:38.480 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-base. 2024-04-01T01:52:38.507 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../032-ceph-base_19.0.0-1977-g384f31f3-1jammy_amd64.deb ... 2024-04-01T01:52:38.556 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-base (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:52:38.723 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-01T01:52:38.751 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-01T01:52:38.790 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-01T01:52:39.093 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-tempora. 2024-04-01T01:52:39.120 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-04-01T01:52:39.134 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-01T01:52:39.160 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-01T01:52:39.161 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-01T01:52:39.201 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-01T01:52:39.429 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-portend. 2024-04-01T01:52:39.453 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-cheroot. 2024-04-01T01:52:39.456 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-04-01T01:52:39.480 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-01T01:52:39.495 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-01T01:52:39.512 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-01T01:52:39.799 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-01T01:52:39.814 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-01T01:52:39.825 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-01T01:52:39.841 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-01T01:52:39.865 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-01T01:52:39.881 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-01T01:52:40.168 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-01T01:52:40.176 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-01T01:52:40.194 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-01T01:52:40.204 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-01T01:52:40.243 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-01T01:52:40.250 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-01T01:52:40.578 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-01T01:52:40.596 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-natsort. 2024-04-01T01:52:40.605 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-01T01:52:40.624 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-04-01T01:52:40.645 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-01T01:52:40.663 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-01T01:52:40.915 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-tempora. 2024-04-01T01:52:40.941 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-04-01T01:52:40.973 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-01T01:52:40.974 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-logutils. 2024-04-01T01:52:41.001 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-04-01T01:52:41.041 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-01T01:52:41.242 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-portend. 2024-04-01T01:52:41.257 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-04-01T01:52:41.292 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-01T01:52:41.319 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-01T01:52:41.346 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-01T01:52:41.385 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-01T01:52:41.603 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-01T01:52:41.630 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-01T01:52:41.655 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-mako. 2024-04-01T01:52:41.670 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-01T01:52:41.682 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-01T01:52:41.721 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-01T01:52:41.972 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-01T01:52:41.999 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-01T01:52:42.039 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-01T01:52:42.050 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-01T01:52:42.077 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-01T01:52:42.116 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-01T01:52:42.375 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-natsort. 2024-04-01T01:52:42.402 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-04-01T01:52:42.405 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-01T01:52:42.430 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-01T01:52:42.442 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-01T01:52:42.469 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-01T01:52:42.729 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-logutils. 2024-04-01T01:52:42.747 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-webob. 2024-04-01T01:52:42.756 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-04-01T01:52:42.774 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-01T01:52:42.795 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-01T01:52:42.813 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-01T01:52:43.098 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-01T01:52:43.125 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-01T01:52:43.133 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-waitress. 2024-04-01T01:52:43.160 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-01T01:52:43.164 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-01T01:52:43.194 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-01T01:52:43.468 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-mako. 2024-04-01T01:52:43.486 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-tempita. 2024-04-01T01:52:43.495 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-01T01:52:43.514 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-01T01:52:43.535 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-01T01:52:43.554 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-01T01:52:43.879 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-01T01:52:43.881 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-paste. 2024-04-01T01:52:43.906 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-01T01:52:43.908 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-01T01:52:43.945 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-01T01:52:43.947 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-01T01:52:44.206 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-01T01:52:44.222 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-01T01:52:44.250 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-01T01:52:44.256 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-01T01:52:44.266 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-01T01:52:44.308 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-01T01:52:44.576 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-webob. 2024-04-01T01:52:44.603 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-01T01:52:44.611 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-01T01:52:44.638 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-01T01:52:44.642 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-01T01:52:44.677 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-01T01:52:45.004 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-waitress. 2024-04-01T01:52:45.006 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-webtest. 2024-04-01T01:52:45.030 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-01T01:52:45.033 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-04-01T01:52:45.072 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-01T01:52:45.073 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-01T01:52:45.384 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-pecan. 2024-04-01T01:52:45.398 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-tempita. 2024-04-01T01:52:45.411 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-01T01:52:45.425 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-01T01:52:45.465 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-01T01:52:45.808 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-01T01:52:46.464 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-certifi. 2024-04-01T01:52:46.491 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-04-01T01:52:46.521 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-01T01:52:46.601 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-paste. 2024-04-01T01:52:46.628 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-01T01:52:46.876 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-01T01:52:46.958 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-idna. 2024-04-01T01:52:46.974 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-04-01T01:52:47.016 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-01T01:52:47.213 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-01T01:52:47.239 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-01T01:52:47.279 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-01T01:52:47.327 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-urllib3. 2024-04-01T01:52:47.355 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-01T01:52:47.394 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-01T01:52:47.540 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-01T01:52:47.555 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-01T01:52:47.598 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-01T01:52:47.714 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-requests. 2024-04-01T01:52:47.741 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-01T01:52:47.780 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-01T01:52:47.901 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-webtest. 2024-04-01T01:52:47.928 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-04-01T01:52:47.968 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-01T01:52:48.108 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-01T01:52:48.135 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-01T01:52:48.174 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-01T01:52:48.279 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-pecan. 2024-04-01T01:52:48.305 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-01T01:52:48.346 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-01T01:52:48.495 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-01T01:52:48.522 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-1977-g384f31f3-1jammy_all.deb ... 2024-04-01T01:52:48.561 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-mgr-modules-core (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:52:48.725 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-certifi. 2024-04-01T01:52:48.752 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-04-01T01:52:48.792 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-01T01:52:48.933 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-01T01:52:48.960 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-1977-g384f31f3-1jammy_amd64.deb ... 2024-04-01T01:52:48.991 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:52:49.086 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-idna. 2024-04-01T01:52:49.102 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-04-01T01:52:49.136 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-01T01:52:49.285 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-01T01:52:49.313 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-01T01:52:49.352 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-01T01:52:49.397 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-urllib3. 2024-04-01T01:52:49.413 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-01T01:52:49.455 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-01T01:52:49.638 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-openssl. 2024-04-01T01:52:49.665 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-04-01T01:52:49.704 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-01T01:52:49.725 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-requests. 2024-04-01T01:52:49.753 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-01T01:52:49.792 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-01T01:52:50.041 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-mgr. 2024-04-01T01:52:50.068 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-1977-g384f31f3-1jammy_amd64.deb ... 2024-04-01T01:52:50.103 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-01T01:52:50.107 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-mgr (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:52:50.130 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-01T01:52:50.170 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-01T01:52:50.452 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-mon. 2024-04-01T01:52:50.480 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-1977-g384f31f3-1jammy_amd64.deb ... 2024-04-01T01:52:50.481 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-01T01:52:50.496 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-1977-g384f31f3-1jammy_all.deb ... 2024-04-01T01:52:50.510 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-mon (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:52:50.539 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-mgr-modules-core (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:52:50.885 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-01T01:52:50.913 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-1977-g384f31f3-1jammy_amd64.deb ... 2024-04-01T01:52:50.943 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:52:51.222 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-osd. 2024-04-01T01:52:51.250 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-1977-g384f31f3-1jammy_amd64.deb ... 2024-04-01T01:52:51.255 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-01T01:52:51.281 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-01T01:52:51.288 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-osd (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:52:51.321 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-01T01:52:51.624 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-openssl. 2024-04-01T01:52:51.651 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-04-01T01:52:51.690 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-01T01:52:52.018 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-mgr. 2024-04-01T01:52:52.033 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-1977-g384f31f3-1jammy_amd64.deb ... 2024-04-01T01:52:52.068 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-mgr (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:52:52.463 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-mon. 2024-04-01T01:52:52.483 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph. 2024-04-01T01:52:52.489 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-1977-g384f31f3-1jammy_amd64.deb ... 2024-04-01T01:52:52.511 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../068-ceph_19.0.0-1977-g384f31f3-1jammy_amd64.deb ... 2024-04-01T01:52:52.550 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:52:52.563 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-mon (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:52:52.869 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-fuse. 2024-04-01T01:52:52.896 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-1977-g384f31f3-1jammy_amd64.deb ... 2024-04-01T01:52:52.927 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-fuse (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:52:53.241 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-osd. 2024-04-01T01:52:53.268 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-1977-g384f31f3-1jammy_amd64.deb ... 2024-04-01T01:52:53.272 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-mds. 2024-04-01T01:52:53.299 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-1977-g384f31f3-1jammy_amd64.deb ... 2024-04-01T01:52:53.316 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-osd (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:52:53.338 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-mds (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:52:53.733 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package cephadm. 2024-04-01T01:52:53.760 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../071-cephadm_19.0.0-1977-g384f31f3-1jammy_amd64.deb ... 2024-04-01T01:52:53.799 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking cephadm (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:52:54.094 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-01T01:52:54.121 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-01T01:52:54.160 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-01T01:52:54.403 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph. 2024-04-01T01:52:54.429 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../068-ceph_19.0.0-1977-g384f31f3-1jammy_amd64.deb ... 2024-04-01T01:52:54.480 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-01T01:52:54.486 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:52:54.507 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-01T01:52:54.546 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-01T01:52:54.830 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-fuse. 2024-04-01T01:52:54.857 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-1977-g384f31f3-1jammy_amd64.deb ... 2024-04-01T01:52:54.896 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-fuse (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:52:55.283 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-mds. 2024-04-01T01:52:55.310 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-1977-g384f31f3-1jammy_amd64.deb ... 2024-04-01T01:52:55.349 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-mds (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:52:55.593 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-babel. 2024-04-01T01:52:55.621 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-01T01:52:55.660 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-01T01:52:55.811 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package cephadm. 2024-04-01T01:52:55.837 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../071-cephadm_19.0.0-1977-g384f31f3-1jammy_amd64.deb ... 2024-04-01T01:52:55.885 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking cephadm (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:52:55.979 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-jinja2. 2024-04-01T01:52:56.007 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-01T01:52:56.046 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-01T01:52:56.272 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-01T01:52:56.298 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-01T01:52:56.346 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-01T01:52:56.407 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-01T01:52:56.435 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-1977-g384f31f3-1jammy_all.deb ... 2024-04-01T01:52:56.482 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-mgr-cephadm (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:52:56.766 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-01T01:52:56.793 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-01T01:52:56.827 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-01T01:52:56.840 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-01T01:52:56.855 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-04-01T01:52:56.894 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-01T01:52:57.180 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-routes. 2024-04-01T01:52:57.208 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-01T01:52:57.246 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-01T01:52:57.524 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-01T01:52:57.541 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-1977-g384f31f3-1jammy_all.deb ... 2024-04-01T01:52:57.574 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-mgr-dashboard (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:52:57.996 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-babel. 2024-04-01T01:52:58.023 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-01T01:52:58.062 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-01T01:52:58.390 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-jinja2. 2024-04-01T01:52:58.417 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-01T01:52:58.456 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-01T01:52:58.784 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-01T01:52:58.800 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-1977-g384f31f3-1jammy_all.deb ... 2024-04-01T01:52:58.834 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-mgr-cephadm (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:52:58.880 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-01T01:52:58.907 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-01T01:52:58.946 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-01T01:52:59.154 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-01T01:52:59.181 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-04-01T01:52:59.221 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-01T01:52:59.450 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-joblib. 2024-04-01T01:52:59.477 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-01T01:52:59.481 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-routes. 2024-04-01T01:52:59.508 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-01T01:52:59.515 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-01T01:52:59.540 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-01T01:52:59.828 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-01T01:52:59.844 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-01T01:52:59.859 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-01T01:52:59.886 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-1977-g384f31f3-1jammy_all.deb ... 2024-04-01T01:52:59.918 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-mgr-dashboard (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:53:00.013 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-01T01:53:00.324 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-sklearn. 2024-04-01T01:53:00.352 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-01T01:53:00.390 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-01T01:53:01.067 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-01T01:53:01.095 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-1977-g384f31f3-1jammy_all.deb ... 2024-04-01T01:53:01.125 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:53:01.265 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-01T01:53:01.292 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-01T01:53:01.322 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-01T01:53:01.809 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-joblib. 2024-04-01T01:53:01.837 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-01T01:53:01.875 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-01T01:53:02.246 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-01T01:53:02.273 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-01T01:53:02.345 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-cachetools. 2024-04-01T01:53:02.373 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-04-01T01:53:02.398 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-01T01:53:02.411 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-01T01:53:02.664 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-01T01:53:02.680 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-01T01:53:02.700 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-sklearn. 2024-04-01T01:53:02.714 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-01T01:53:02.727 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-01T01:53:02.767 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-01T01:53:03.026 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-01T01:53:03.053 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-01T01:53:03.092 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-01T01:53:03.372 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-rsa. 2024-04-01T01:53:03.400 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-04-01T01:53:03.430 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-01T01:53:03.459 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-01T01:53:03.472 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-1977-g384f31f3-1jammy_all.deb ... 2024-04-01T01:53:03.509 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:53:03.734 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-google-auth. 2024-04-01T01:53:03.760 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-04-01T01:53:03.800 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-01T01:53:04.120 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-01T01:53:04.148 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-01T01:53:04.186 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-01T01:53:04.489 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-cachetools. 2024-04-01T01:53:04.505 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-04-01T01:53:04.507 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-websocket. 2024-04-01T01:53:04.534 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-04-01T01:53:04.547 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-01T01:53:04.573 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-01T01:53:04.858 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-01T01:53:04.876 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-01T01:53:04.885 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-01T01:53:04.905 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-01T01:53:04.925 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-01T01:53:04.943 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-01T01:53:05.236 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-01T01:53:05.264 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-01T01:53:05.294 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-01T01:53:05.581 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-rsa. 2024-04-01T01:53:05.608 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-04-01T01:53:05.615 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-01T01:53:05.644 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-1977-g384f31f3-1jammy_all.deb ... 2024-04-01T01:53:05.647 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-01T01:53:05.681 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:53:05.917 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-google-auth. 2024-04-01T01:53:05.941 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-04-01T01:53:05.975 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-01T01:53:06.009 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-01T01:53:06.037 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-01T01:53:06.076 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-01T01:53:06.270 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-01T01:53:06.286 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-01T01:53:06.322 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-01T01:53:06.412 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-01T01:53:06.440 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-01T01:53:06.479 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-01T01:53:06.565 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-websocket. 2024-04-01T01:53:06.581 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-04-01T01:53:06.623 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-01T01:53:06.707 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package jq. 2024-04-01T01:53:06.728 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-01T01:53:06.756 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-01T01:53:07.035 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-01T01:53:07.062 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-01T01:53:07.101 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-01T01:53:07.126 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package socat. 2024-04-01T01:53:07.154 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-01T01:53:07.192 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-01T01:53:07.638 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package xmlstarlet. 2024-04-01T01:53:07.665 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-01T01:53:07.704 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-01T01:53:07.798 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-01T01:53:07.814 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-1977-g384f31f3-1jammy_all.deb ... 2024-04-01T01:53:07.856 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:53:08.075 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-test. 2024-04-01T01:53:08.103 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../099-ceph-test_19.0.0-1977-g384f31f3-1jammy_amd64.deb ... 2024-04-01T01:53:08.141 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-test (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:53:08.409 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-01T01:53:08.436 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-01T01:53:08.476 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-01T01:53:08.804 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-01T01:53:08.831 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-01T01:53:08.870 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-01T01:53:09.106 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package jq. 2024-04-01T01:53:09.122 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-01T01:53:09.198 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-01T01:53:09.450 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package socat. 2024-04-01T01:53:09.477 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-01T01:53:09.517 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-01T01:53:09.837 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package xmlstarlet. 2024-04-01T01:53:09.864 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-01T01:53:09.903 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-01T01:53:10.249 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-test. 2024-04-01T01:53:10.276 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../099-ceph-test_19.0.0-1977-g384f31f3-1jammy_amd64.deb ... 2024-04-01T01:53:10.315 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-test (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:53:10.446 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-volume. 2024-04-01T01:53:10.474 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-1977-g384f31f3-1jammy_all.deb ... 2024-04-01T01:53:10.512 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-volume (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:53:10.866 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package cephfs-mirror. 2024-04-01T01:53:10.895 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-1977-g384f31f3-1jammy_amd64.deb ... 2024-04-01T01:53:10.924 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking cephfs-mirror (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:53:11.219 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-colorama. 2024-04-01T01:53:11.247 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-04-01T01:53:11.285 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-04-01T01:53:11.555 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package cephfs-shell. 2024-04-01T01:53:11.583 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-1977-g384f31f3-1jammy_all.deb ... 2024-04-01T01:53:11.621 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking cephfs-shell (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:53:11.882 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package cephfs-top. 2024-04-01T01:53:11.899 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-1977-g384f31f3-1jammy_all.deb ... 2024-04-01T01:53:11.940 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking cephfs-top (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:53:12.201 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-01T01:53:12.217 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-1977-g384f31f3-1jammy_amd64.deb ... 2024-04-01T01:53:12.262 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libcephfs-dev (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:53:12.544 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-volume. 2024-04-01T01:53:12.545 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-01T01:53:12.572 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-1977-g384f31f3-1jammy_all.deb ... 2024-04-01T01:53:12.574 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-01T01:53:12.610 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-volume (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:53:12.611 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-01T01:53:12.942 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-01T01:53:12.970 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-04-01T01:53:12.998 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package cephfs-mirror. 2024-04-01T01:53:13.007 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-01T01:53:13.026 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-1977-g384f31f3-1jammy_amd64.deb ... 2024-04-01T01:53:13.064 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking cephfs-mirror (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:53:13.328 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package nvme-cli. 2024-04-01T01:53:13.357 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-01T01:53:13.395 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-01T01:53:13.409 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-colorama. 2024-04-01T01:53:13.436 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-04-01T01:53:13.475 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-04-01T01:53:13.728 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package cephfs-shell. 2024-04-01T01:53:13.755 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-1977-g384f31f3-1jammy_all.deb ... 2024-04-01T01:53:13.775 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package pkg-config. 2024-04-01T01:53:13.794 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking cephfs-shell (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:53:13.804 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-01T01:53:13.833 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-01T01:53:14.005 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package cephfs-top. 2024-04-01T01:53:14.021 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-1977-g384f31f3-1jammy_all.deb ... 2024-04-01T01:53:14.063 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking cephfs-top (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:53:14.078 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-01T01:53:14.095 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-01T01:53:14.136 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-01T01:53:14.316 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-01T01:53:14.373 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-1977-g384f31f3-1jammy_amd64.deb ... 2024-04-01T01:53:14.374 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libcephfs-dev (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:53:14.548 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-01T01:53:14.576 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-01T01:53:14.614 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-01T01:53:14.652 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-01T01:53:14.668 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-01T01:53:14.701 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-01T01:53:14.917 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-pastescript. 2024-04-01T01:53:14.945 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-04-01T01:53:14.983 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-01T01:53:15.023 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-01T01:53:15.050 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-04-01T01:53:15.089 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-01T01:53:15.303 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-pluggy. 2024-04-01T01:53:15.332 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-01T01:53:15.394 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-01T01:53:15.460 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package nvme-cli. 2024-04-01T01:53:15.487 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-01T01:53:15.526 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-01T01:53:15.690 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-psutil. 2024-04-01T01:53:15.718 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-01T01:53:15.756 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-01T01:53:15.981 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package pkg-config. 2024-04-01T01:53:16.009 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-01T01:53:16.048 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-01T01:53:16.109 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-py. 2024-04-01T01:53:16.137 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-04-01T01:53:16.184 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-01T01:53:16.317 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-01T01:53:16.333 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-01T01:53:16.367 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-01T01:53:16.478 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-pygments. 2024-04-01T01:53:16.495 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-01T01:53:16.537 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-01T01:53:16.778 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-01T01:53:16.806 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-01T01:53:16.845 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-01T01:53:16.983 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-01T01:53:17.011 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-01T01:53:17.049 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-01T01:53:17.106 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-pastescript. 2024-04-01T01:53:17.133 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-04-01T01:53:17.163 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-01T01:53:17.352 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-toml. 2024-04-01T01:53:17.381 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-04-01T01:53:17.418 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-01T01:53:17.492 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-pluggy. 2024-04-01T01:53:17.520 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-01T01:53:17.558 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-01T01:53:17.721 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-pytest. 2024-04-01T01:53:17.749 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-01T01:53:17.787 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-01T01:53:17.870 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-psutil. 2024-04-01T01:53:17.897 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-01T01:53:17.936 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-01T01:53:18.133 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-simplejson. 2024-04-01T01:53:18.161 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-01T01:53:18.199 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-01T01:53:18.289 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-py. 2024-04-01T01:53:18.317 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-04-01T01:53:18.364 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-01T01:53:18.468 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-01T01:53:18.485 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-01T01:53:18.527 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-01T01:53:18.676 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-pygments. 2024-04-01T01:53:18.703 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-01T01:53:18.742 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-01T01:53:19.221 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-01T01:53:19.237 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-01T01:53:19.256 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package radosgw. 2024-04-01T01:53:19.279 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-01T01:53:19.285 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../122-radosgw_19.0.0-1977-g384f31f3-1jammy_amd64.deb ... 2024-04-01T01:53:19.339 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking radosgw (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:53:19.591 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-toml. 2024-04-01T01:53:19.618 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-04-01T01:53:19.657 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-01T01:53:19.926 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-pytest. 2024-04-01T01:53:19.954 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-01T01:53:19.992 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-01T01:53:20.275 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package rbd-fuse. 2024-04-01T01:53:20.292 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-1977-g384f31f3-1jammy_amd64.deb ... 2024-04-01T01:53:20.333 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking rbd-fuse (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:53:20.346 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-simplejson. 2024-04-01T01:53:20.373 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-01T01:53:20.412 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-01T01:53:20.630 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-01T01:53:20.690 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-01T01:53:20.706 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-01T01:53:20.748 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-01T01:53:20.897 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-01T01:53:20.998 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-01T01:53:21.269 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-01T01:53:21.502 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package radosgw. 2024-04-01T01:53:21.530 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../122-radosgw_19.0.0-1977-g384f31f3-1jammy_amd64.deb ... 2024-04-01T01:53:21.560 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking radosgw (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:53:21.621 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-01T01:53:22.040 INFO:teuthology.orchestra.run.smithi050.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-01T01:53:22.158 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up cephadm (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:53:22.322 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package rbd-fuse. 2024-04-01T01:53:22.349 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-1977-g384f31f3-1jammy_amd64.deb ... 2024-04-01T01:53:22.388 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking rbd-fuse (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:53:22.701 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-01T01:53:22.784 INFO:teuthology.orchestra.run.smithi050.stdout:Adding system user cephadm....done 2024-04-01T01:53:22.940 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-01T01:53:22.959 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-01T01:53:23.086 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-01T01:53:23.343 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-01T01:53:23.669 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-01T01:53:23.934 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-01T01:53:24.098 INFO:teuthology.orchestra.run.smithi097.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-01T01:53:24.170 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up cephadm (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:53:24.301 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-01T01:53:24.427 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-01T01:53:24.687 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-01T01:53:24.770 INFO:teuthology.orchestra.run.smithi097.stdout:Adding system user cephadm....done 2024-04-01T01:53:24.918 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-01T01:53:24.955 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-01T01:53:25.064 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-01T01:53:25.195 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-01T01:53:25.400 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-01T01:53:25.462 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-01T01:53:25.622 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-01T01:53:25.768 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-01T01:53:25.906 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-01T01:53:26.027 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-04-01T01:53:26.166 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-01T01:53:26.275 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-01T01:53:26.287 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-01T01:53:26.585 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-01T01:53:26.630 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-01T01:53:26.898 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-01T01:53:26.945 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-01T01:53:27.141 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-01T01:53:27.205 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-04-01T01:53:27.400 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-01T01:53:27.498 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-01T01:53:27.659 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-ceph-argparse (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:53:27.757 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-01T01:53:27.927 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-01T01:53:28.034 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-01T01:53:28.053 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-01T01:53:28.179 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-04-01T01:53:28.301 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-01T01:53:28.455 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-01T01:53:28.556 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-01T01:53:28.561 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-01T01:53:28.807 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-01T01:53:28.887 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-ceph-argparse (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:53:29.171 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-01T01:53:29.245 INFO:teuthology.orchestra.run.smithi050.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-01T01:53:29.281 INFO:teuthology.orchestra.run.smithi050.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-01T01:53:29.297 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-01T01:53:29.335 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-01T01:53:29.415 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-04-01T01:53:29.461 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-01T01:53:29.691 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-01T01:53:29.829 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-01T01:53:29.859 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-01T01:53:29.964 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-01T01:53:30.126 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-01T01:53:30.240 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-01T01:53:30.492 INFO:teuthology.orchestra.run.smithi097.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-01T01:53:30.499 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-01T01:53:30.525 INFO:teuthology.orchestra.run.smithi097.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-01T01:53:30.588 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-01T01:53:30.739 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-01T01:53:30.817 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up zip (3.0-12build2) ... 2024-04-01T01:53:30.943 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-01T01:53:31.140 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-01T01:53:31.291 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-01T01:53:31.576 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-01T01:53:31.670 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-01T01:53:31.843 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-01T01:53:31.938 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-01T01:53:32.089 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-01T01:53:32.144 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up zip (3.0-12build2) ... 2024-04-01T01:53:32.190 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-01T01:53:32.270 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-01T01:53:32.499 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-01T01:53:32.934 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-01T01:53:32.964 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-01T01:53:33.193 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-01T01:53:33.215 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-01T01:53:33.366 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-01T01:53:33.517 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-01T01:53:33.595 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-01T01:53:33.826 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-01T01:53:33.896 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-04-01T01:53:34.211 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-01T01:53:34.222 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-01T01:53:34.470 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-01T01:53:34.565 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-01T01:53:34.816 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-01T01:53:34.847 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-01T01:53:34.942 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-ceph-common (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:53:35.132 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-04-01T01:53:35.243 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-idna (3.3-1) ... 2024-04-01T01:53:35.441 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-01T01:53:35.561 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-01T01:53:35.784 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-01T01:53:36.035 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-01T01:53:36.161 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-ceph-common (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:53:36.454 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-idna (3.3-1) ... 2024-04-01T01:53:36.764 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-01T01:53:36.809 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-01T01:53:37.077 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-01T01:53:37.211 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-01T01:53:37.496 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-01T01:53:37.614 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-01T01:53:37.715 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-01T01:53:37.944 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-01T01:53:38.007 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-01T01:53:38.196 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-01T01:53:38.267 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-01T01:53:38.347 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-01T01:53:38.518 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-01T01:53:38.623 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-01T01:53:38.644 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-01T01:53:38.732 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-01T01:53:38.850 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-01T01:53:39.146 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-01T01:53:39.350 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-01T01:53:39.422 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-01T01:53:39.677 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-01T01:53:39.689 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-01T01:53:39.928 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-01T01:53:39.949 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-01T01:53:40.054 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-01T01:53:40.191 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-01T01:53:40.372 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-01T01:53:40.484 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-01T01:53:40.610 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-01T01:53:40.649 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-01T01:53:40.895 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-01T01:53:40.916 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-01T01:53:41.021 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-01T01:53:41.167 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-01T01:53:41.314 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-01T01:53:41.418 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-01T01:53:41.598 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-01T01:53:41.686 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-01T01:53:41.812 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-01T01:53:41.832 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-01T01:53:41.958 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-01T01:53:42.088 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-01T01:53:42.109 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-01T01:53:42.198 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-01T01:53:42.198 INFO:teuthology.orchestra.run.smithi050.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-01T01:53:42.452 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-01T01:53:42.482 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-01T01:53:42.579 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-01T01:53:42.800 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-01T01:53:42.998 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-01T01:53:43.051 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-01T01:53:43.177 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-01T01:53:43.248 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-01T01:53:43.303 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-01T01:53:43.374 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-01T01:53:43.393 INFO:teuthology.orchestra.run.smithi097.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-01T01:53:43.630 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-01T01:53:43.633 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-01T01:53:43.759 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-01T01:53:43.781 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-01T01:53:44.094 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-01T01:53:44.174 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-01T01:53:44.395 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-01T01:53:44.442 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-01T01:53:44.593 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-01T01:53:44.696 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-01T01:53:44.868 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-01T01:53:44.899 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-01T01:53:44.995 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-01T01:53:45.166 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-01T01:53:45.312 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-01T01:53:45.443 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-01T01:53:45.622 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-01T01:53:45.711 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-01T01:53:45.906 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-01T01:53:46.096 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-01T01:53:46.109 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-01T01:53:46.377 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-01T01:53:46.381 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-01T01:53:46.645 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-01T01:53:46.750 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-01T01:53:46.876 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up librados2 (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:53:46.905 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-01T01:53:47.002 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libsqlite3-mod-ceph (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:53:47.128 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-01T01:53:47.290 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-01T01:53:47.439 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libcephfs2 (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:53:47.557 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libradosstriper1 (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:53:47.591 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-01T01:53:47.683 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-01T01:53:47.927 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-01T01:53:47.985 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up librbd1 (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:53:48.053 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up librados2 (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:53:48.111 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-mgr-modules-core (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:53:48.179 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libsqlite3-mod-ceph (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:53:48.237 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-fuse (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:53:48.337 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-01T01:53:48.455 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-01T01:53:48.455 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-01T01:53:48.741 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libcephfs2 (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:53:48.892 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libradosstriper1 (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:53:48.929 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libcephfs-dev (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:53:49.035 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-01T01:53:49.056 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-rados (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:53:49.173 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up librgw2 (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:53:49.274 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up cephfs-top (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:53:49.311 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up librbd1 (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:53:49.400 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-01T01:53:49.437 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-mgr-modules-core (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:53:49.563 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-fuse (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:53:49.760 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-01T01:53:49.760 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-01T01:53:50.223 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libcephfs-dev (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:53:50.351 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-rados (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:53:50.477 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up librgw2 (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:53:50.603 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up cephfs-top (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:53:50.662 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-rbd (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:53:50.729 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-01T01:53:50.771 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up rbd-fuse (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:53:50.873 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-rgw (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:53:50.990 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-cephfs (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:53:51.116 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up cephfs-shell (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:53:51.242 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-common (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:53:51.793 INFO:teuthology.orchestra.run.smithi050.stdout:Adding group ceph....done 2024-04-01T01:53:51.958 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-rbd (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:53:52.092 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up rbd-fuse (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:53:52.180 INFO:teuthology.orchestra.run.smithi050.stdout:Adding system user ceph....done 2024-04-01T01:53:52.218 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-rgw (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:53:52.299 INFO:teuthology.orchestra.run.smithi050.stdout:Setting system user ceph properties....done 2024-04-01T01:53:52.313 INFO:teuthology.orchestra.run.smithi050.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-01T01:53:52.344 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-cephfs (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:53:52.456 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-01T01:53:52.470 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up cephfs-shell (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:53:52.596 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-common (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:53:52.796 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-01T01:53:53.139 INFO:teuthology.orchestra.run.smithi097.stdout:Adding group ceph....done 2024-04-01T01:53:53.270 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up cephfs-mirror (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:53:53.487 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-01T01:53:53.487 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-01T01:53:53.507 INFO:teuthology.orchestra.run.smithi097.stdout:Adding system user ceph....done 2024-04-01T01:53:53.692 INFO:teuthology.orchestra.run.smithi097.stdout:Setting system user ceph properties....done 2024-04-01T01:53:53.706 INFO:teuthology.orchestra.run.smithi097.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-01T01:53:53.847 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-01T01:53:53.955 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-test (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:53:54.073 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up radosgw (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:53:54.225 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-01T01:53:54.530 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-01T01:53:54.531 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-01T01:53:54.697 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up cephfs-mirror (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:53:54.930 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-01T01:53:54.931 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-01T01:53:55.004 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-base (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:53:55.357 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-01T01:53:55.424 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-test (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:53:55.575 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up radosgw (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:53:55.806 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-mds (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:53:56.023 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-01T01:53:56.023 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-01T01:53:56.056 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-01T01:53:56.056 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-01T01:53:56.475 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-mgr (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:53:56.544 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-base (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:53:56.701 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-01T01:53:56.701 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-01T01:53:56.889 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-01T01:53:57.177 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-osd (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:53:57.379 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-mds (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:53:57.460 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-01T01:53:57.460 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-01T01:53:57.625 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-01T01:53:57.625 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-01T01:53:57.953 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-mgr-k8sevents (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:53:58.063 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:53:58.122 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-mgr (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:53:58.197 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-mon (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:53:58.315 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-01T01:53:58.316 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-01T01:53:58.406 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-01T01:53:58.406 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-01T01:53:58.806 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-osd (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:53:58.955 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-mgr-cephadm (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:53:59.062 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-01T01:53:59.062 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-01T01:53:59.217 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:53:59.334 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-mgr-dashboard (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:53:59.460 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-volume (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:53:59.592 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-mgr-k8sevents (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:53:59.718 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:53:59.788 INFO:teuthology.orchestra.run.smithi050.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-01T01:53:59.889 INFO:teuthology.orchestra.run.smithi050.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-01T01:54:00.029 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-mon (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:54:00.082 INFO:teuthology.orchestra.run.smithi050.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-01T01:54:00.250 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-01T01:54:00.250 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-01T01:54:00.781 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-mgr-cephadm (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:54:00.940 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:54:01.041 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-mgr-dashboard (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:54:01.200 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-volume (19.0.0-1977-g384f31f3-1jammy) ... 2024-04-01T01:54:01.226 INFO:teuthology.orchestra.run.smithi050.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-01T01:54:01.553 INFO:teuthology.orchestra.run.smithi097.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-01T01:54:01.662 INFO:teuthology.orchestra.run.smithi097.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-01T01:54:01.840 INFO:teuthology.orchestra.run.smithi097.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-01T01:54:01.912 INFO:teuthology.orchestra.run.smithi050.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-01T01:54:01.916 DEBUG:teuthology.orchestra.run.smithi050:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-04-01T01:54:01.977 INFO:teuthology.orchestra.run.smithi050.stdout:Reading package lists... 2024-04-01T01:54:02.180 INFO:teuthology.orchestra.run.smithi050.stdout:Building dependency tree... 2024-04-01T01:54:02.181 INFO:teuthology.orchestra.run.smithi050.stdout:Reading state information... 2024-04-01T01:54:02.378 INFO:teuthology.orchestra.run.smithi050.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-04-01T01:54:02.379 INFO:teuthology.orchestra.run.smithi050.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-04-01T01:54:02.379 INFO:teuthology.orchestra.run.smithi050.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-04-01T01:54:02.379 INFO:teuthology.orchestra.run.smithi050.stdout:The following packages were automatically installed and are no longer required: 2024-04-01T01:54:02.379 INFO:teuthology.orchestra.run.smithi050.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-01T01:54:02.379 INFO:teuthology.orchestra.run.smithi050.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-01T01:54:02.379 INFO:teuthology.orchestra.run.smithi050.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-01T01:54:02.379 INFO:teuthology.orchestra.run.smithi050.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-01T01:54:02.380 INFO:teuthology.orchestra.run.smithi050.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-01T01:54:02.380 INFO:teuthology.orchestra.run.smithi050.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-01T01:54:02.380 INFO:teuthology.orchestra.run.smithi050.stdout:The following additional packages will be installed: 2024-04-01T01:54:02.380 INFO:teuthology.orchestra.run.smithi050.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-04-01T01:54:02.380 INFO:teuthology.orchestra.run.smithi050.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-04-01T01:54:02.381 INFO:teuthology.orchestra.run.smithi050.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-04-01T01:54:02.381 INFO:teuthology.orchestra.run.smithi050.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-04-01T01:54:02.381 INFO:teuthology.orchestra.run.smithi050.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-01T01:54:02.382 INFO:teuthology.orchestra.run.smithi050.stdout:Suggested packages: 2024-04-01T01:54:02.382 INFO:teuthology.orchestra.run.smithi050.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-04-01T01:54:02.383 INFO:teuthology.orchestra.run.smithi050.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-04-01T01:54:02.383 INFO:teuthology.orchestra.run.smithi050.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-04-01T01:54:02.427 INFO:teuthology.orchestra.run.smithi050.stdout:The following NEW packages will be installed: 2024-04-01T01:54:02.427 INFO:teuthology.orchestra.run.smithi050.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-04-01T01:54:02.427 INFO:teuthology.orchestra.run.smithi050.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-04-01T01:54:02.428 INFO:teuthology.orchestra.run.smithi050.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-04-01T01:54:02.429 INFO:teuthology.orchestra.run.smithi050.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-04-01T01:54:02.429 INFO:teuthology.orchestra.run.smithi050.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-04-01T01:54:02.429 INFO:teuthology.orchestra.run.smithi050.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-04-01T01:54:02.429 INFO:teuthology.orchestra.run.smithi050.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-01T01:54:02.429 INFO:teuthology.orchestra.run.smithi050.stdout:The following packages will be upgraded: 2024-04-01T01:54:02.430 INFO:teuthology.orchestra.run.smithi050.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-04-01T01:54:02.512 INFO:teuthology.orchestra.run.smithi050.stdout:4 upgraded, 39 newly installed, 0 to remove and 294 not upgraded. 2024-04-01T01:54:02.512 INFO:teuthology.orchestra.run.smithi050.stdout:Need to get 55.7 MB of archives. 2024-04-01T01:54:02.512 INFO:teuthology.orchestra.run.smithi050.stdout:After this operation, 202 MB of additional disk space will be used. 2024-04-01T01:54:02.512 INFO:teuthology.orchestra.run.smithi050.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.3 [1,063 kB] 2024-04-01T01:54:02.672 INFO:teuthology.orchestra.run.smithi050.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-04-01T01:54:02.680 INFO:teuthology.orchestra.run.smithi050.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-04-01T01:54:02.721 INFO:teuthology.orchestra.run.smithi050.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.3 [33.1 kB] 2024-04-01T01:54:02.722 INFO:teuthology.orchestra.run.smithi050.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.3 [24.4 kB] 2024-04-01T01:54:02.723 INFO:teuthology.orchestra.run.smithi050.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-04-01T01:54:02.734 INFO:teuthology.orchestra.run.smithi050.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-04-01T01:54:02.735 INFO:teuthology.orchestra.run.smithi050.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-04-01T01:54:03.032 INFO:teuthology.orchestra.run.smithi097.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-01T01:54:03.719 INFO:teuthology.orchestra.run.smithi050.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-04-01T01:54:03.721 INFO:teuthology.orchestra.run.smithi050.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-04-01T01:54:03.722 INFO:teuthology.orchestra.run.smithi050.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-04-01T01:54:03.724 INFO:teuthology.orchestra.run.smithi050.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-04-01T01:54:03.726 INFO:teuthology.orchestra.run.smithi050.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-04-01T01:54:03.726 INFO:teuthology.orchestra.run.smithi050.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-04-01T01:54:03.727 INFO:teuthology.orchestra.run.smithi050.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-04-01T01:54:03.729 INFO:teuthology.orchestra.run.smithi050.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-04-01T01:54:03.732 INFO:teuthology.orchestra.run.smithi097.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-01T01:54:03.735 DEBUG:teuthology.orchestra.run.smithi097:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-04-01T01:54:03.789 INFO:teuthology.orchestra.run.smithi097.stdout:Reading package lists... 2024-04-01T01:54:03.987 INFO:teuthology.orchestra.run.smithi097.stdout:Building dependency tree... 2024-04-01T01:54:03.987 INFO:teuthology.orchestra.run.smithi097.stdout:Reading state information... 2024-04-01T01:54:04.180 INFO:teuthology.orchestra.run.smithi097.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-04-01T01:54:04.180 INFO:teuthology.orchestra.run.smithi097.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-04-01T01:54:04.180 INFO:teuthology.orchestra.run.smithi097.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-04-01T01:54:04.180 INFO:teuthology.orchestra.run.smithi097.stdout:The following packages were automatically installed and are no longer required: 2024-04-01T01:54:04.180 INFO:teuthology.orchestra.run.smithi097.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-01T01:54:04.180 INFO:teuthology.orchestra.run.smithi097.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-01T01:54:04.180 INFO:teuthology.orchestra.run.smithi097.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-01T01:54:04.181 INFO:teuthology.orchestra.run.smithi097.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-01T01:54:04.181 INFO:teuthology.orchestra.run.smithi097.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-01T01:54:04.181 INFO:teuthology.orchestra.run.smithi097.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-01T01:54:04.181 INFO:teuthology.orchestra.run.smithi097.stdout:The following additional packages will be installed: 2024-04-01T01:54:04.181 INFO:teuthology.orchestra.run.smithi097.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-04-01T01:54:04.182 INFO:teuthology.orchestra.run.smithi097.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-04-01T01:54:04.182 INFO:teuthology.orchestra.run.smithi097.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-04-01T01:54:04.182 INFO:teuthology.orchestra.run.smithi097.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-04-01T01:54:04.182 INFO:teuthology.orchestra.run.smithi097.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-01T01:54:04.183 INFO:teuthology.orchestra.run.smithi097.stdout:Suggested packages: 2024-04-01T01:54:04.184 INFO:teuthology.orchestra.run.smithi097.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-04-01T01:54:04.184 INFO:teuthology.orchestra.run.smithi097.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-04-01T01:54:04.184 INFO:teuthology.orchestra.run.smithi097.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-04-01T01:54:04.226 INFO:teuthology.orchestra.run.smithi097.stdout:The following NEW packages will be installed: 2024-04-01T01:54:04.227 INFO:teuthology.orchestra.run.smithi097.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-04-01T01:54:04.227 INFO:teuthology.orchestra.run.smithi097.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-04-01T01:54:04.227 INFO:teuthology.orchestra.run.smithi097.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-04-01T01:54:04.227 INFO:teuthology.orchestra.run.smithi097.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-04-01T01:54:04.227 INFO:teuthology.orchestra.run.smithi097.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-04-01T01:54:04.227 INFO:teuthology.orchestra.run.smithi097.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-04-01T01:54:04.227 INFO:teuthology.orchestra.run.smithi097.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-01T01:54:04.228 INFO:teuthology.orchestra.run.smithi097.stdout:The following packages will be upgraded: 2024-04-01T01:54:04.229 INFO:teuthology.orchestra.run.smithi097.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-04-01T01:54:04.288 INFO:teuthology.orchestra.run.smithi097.stdout:4 upgraded, 39 newly installed, 0 to remove and 294 not upgraded. 2024-04-01T01:54:04.288 INFO:teuthology.orchestra.run.smithi097.stdout:Need to get 55.7 MB of archives. 2024-04-01T01:54:04.288 INFO:teuthology.orchestra.run.smithi097.stdout:After this operation, 202 MB of additional disk space will be used. 2024-04-01T01:54:04.288 INFO:teuthology.orchestra.run.smithi097.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.3 [1,063 kB] 2024-04-01T01:54:04.310 INFO:teuthology.orchestra.run.smithi050.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-04-01T01:54:04.449 INFO:teuthology.orchestra.run.smithi097.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-04-01T01:54:04.456 INFO:teuthology.orchestra.run.smithi097.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-04-01T01:54:04.497 INFO:teuthology.orchestra.run.smithi097.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.3 [33.1 kB] 2024-04-01T01:54:04.498 INFO:teuthology.orchestra.run.smithi097.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.3 [24.4 kB] 2024-04-01T01:54:04.499 INFO:teuthology.orchestra.run.smithi097.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-04-01T01:54:04.510 INFO:teuthology.orchestra.run.smithi097.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-04-01T01:54:04.510 INFO:teuthology.orchestra.run.smithi097.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-04-01T01:54:04.513 INFO:teuthology.orchestra.run.smithi097.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-04-01T01:54:04.514 INFO:teuthology.orchestra.run.smithi097.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-04-01T01:54:04.514 INFO:teuthology.orchestra.run.smithi097.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-04-01T01:54:04.516 INFO:teuthology.orchestra.run.smithi097.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-04-01T01:54:04.519 INFO:teuthology.orchestra.run.smithi097.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-04-01T01:54:04.538 INFO:teuthology.orchestra.run.smithi097.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-04-01T01:54:04.538 INFO:teuthology.orchestra.run.smithi097.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-04-01T01:54:04.539 INFO:teuthology.orchestra.run.smithi097.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-04-01T01:54:04.750 INFO:teuthology.orchestra.run.smithi050.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-04-01T01:54:04.751 INFO:teuthology.orchestra.run.smithi050.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-04-01T01:54:04.758 INFO:teuthology.orchestra.run.smithi050.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-04-01T01:54:04.759 INFO:teuthology.orchestra.run.smithi050.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-04-01T01:54:04.769 INFO:teuthology.orchestra.run.smithi050.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-04-01T01:54:04.773 INFO:teuthology.orchestra.run.smithi050.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-04-01T01:54:04.868 INFO:teuthology.orchestra.run.smithi097.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-04-01T01:54:04.870 INFO:teuthology.orchestra.run.smithi097.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-04-01T01:54:04.870 INFO:teuthology.orchestra.run.smithi097.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-04-01T01:54:04.872 INFO:teuthology.orchestra.run.smithi097.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-04-01T01:54:04.872 INFO:teuthology.orchestra.run.smithi097.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-04-01T01:54:04.876 INFO:teuthology.orchestra.run.smithi097.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-04-01T01:54:04.912 INFO:teuthology.orchestra.run.smithi097.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-04-01T01:54:04.919 INFO:teuthology.orchestra.run.smithi097.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-04-01T01:54:04.919 INFO:teuthology.orchestra.run.smithi097.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-04-01T01:54:04.939 INFO:teuthology.orchestra.run.smithi097.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-04-01T01:54:04.939 INFO:teuthology.orchestra.run.smithi097.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-04-01T01:54:04.960 INFO:teuthology.orchestra.run.smithi097.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-04-01T01:54:04.987 INFO:teuthology.orchestra.run.smithi097.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-04-01T01:54:04.997 INFO:teuthology.orchestra.run.smithi097.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-04-01T01:54:05.002 INFO:teuthology.orchestra.run.smithi097.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-04-01T01:54:05.008 INFO:teuthology.orchestra.run.smithi097.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-04-01T01:54:05.015 INFO:teuthology.orchestra.run.smithi097.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-04-01T01:54:05.036 INFO:teuthology.orchestra.run.smithi097.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-04-01T01:54:05.085 INFO:teuthology.orchestra.run.smithi097.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-04-01T01:54:05.403 INFO:teuthology.orchestra.run.smithi097.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-04-01T01:54:05.403 INFO:teuthology.orchestra.run.smithi097.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-04-01T01:54:05.403 INFO:teuthology.orchestra.run.smithi097.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-04-01T01:54:05.403 INFO:teuthology.orchestra.run.smithi097.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-04-01T01:54:05.403 INFO:teuthology.orchestra.run.smithi097.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-04-01T01:54:05.403 INFO:teuthology.orchestra.run.smithi097.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-04-01T01:54:05.416 INFO:teuthology.orchestra.run.smithi097.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-04-01T01:54:05.417 INFO:teuthology.orchestra.run.smithi097.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-04-01T01:54:05.820 INFO:teuthology.orchestra.run.smithi097.stdout:Preconfiguring packages ... 2024-04-01T01:54:05.884 INFO:teuthology.orchestra.run.smithi050.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-04-01T01:54:05.884 INFO:teuthology.orchestra.run.smithi050.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-04-01T01:54:05.989 INFO:teuthology.orchestra.run.smithi050.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-04-01T01:54:05.990 INFO:teuthology.orchestra.run.smithi050.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-04-01T01:54:05.995 INFO:teuthology.orchestra.run.smithi097.stdout:Fetched 55.7 MB in 1s (47.2 MB/s) 2024-04-01T01:54:06.016 INFO:teuthology.orchestra.run.smithi050.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-04-01T01:54:06.049 INFO:teuthology.orchestra.run.smithi050.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-04-01T01:54:06.054 INFO:teuthology.orchestra.run.smithi050.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-04-01T01:54:06.054 INFO:teuthology.orchestra.run.smithi050.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-04-01T01:54:06.055 INFO:teuthology.orchestra.run.smithi050.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-04-01T01:54:06.056 INFO:teuthology.orchestra.run.smithi050.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-04-01T01:54:06.069 INFO:teuthology.orchestra.run.smithi050.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-04-01T01:54:06.071 INFO:teuthology.orchestra.run.smithi050.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-04-01T01:54:06.381 INFO:teuthology.orchestra.run.smithi097.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173982 files and directories currently installed.) 2024-04-01T01:54:06.387 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.3_amd64.deb ... 2024-04-01T01:54:06.480 INFO:teuthology.orchestra.run.smithi050.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-04-01T01:54:06.481 INFO:teuthology.orchestra.run.smithi050.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-04-01T01:54:06.481 INFO:teuthology.orchestra.run.smithi050.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-04-01T01:54:06.481 INFO:teuthology.orchestra.run.smithi050.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-04-01T01:54:06.481 INFO:teuthology.orchestra.run.smithi050.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-04-01T01:54:06.481 INFO:teuthology.orchestra.run.smithi050.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-04-01T01:54:06.502 INFO:teuthology.orchestra.run.smithi050.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-04-01T01:54:06.502 INFO:teuthology.orchestra.run.smithi050.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-04-01T01:54:06.566 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking util-linux (2.37.2-4ubuntu3.3) over (2.37.2-4ubuntu3) ... 2024-04-01T01:54:06.926 INFO:teuthology.orchestra.run.smithi050.stdout:Preconfiguring packages ... 2024-04-01T01:54:07.071 INFO:teuthology.orchestra.run.smithi050.stdout:Fetched 55.7 MB in 4s (13.7 MB/s) 2024-04-01T01:54:07.195 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up util-linux (2.37.2-4ubuntu3.3) ... 2024-04-01T01:54:07.391 INFO:teuthology.orchestra.run.smithi050.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173982 files and directories currently installed.) 2024-04-01T01:54:07.397 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.3_amd64.deb ... 2024-04-01T01:54:07.533 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking util-linux (2.37.2-4ubuntu3.3) over (2.37.2-4ubuntu3) ... 2024-04-01T01:54:08.129 INFO:teuthology.orchestra.run.smithi097.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-04-01T01:54:08.129 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up util-linux (2.37.2-4ubuntu3.3) ... 2024-04-01T01:54:08.363 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package flex. 2024-04-01T01:54:08.462 INFO:teuthology.orchestra.run.smithi097.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173982 files and directories currently installed.) 2024-04-01T01:54:08.467 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-04-01T01:54:08.511 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking flex (2.6.4-8build2) ... 2024-04-01T01:54:09.041 INFO:teuthology.orchestra.run.smithi050.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-04-01T01:54:09.043 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-01T01:54:09.217 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-04-01T01:54:09.280 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package flex. 2024-04-01T01:54:09.383 INFO:teuthology.orchestra.run.smithi050.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173982 files and directories currently installed.) 2024-04-01T01:54:09.388 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-04-01T01:54:09.428 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking flex (2.6.4-8build2) ... 2024-04-01T01:54:09.661 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-01T01:54:09.946 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-01T01:54:10.118 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-04-01T01:54:10.188 INFO:teuthology.orchestra.run.smithi097.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174055 files and directories currently installed.) 2024-04-01T01:54:10.193 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.3_amd64.deb ... 2024-04-01T01:54:10.316 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.3) over (2.37.2-4ubuntu3) ... 2024-04-01T01:54:10.513 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-01T01:54:10.818 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.3_amd64.deb ... 2024-04-01T01:54:10.972 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.3) over (2.37.2-4ubuntu3) ... 2024-04-01T01:54:11.026 INFO:teuthology.orchestra.run.smithi050.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174055 files and directories currently installed.) 2024-04-01T01:54:11.030 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.3_amd64.deb ... 2024-04-01T01:54:11.126 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.3) over (2.37.2-4ubuntu3) ... 2024-04-01T01:54:11.375 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.3) ... 2024-04-01T01:54:11.544 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.3_amd64.deb ... 2024-04-01T01:54:11.691 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.3) over (2.37.2-4ubuntu3) ... 2024-04-01T01:54:11.790 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package bison. 2024-04-01T01:54:11.897 INFO:teuthology.orchestra.run.smithi097.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174055 files and directories currently installed.) 2024-04-01T01:54:11.902 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-04-01T01:54:11.958 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-04-01T01:54:12.027 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.3) ... 2024-04-01T01:54:12.409 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package bison. 2024-04-01T01:54:12.443 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-04-01T01:54:12.470 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-04-01T01:54:12.516 INFO:teuthology.orchestra.run.smithi050.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174055 files and directories currently installed.) 2024-04-01T01:54:12.518 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-04-01T01:54:12.522 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-04-01T01:54:12.570 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-04-01T01:54:12.908 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package dump. 2024-04-01T01:54:12.936 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-04-01T01:54:12.971 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-04-01T01:54:12.995 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking dump (0.4b47-3) ... 2024-04-01T01:54:12.999 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-04-01T01:54:13.037 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-04-01T01:54:13.308 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package indent. 2024-04-01T01:54:13.324 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-04-01T01:54:13.357 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package dump. 2024-04-01T01:54:13.366 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-01T01:54:13.385 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-04-01T01:54:13.423 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking dump (0.4b47-3) ... 2024-04-01T01:54:13.677 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-01T01:54:13.703 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package indent. 2024-04-01T01:54:13.705 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-04-01T01:54:13.720 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-04-01T01:54:13.752 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-01T01:54:13.869 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-01T01:54:14.097 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-01T01:54:14.126 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-04-01T01:54:14.156 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-04-01T01:54:14.163 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-01T01:54:14.184 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-04-01T01:54:14.222 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-01T01:54:14.483 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-01T01:54:14.499 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-04-01T01:54:14.501 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-04-01T01:54:14.530 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-04-01T01:54:14.541 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-04-01T01:54:14.568 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-01T01:54:14.829 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-01T01:54:14.857 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-04-01T01:54:14.896 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-04-01T01:54:14.962 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libfl2:amd64. 2024-04-01T01:54:14.990 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-04-01T01:54:15.037 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-04-01T01:54:15.199 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libfl2:amd64. 2024-04-01T01:54:15.227 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-04-01T01:54:15.284 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-04-01T01:54:15.339 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-04-01T01:54:15.367 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-04-01T01:54:15.414 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-01T01:54:15.535 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-04-01T01:54:15.552 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-04-01T01:54:15.594 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-01T01:54:15.675 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libjson-perl. 2024-04-01T01:54:15.691 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-04-01T01:54:15.725 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-04-01T01:54:15.830 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libjson-perl. 2024-04-01T01:54:15.847 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-04-01T01:54:15.888 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-04-01T01:54:16.054 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libllvm14:amd64. 2024-04-01T01:54:16.081 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-04-01T01:54:16.120 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-01T01:54:16.150 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libllvm14:amd64. 2024-04-01T01:54:16.179 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-04-01T01:54:16.217 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-01T01:54:17.798 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-04-01T01:54:17.826 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-01T01:54:17.864 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-01T01:54:17.945 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-04-01T01:54:17.973 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-01T01:54:18.011 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-01T01:54:18.125 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libmbim-proxy. 2024-04-01T01:54:18.141 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-01T01:54:18.175 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-01T01:54:18.272 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libmbim-proxy. 2024-04-01T01:54:18.289 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-01T01:54:18.330 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-01T01:54:18.487 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-04-01T01:54:18.514 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-01T01:54:18.553 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-01T01:54:18.692 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-04-01T01:54:18.721 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-01T01:54:18.759 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-01T01:54:18.923 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libndp0:amd64. 2024-04-01T01:54:18.950 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-04-01T01:54:18.989 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-01T01:54:19.112 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libndp0:amd64. 2024-04-01T01:54:19.140 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-04-01T01:54:19.178 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-01T01:54:19.326 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libnm0:amd64. 2024-04-01T01:54:19.353 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-04-01T01:54:19.392 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-01T01:54:19.473 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libnm0:amd64. 2024-04-01T01:54:19.502 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-04-01T01:54:19.531 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-01T01:54:19.712 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libpq5:amd64. 2024-04-01T01:54:19.739 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-01T01:54:19.778 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-01T01:54:19.885 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libpq5:amd64. 2024-04-01T01:54:19.914 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-01T01:54:19.951 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-01T01:54:20.132 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-04-01T01:54:20.159 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-01T01:54:20.198 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-01T01:54:20.288 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-04-01T01:54:20.317 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-01T01:54:20.354 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-01T01:54:20.500 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libqmi-proxy. 2024-04-01T01:54:20.525 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-01T01:54:20.567 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-01T01:54:20.649 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libqmi-proxy. 2024-04-01T01:54:20.677 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-01T01:54:20.715 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-01T01:54:20.795 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-01T01:54:20.811 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-01T01:54:20.845 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-01T01:54:20.968 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-01T01:54:20.996 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-01T01:54:21.035 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-01T01:54:21.340 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-04-01T01:54:21.368 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-04-01T01:54:21.407 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-04-01T01:54:21.580 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-04-01T01:54:21.608 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-04-01T01:54:21.646 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-04-01T01:54:21.718 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package modemmanager. 2024-04-01T01:54:21.746 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-01T01:54:21.785 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-01T01:54:21.967 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package modemmanager. 2024-04-01T01:54:21.995 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-01T01:54:22.058 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-01T01:54:22.408 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package network-manager. 2024-04-01T01:54:22.436 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-04-01T01:54:22.500 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-04-01T01:54:22.682 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package network-manager. 2024-04-01T01:54:22.710 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-04-01T01:54:22.757 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-04-01T01:54:23.132 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ppp. 2024-04-01T01:54:23.160 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-04-01T01:54:23.340 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ppp. 2024-04-01T01:54:23.368 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-04-01T01:54:23.429 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-04-01T01:54:23.627 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-04-01T01:54:23.815 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package pptp-linux. 2024-04-01T01:54:23.843 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-04-01T01:54:23.912 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package pptp-linux. 2024-04-01T01:54:23.920 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-04-01T01:54:23.940 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-04-01T01:54:23.978 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-04-01T01:54:24.215 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package network-manager-pptp. 2024-04-01T01:54:24.236 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package network-manager-pptp. 2024-04-01T01:54:24.243 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-04-01T01:54:24.253 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-04-01T01:54:24.290 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-04-01T01:54:24.297 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-04-01T01:54:24.567 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package postgresql-client-common. 2024-04-01T01:54:24.593 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-04-01T01:54:24.634 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking postgresql-client-common (238) ... 2024-04-01T01:54:24.685 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package postgresql-client-common. 2024-04-01T01:54:24.712 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-04-01T01:54:24.759 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking postgresql-client-common (238) ... 2024-04-01T01:54:24.938 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package postgresql-client-14. 2024-04-01T01:54:24.967 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-01T01:54:25.005 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-01T01:54:25.080 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package postgresql-client-14. 2024-04-01T01:54:25.108 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-01T01:54:25.147 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-01T01:54:25.735 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package postgresql-common. 2024-04-01T01:54:25.764 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-04-01T01:54:25.768 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package postgresql-common. 2024-04-01T01:54:25.796 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-04-01T01:54:25.820 INFO:teuthology.orchestra.run.smithi050.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-04-01T01:54:25.850 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking postgresql-common (238) ... 2024-04-01T01:54:25.853 INFO:teuthology.orchestra.run.smithi097.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-04-01T01:54:25.882 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking postgresql-common (238) ... 2024-04-01T01:54:26.284 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package postgresql-14. 2024-04-01T01:54:26.313 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-01T01:54:26.350 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package postgresql-14. 2024-04-01T01:54:26.354 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-01T01:54:26.379 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-01T01:54:26.420 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-01T01:54:27.596 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package postgresql. 2024-04-01T01:54:27.614 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-04-01T01:54:27.654 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking postgresql (14+238) ... 2024-04-01T01:54:27.687 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package postgresql. 2024-04-01T01:54:27.716 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-04-01T01:54:27.753 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking postgresql (14+238) ... 2024-04-01T01:54:27.881 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package postgresql-client. 2024-04-01T01:54:27.910 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-04-01T01:54:27.940 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking postgresql-client (14+238) ... 2024-04-01T01:54:27.997 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package postgresql-client. 2024-04-01T01:54:28.013 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-04-01T01:54:28.063 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking postgresql-client (14+238) ... 2024-04-01T01:54:28.291 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package postgresql-contrib. 2024-04-01T01:54:28.307 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-04-01T01:54:28.349 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking postgresql-contrib (14+238) ... 2024-04-01T01:54:28.619 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package postgresql-contrib. 2024-04-01T01:54:28.649 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-04-01T01:54:28.668 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package tcl8.6. 2024-04-01T01:54:28.692 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking postgresql-contrib (14+238) ... 2024-04-01T01:54:28.696 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-04-01T01:54:28.735 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-01T01:54:29.012 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package tcl8.6. 2024-04-01T01:54:29.029 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package tcl. 2024-04-01T01:54:29.041 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-04-01T01:54:29.045 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-04-01T01:54:29.078 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-01T01:54:29.093 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-04-01T01:54:29.348 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package tcl. 2024-04-01T01:54:29.377 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-04-01T01:54:29.419 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-04-01T01:54:29.440 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package wpasupplicant. 2024-04-01T01:54:29.468 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-04-01T01:54:29.507 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-01T01:54:29.709 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package wpasupplicant. 2024-04-01T01:54:29.738 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-04-01T01:54:29.775 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-01T01:54:29.886 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-04-01T01:54:29.914 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-04-01T01:54:29.961 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-04-01T01:54:30.147 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-04-01T01:54:30.172 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-04-01T01:54:30.213 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-04-01T01:54:30.339 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package usb-modeswitch. 2024-04-01T01:54:30.368 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-04-01T01:54:30.414 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-01T01:54:30.592 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package usb-modeswitch. 2024-04-01T01:54:30.621 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-04-01T01:54:30.667 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-01T01:54:30.719 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up postgresql-client-common (238) ... 2024-04-01T01:54:30.922 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up flex (2.6.4-8build2) ... 2024-04-01T01:54:30.964 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up postgresql-client-common (238) ... 2024-04-01T01:54:31.023 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-01T01:54:31.166 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-01T01:54:31.173 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up flex (2.6.4-8build2) ... 2024-04-01T01:54:31.292 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-04-01T01:54:31.299 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-01T01:54:31.418 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-01T01:54:31.425 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-01T01:54:31.543 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-04-01T01:54:31.544 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-01T01:54:31.661 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-01T01:54:31.787 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-01T01:54:32.066 INFO:teuthology.orchestra.run.smithi097.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-04-01T01:54:32.150 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-01T01:54:32.324 INFO:teuthology.orchestra.run.smithi050.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-04-01T01:54:32.401 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-01T01:54:32.528 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-01T01:54:32.528 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-01T01:54:32.790 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-01T01:54:32.790 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-01T01:54:33.019 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.3) ... 2024-04-01T01:54:33.146 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-04-01T01:54:33.254 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.3) ... 2024-04-01T01:54:33.263 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-01T01:54:33.373 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-04-01T01:54:33.380 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-04-01T01:54:33.482 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-04-01T01:54:33.506 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-01T01:54:33.608 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-04-01T01:54:33.632 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-04-01T01:54:33.734 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-01T01:54:33.860 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-04-01T01:54:34.109 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-04-01T01:54:34.218 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-04-01T01:54:34.319 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-01T01:54:34.437 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-04-01T01:54:34.465 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-01T01:54:34.592 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up dump (0.4b47-3) ... 2024-04-01T01:54:34.739 INFO:teuthology.orchestra.run.smithi097.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-04-01T01:54:34.818 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-01T01:54:34.944 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-01T01:54:35.070 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up tcl (8.6.11+1build2) ... 2024-04-01T01:54:35.084 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-01T01:54:35.195 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up dump (0.4b47-3) ... 2024-04-01T01:54:35.204 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libjson-perl (4.04000-1) ... 2024-04-01T01:54:35.306 INFO:teuthology.orchestra.run.smithi050.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-04-01T01:54:35.314 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-04-01T01:54:35.372 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-01T01:54:35.387 INFO:teuthology.orchestra.run.smithi097.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-04-01T01:54:35.457 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-01T01:54:35.498 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-01T01:54:35.583 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-01T01:54:35.624 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up tcl (8.6.11+1build2) ... 2024-04-01T01:54:35.750 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libjson-perl (4.04000-1) ... 2024-04-01T01:54:35.760 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-01T01:54:35.869 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-01T01:54:35.876 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-04-01T01:54:35.958 INFO:teuthology.orchestra.run.smithi050.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-04-01T01:54:35.970 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-04-01T01:54:36.019 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-01T01:54:36.120 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-01T01:54:36.129 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up postgresql-client (14+238) ... 2024-04-01T01:54:36.256 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-04-01T01:54:36.296 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-01T01:54:36.423 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-01T01:54:36.548 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-04-01T01:54:36.716 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up postgresql-client (14+238) ... 2024-04-01T01:54:36.754 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-04-01T01:54:36.754 INFO:teuthology.orchestra.run.smithi097.stdout:The following network interfaces were found in /etc/network/interfaces 2024-04-01T01:54:36.755 INFO:teuthology.orchestra.run.smithi097.stdout:which means they are currently configured by ifupdown: 2024-04-01T01:54:36.755 INFO:teuthology.orchestra.run.smithi097.stdout:- enp3s0f1 2024-04-01T01:54:36.755 INFO:teuthology.orchestra.run.smithi097.stdout:If you want to manage those interfaces with NetworkManager instead 2024-04-01T01:54:36.755 INFO:teuthology.orchestra.run.smithi097.stdout:remove their configuration from /etc/network/interfaces. 2024-04-01T01:54:36.755 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-04-01T01:54:36.842 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-04-01T01:54:36.887 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-04-01T01:54:37.214 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-04-01T01:54:37.275 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-01T01:54:37.276 INFO:teuthology.orchestra.run.smithi050.stdout:The following network interfaces were found in /etc/network/interfaces 2024-04-01T01:54:37.276 INFO:teuthology.orchestra.run.smithi050.stdout:which means they are currently configured by ifupdown: 2024-04-01T01:54:37.276 INFO:teuthology.orchestra.run.smithi050.stdout:- ens1f0 2024-04-01T01:54:37.276 INFO:teuthology.orchestra.run.smithi050.stdout:If you want to manage those interfaces with NetworkManager instead 2024-04-01T01:54:37.276 INFO:teuthology.orchestra.run.smithi050.stdout:remove their configuration from /etc/network/interfaces. 2024-04-01T01:54:37.276 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-01T01:54:37.400 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-04-01T01:54:37.537 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-04-01T01:54:37.732 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-04-01T01:54:38.050 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-01T01:54:38.063 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-04-01T01:54:38.202 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-01T01:54:38.328 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-04-01T01:54:38.454 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up postgresql-common (238) ... 2024-04-01T01:54:38.590 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-01T01:54:38.738 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-01T01:54:38.864 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-04-01T01:54:38.990 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up postgresql-common (238) ... 2024-04-01T01:54:39.309 INFO:teuthology.orchestra.run.smithi097.stdout:Adding user postgres to group ssl-cert 2024-04-01T01:54:39.528 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-04-01T01:54:39.528 INFO:teuthology.orchestra.run.smithi097.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-04-01T01:54:39.711 INFO:teuthology.orchestra.run.smithi097.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-04-01T01:54:39.711 INFO:teuthology.orchestra.run.smithi097.stdout:Removing obsolete dictionary files: 2024-04-01T01:54:39.900 INFO:teuthology.orchestra.run.smithi050.stdout:Adding user postgres to group ssl-cert 2024-04-01T01:54:40.139 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-01T01:54:40.140 INFO:teuthology.orchestra.run.smithi050.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-04-01T01:54:40.266 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-04-01T01:54:40.359 INFO:teuthology.orchestra.run.smithi050.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-04-01T01:54:40.359 INFO:teuthology.orchestra.run.smithi050.stdout:Removing obsolete dictionary files: 2024-04-01T01:54:40.639 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-01T01:54:40.936 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-04-01T01:54:40.952 INFO:teuthology.orchestra.run.smithi097.stdout:Creating new PostgreSQL cluster 14/main ... 2024-04-01T01:54:40.968 INFO:teuthology.orchestra.run.smithi097.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-04-01T01:54:41.012 INFO:teuthology.orchestra.run.smithi097.stdout:The files belonging to this database system will be owned by user "postgres". 2024-04-01T01:54:41.013 INFO:teuthology.orchestra.run.smithi097.stdout:This user must also own the server process. 2024-04-01T01:54:41.013 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-04-01T01:54:41.013 INFO:teuthology.orchestra.run.smithi097.stdout:The database cluster will be initialized with locale "en_US". 2024-04-01T01:54:41.013 INFO:teuthology.orchestra.run.smithi097.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-04-01T01:54:41.013 INFO:teuthology.orchestra.run.smithi097.stdout:The default text search configuration will be set to "english". 2024-04-01T01:54:41.013 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-04-01T01:54:41.013 INFO:teuthology.orchestra.run.smithi097.stdout:Data page checksums are disabled. 2024-04-01T01:54:41.014 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-04-01T01:54:41.014 INFO:teuthology.orchestra.run.smithi097.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-04-01T01:54:41.014 INFO:teuthology.orchestra.run.smithi097.stdout:creating subdirectories ... ok 2024-04-01T01:54:41.014 INFO:teuthology.orchestra.run.smithi097.stdout:selecting dynamic shared memory implementation ... posix 2024-04-01T01:54:41.028 INFO:teuthology.orchestra.run.smithi097.stdout:selecting default max_connections ... 100 2024-04-01T01:54:41.047 INFO:teuthology.orchestra.run.smithi097.stdout:selecting default shared_buffers ... 128MB 2024-04-01T01:54:41.057 INFO:teuthology.orchestra.run.smithi097.stdout:selecting default time zone ... Etc/UTC 2024-04-01T01:54:41.058 INFO:teuthology.orchestra.run.smithi097.stdout:creating configuration files ... ok 2024-04-01T01:54:41.172 INFO:teuthology.orchestra.run.smithi097.stdout:running bootstrap script ... ok 2024-04-01T01:54:41.333 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-01T01:54:41.670 INFO:teuthology.orchestra.run.smithi050.stdout:Creating new PostgreSQL cluster 14/main ... 2024-04-01T01:54:41.689 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-04-01T01:54:41.729 INFO:teuthology.orchestra.run.smithi050.stdout:The files belonging to this database system will be owned by user "postgres". 2024-04-01T01:54:41.729 INFO:teuthology.orchestra.run.smithi050.stdout:This user must also own the server process. 2024-04-01T01:54:41.729 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-01T01:54:41.729 INFO:teuthology.orchestra.run.smithi050.stdout:The database cluster will be initialized with locale "en_US". 2024-04-01T01:54:41.729 INFO:teuthology.orchestra.run.smithi050.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-04-01T01:54:41.729 INFO:teuthology.orchestra.run.smithi050.stdout:The default text search configuration will be set to "english". 2024-04-01T01:54:41.729 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-01T01:54:41.729 INFO:teuthology.orchestra.run.smithi050.stdout:Data page checksums are disabled. 2024-04-01T01:54:41.730 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-01T01:54:41.730 INFO:teuthology.orchestra.run.smithi050.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-04-01T01:54:41.730 INFO:teuthology.orchestra.run.smithi050.stdout:creating subdirectories ... ok 2024-04-01T01:54:41.730 INFO:teuthology.orchestra.run.smithi050.stdout:selecting dynamic shared memory implementation ... posix 2024-04-01T01:54:41.741 INFO:teuthology.orchestra.run.smithi050.stdout:selecting default max_connections ... 100 2024-04-01T01:54:41.764 INFO:teuthology.orchestra.run.smithi050.stdout:selecting default shared_buffers ... 128MB 2024-04-01T01:54:41.775 INFO:teuthology.orchestra.run.smithi050.stdout:selecting default time zone ... Etc/UTC 2024-04-01T01:54:41.776 INFO:teuthology.orchestra.run.smithi050.stdout:creating configuration files ... ok 2024-04-01T01:54:41.793 INFO:teuthology.orchestra.run.smithi097.stdout:performing post-bootstrap initialization ... ok 2024-04-01T01:54:41.890 INFO:teuthology.orchestra.run.smithi050.stdout:running bootstrap script ... ok 2024-04-01T01:54:42.535 INFO:teuthology.orchestra.run.smithi097.stdout:syncing data to disk ... ok 2024-04-01T01:54:42.578 INFO:teuthology.orchestra.run.smithi050.stdout:performing post-bootstrap initialization ... ok 2024-04-01T01:54:42.912 INFO:teuthology.orchestra.run.smithi097.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-04-01T01:54:43.202 INFO:teuthology.orchestra.run.smithi050.stdout:syncing data to disk ... ok 2024-04-01T01:54:43.597 INFO:teuthology.orchestra.run.smithi050.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-04-01T01:54:45.755 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-01T01:54:45.881 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up postgresql-contrib (14+238) ... 2024-04-01T01:54:46.007 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up postgresql (14+238) ... 2024-04-01T01:54:46.133 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-01T01:54:46.259 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-01T01:54:46.373 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-01T01:54:46.499 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up postgresql-contrib (14+238) ... 2024-04-01T01:54:46.521 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-04-01T01:54:46.521 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-04-01T01:54:46.608 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up postgresql (14+238) ... 2024-04-01T01:54:46.709 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-01T01:54:46.835 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-01T01:54:47.070 INFO:teuthology.orchestra.run.smithi097.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-01T01:54:47.099 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-04-01T01:54:47.099 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-04-01T01:54:47.162 INFO:teuthology.orchestra.run.smithi097.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-04-01T01:54:47.423 INFO:teuthology.orchestra.run.smithi097.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-01T01:54:47.584 INFO:teuthology.orchestra.run.smithi097.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-01T01:54:47.680 INFO:teuthology.orchestra.run.smithi050.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-01T01:54:47.780 INFO:teuthology.orchestra.run.smithi050.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-04-01T01:54:48.074 INFO:teuthology.orchestra.run.smithi050.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-01T01:54:48.226 INFO:teuthology.orchestra.run.smithi050.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-01T01:54:48.920 INFO:teuthology.orchestra.run.smithi097.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-04-01T01:54:49.020 INFO:teuthology.orchestra.run.smithi097.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-01T01:54:49.512 INFO:teuthology.orchestra.run.smithi097.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-01T01:54:49.518 DEBUG:teuthology.parallel:result is None 2024-04-01T01:54:49.637 INFO:teuthology.orchestra.run.smithi050.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-04-01T01:54:49.720 INFO:teuthology.orchestra.run.smithi050.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-01T01:54:50.218 INFO:teuthology.orchestra.run.smithi050.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-01T01:54:50.222 DEBUG:teuthology.parallel:result is None 2024-04-01T01:54:50.223 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=384f31f3d3aee7f8ba3f60846b8844c049165583 2024-04-01T01:54:50.368 DEBUG:teuthology.orchestra.run.smithi050:> dpkg-query -W -f '${Version}' ceph 2024-04-01T01:54:50.388 INFO:teuthology.orchestra.run.smithi050.stdout:19.0.0-1977-g384f31f3-1jammy 2024-04-01T01:54:50.388 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1977-g384f31f3-1jammy 2024-04-01T01:54:50.389 INFO:teuthology.task.install:The correct ceph version 19.0.0-1977-g384f31f3-1jammy is installed. 2024-04-01T01:54:50.390 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=384f31f3d3aee7f8ba3f60846b8844c049165583 2024-04-01T01:54:50.610 DEBUG:teuthology.orchestra.run.smithi097:> dpkg-query -W -f '${Version}' ceph 2024-04-01T01:54:50.629 INFO:teuthology.orchestra.run.smithi097.stdout:19.0.0-1977-g384f31f3-1jammy 2024-04-01T01:54:50.630 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1977-g384f31f3-1jammy 2024-04-01T01:54:50.630 INFO:teuthology.task.install:The correct ceph version 19.0.0-1977-g384f31f3-1jammy is installed. 2024-04-01T01:54:50.632 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-01T01:54:50.632 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-04-01T01:54:50.632 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-01T01:54:50.647 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-04-01T01:54:50.647 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-01T01:54:50.684 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-01T01:54:50.685 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-04-01T01:54:50.685 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/usr/bin/daemon-helper 2024-04-01T01:54:50.702 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-01T01:54:50.758 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-04-01T01:54:50.758 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/usr/bin/daemon-helper 2024-04-01T01:54:50.772 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-01T01:54:50.827 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-01T01:54:50.827 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-04-01T01:54:50.827 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-01T01:54:50.841 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-01T01:54:50.898 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-04-01T01:54:50.898 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-01T01:54:50.911 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-01T01:54:50.963 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-01T01:54:50.964 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-04-01T01:54:50.964 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/usr/bin/stdin-killer 2024-04-01T01:54:50.978 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-01T01:54:51.035 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-04-01T01:54:51.035 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/usr/bin/stdin-killer 2024-04-01T01:54:51.048 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-01T01:54:51.103 INFO:teuthology.run_tasks:Running task ceph... 2024-04-01T01:54:51.189 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-01T01:54:51.189 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 777 /var/log/ceph 2024-04-01T01:54:51.191 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod 777 /var/log/ceph 2024-04-01T01:54:51.203 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-01T01:54:51.204 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-01T01:54:51.251 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-01T01:54:51.263 INFO:tasks.ceph:Creating extra log directories... 2024-04-01T01:54:51.263 DEBUG:teuthology.orchestra.run.smithi050:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-01T01:54:51.308 DEBUG:teuthology.orchestra.run.smithi097:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-01T01:54:51.333 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-04-01T01:54:51.334 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-04-01T01:54:51.334 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-04-01T01:54:51.334 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-04-01T01:54:51.335 DEBUG:teuthology.orchestra.run.smithi050:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-01T01:54:51.367 DEBUG:teuthology.orchestra.run.smithi050:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-01T01:54:51.443 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-04-01T01:54:51.443 DEBUG:teuthology.orchestra.run.smithi097:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-01T01:54:51.449 DEBUG:teuthology.orchestra.run.smithi097:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-01T01:54:51.531 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-01T01:54:51.532 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'lockdep': True}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-01T01:54:51.532 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-03-31_21:24:02-fs-squid-distro-default-smithi/7633248', 'branch': 'squid', 'description': 'fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu/{overrides ubuntu_latest}} mount/fuse objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/1 tasks/dbench validater/lockdep}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7633248', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'teuthology-2024-03-31_21:24:02-fs-squid-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'squid'}, 'ceph': {'cephfs': {'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'lockdep': True}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '384f31f3d3aee7f8ba3f60846b8844c049165583', 'valgrind': {'exit_on_first_error': False}}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '384f31f3d3aee7f8ba3f60846b8844c049165583'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': '384f31f3d3aee7f8ba3f60846b8844c049165583'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 8238, 'sha1': '384f31f3d3aee7f8ba3f60846b8844c049165583', 'sleep_before_teardown': 0, 'subset': '361/512', 'suite': 'fs', 'suite_branch': 'squid', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_384f31f3d3aee7f8ba3f60846b8844c049165583/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': '384f31f3d3aee7f8ba3f60846b8844c049165583', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi050.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIaIIMFIyz/Ym4ph/Q4OtlkmlRL7pbJF7YwUBjImiShD3B4vun9tltsG3mXt4pnng1dlVm8JKT7VtrxGKASVLH4=', 'smithi097.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPVwbYRyhjH4QnGesHGUZYOKzTOLyLuMi+GEeyKY0Kc2YplZEwScTcl3SRxWbgK3ftkTwsgEMG2VnWK1dks9f0I='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '384f31f3d3aee7f8ba3f60846b8844c049165583'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'lockdep': True}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '384f31f3d3aee7f8ba3f60846b8844c049165583', 'valgrind': {'exit_on_first_error': False}, 'cluster': 'ceph'}}, {'ceph-fuse': None}, {'workunit': {'clients': {'all': ['suites/dbench.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': 'e691533f9cbb33d85b2187bba20d7102f098636d', 'timestamp': '2024-03-31_21:24:02', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-01T01:54:51.532 DEBUG:teuthology.orchestra.run.smithi050:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-01T01:54:51.535 DEBUG:teuthology.orchestra.run.smithi097:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-01T01:54:51.573 DEBUG:teuthology.orchestra.run.smithi050:> sudo install -d -m0777 -- /var/run/ceph 2024-04-01T01:54:51.583 DEBUG:teuthology.orchestra.run.smithi097:> sudo install -d -m0777 -- /var/run/ceph 2024-04-01T01:54:51.629 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-04-01T01:54:51.629 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/scratch_devs of=/dev/stdout 2024-04-01T01:54:51.642 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-01T01:54:51.643 DEBUG:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_1 2024-04-01T01:54:51.691 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-01T01:54:51.691 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-01T01:54:51.691 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 5h/5d Inode: 878 Links: 1 2024-04-01T01:54:51.691 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-01T01:54:51.691 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2024-04-01 01:48:42.216376646 +0000 2024-04-01T01:54:51.691 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2024-04-01 01:48:42.212376683 +0000 2024-04-01T01:54:51.691 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2024-04-01 01:48:42.212376683 +0000 2024-04-01T01:54:51.691 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: - 2024-04-01T01:54:51.691 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-01T01:54:51.749 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-04-01T01:54:51.749 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-04-01T01:54:51.749 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 0.000318638 s, 1.6 MB/s 2024-04-01T01:54:51.750 DEBUG:teuthology.orchestra.run.smithi050:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-01T01:54:51.800 DEBUG:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_2 2024-04-01T01:54:51.847 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-01T01:54:51.847 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-01T01:54:51.847 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 5h/5d Inode: 890 Links: 1 2024-04-01T01:54:51.847 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-01T01:54:51.847 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2024-04-01 01:48:42.948370108 +0000 2024-04-01T01:54:51.847 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2024-04-01 01:48:42.704372288 +0000 2024-04-01T01:54:51.847 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2024-04-01 01:48:42.704372288 +0000 2024-04-01T01:54:51.847 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: - 2024-04-01T01:54:51.848 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-01T01:54:51.901 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-04-01T01:54:51.901 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-04-01T01:54:51.901 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 0.000320538 s, 1.6 MB/s 2024-04-01T01:54:51.902 DEBUG:teuthology.orchestra.run.smithi050:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-01T01:54:51.952 DEBUG:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_3 2024-04-01T01:54:51.998 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-01T01:54:51.998 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-01T01:54:51.999 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 5h/5d Inode: 912 Links: 1 2024-04-01T01:54:51.999 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-01T01:54:51.999 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2024-04-01 01:48:43.492365250 +0000 2024-04-01T01:54:51.999 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2024-04-01 01:48:43.200367858 +0000 2024-04-01T01:54:51.999 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2024-04-01 01:48:43.200367858 +0000 2024-04-01T01:54:51.999 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: - 2024-04-01T01:54:51.999 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-01T01:54:52.053 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-04-01T01:54:52.053 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-04-01T01:54:52.053 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 0.000308441 s, 1.7 MB/s 2024-04-01T01:54:52.054 DEBUG:teuthology.orchestra.run.smithi050:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-01T01:54:52.104 DEBUG:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_4 2024-04-01T01:54:52.150 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-01T01:54:52.150 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-01T01:54:52.150 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 5h/5d Inode: 931 Links: 1 2024-04-01T01:54:52.151 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-01T01:54:52.151 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2024-04-01 01:48:44.012360604 +0000 2024-04-01T01:54:52.151 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2024-04-01 01:48:43.724363177 +0000 2024-04-01T01:54:52.151 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2024-04-01 01:48:43.724363177 +0000 2024-04-01T01:54:52.151 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: - 2024-04-01T01:54:52.151 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-01T01:54:52.205 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-04-01T01:54:52.205 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-04-01T01:54:52.205 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 0.000314528 s, 1.6 MB/s 2024-04-01T01:54:52.207 DEBUG:teuthology.orchestra.run.smithi050:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-01T01:54:52.256 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-01T01:54:52.256 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-04-01T01:54:52.256 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/scratch_devs of=/dev/stdout 2024-04-01T01:54:52.262 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-01T01:54:52.263 DEBUG:teuthology.orchestra.run.smithi097:> stat /dev/vg_nvme/lv_1 2024-04-01T01:54:52.309 INFO:teuthology.orchestra.run.smithi097.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-01T01:54:52.309 INFO:teuthology.orchestra.run.smithi097.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-01T01:54:52.309 INFO:teuthology.orchestra.run.smithi097.stdout:Device: 5h/5d Inode: 889 Links: 1 2024-04-01T01:54:52.309 INFO:teuthology.orchestra.run.smithi097.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-01T01:54:52.309 INFO:teuthology.orchestra.run.smithi097.stdout:Access: 2024-04-01 01:48:40.403485107 +0000 2024-04-01T01:54:52.309 INFO:teuthology.orchestra.run.smithi097.stdout:Modify: 2024-04-01 01:48:40.139487462 +0000 2024-04-01T01:54:52.309 INFO:teuthology.orchestra.run.smithi097.stdout:Change: 2024-04-01 01:48:40.139487462 +0000 2024-04-01T01:54:52.309 INFO:teuthology.orchestra.run.smithi097.stdout: Birth: - 2024-04-01T01:54:52.310 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-01T01:54:52.363 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records in 2024-04-01T01:54:52.363 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records out 2024-04-01T01:54:52.363 INFO:teuthology.orchestra.run.smithi097.stderr:512 bytes copied, 0.000381605 s, 1.3 MB/s 2024-04-01T01:54:52.365 DEBUG:teuthology.orchestra.run.smithi097:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-01T01:54:52.418 DEBUG:teuthology.orchestra.run.smithi097:> stat /dev/vg_nvme/lv_2 2024-04-01T01:54:52.465 INFO:teuthology.orchestra.run.smithi097.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-01T01:54:52.465 INFO:teuthology.orchestra.run.smithi097.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-01T01:54:52.465 INFO:teuthology.orchestra.run.smithi097.stdout:Device: 5h/5d Inode: 905 Links: 1 2024-04-01T01:54:52.465 INFO:teuthology.orchestra.run.smithi097.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-01T01:54:52.465 INFO:teuthology.orchestra.run.smithi097.stdout:Access: 2024-04-01 01:48:40.903480645 +0000 2024-04-01T01:54:52.465 INFO:teuthology.orchestra.run.smithi097.stdout:Modify: 2024-04-01 01:48:40.651482894 +0000 2024-04-01T01:54:52.465 INFO:teuthology.orchestra.run.smithi097.stdout:Change: 2024-04-01 01:48:40.651482894 +0000 2024-04-01T01:54:52.465 INFO:teuthology.orchestra.run.smithi097.stdout: Birth: - 2024-04-01T01:54:52.466 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-01T01:54:52.519 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records in 2024-04-01T01:54:52.519 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records out 2024-04-01T01:54:52.519 INFO:teuthology.orchestra.run.smithi097.stderr:512 bytes copied, 0.00031371 s, 1.6 MB/s 2024-04-01T01:54:52.520 DEBUG:teuthology.orchestra.run.smithi097:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-01T01:54:52.570 DEBUG:teuthology.orchestra.run.smithi097:> stat /dev/vg_nvme/lv_3 2024-04-01T01:54:52.617 INFO:teuthology.orchestra.run.smithi097.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-01T01:54:52.617 INFO:teuthology.orchestra.run.smithi097.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-01T01:54:52.617 INFO:teuthology.orchestra.run.smithi097.stdout:Device: 5h/5d Inode: 918 Links: 1 2024-04-01T01:54:52.617 INFO:teuthology.orchestra.run.smithi097.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-01T01:54:52.617 INFO:teuthology.orchestra.run.smithi097.stdout:Access: 2024-04-01 01:48:41.387476328 +0000 2024-04-01T01:54:52.617 INFO:teuthology.orchestra.run.smithi097.stdout:Modify: 2024-04-01 01:48:41.115478755 +0000 2024-04-01T01:54:52.617 INFO:teuthology.orchestra.run.smithi097.stdout:Change: 2024-04-01 01:48:41.115478755 +0000 2024-04-01T01:54:52.617 INFO:teuthology.orchestra.run.smithi097.stdout: Birth: - 2024-04-01T01:54:52.617 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-01T01:54:52.671 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records in 2024-04-01T01:54:52.671 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records out 2024-04-01T01:54:52.671 INFO:teuthology.orchestra.run.smithi097.stderr:512 bytes copied, 0.00035512 s, 1.4 MB/s 2024-04-01T01:54:52.673 DEBUG:teuthology.orchestra.run.smithi097:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-01T01:54:52.722 DEBUG:teuthology.orchestra.run.smithi097:> stat /dev/vg_nvme/lv_4 2024-04-01T01:54:52.772 INFO:teuthology.orchestra.run.smithi097.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-01T01:54:52.772 INFO:teuthology.orchestra.run.smithi097.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-01T01:54:52.772 INFO:teuthology.orchestra.run.smithi097.stdout:Device: 5h/5d Inode: 933 Links: 1 2024-04-01T01:54:52.772 INFO:teuthology.orchestra.run.smithi097.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-01T01:54:52.772 INFO:teuthology.orchestra.run.smithi097.stdout:Access: 2024-04-01 01:48:41.863472083 +0000 2024-04-01T01:54:52.772 INFO:teuthology.orchestra.run.smithi097.stdout:Modify: 2024-04-01 01:48:41.619474258 +0000 2024-04-01T01:54:52.773 INFO:teuthology.orchestra.run.smithi097.stdout:Change: 2024-04-01 01:48:41.619474258 +0000 2024-04-01T01:54:52.773 INFO:teuthology.orchestra.run.smithi097.stdout: Birth: - 2024-04-01T01:54:52.773 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-01T01:54:52.827 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records in 2024-04-01T01:54:52.827 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records out 2024-04-01T01:54:52.827 INFO:teuthology.orchestra.run.smithi097.stderr:512 bytes copied, 0.00031394 s, 1.6 MB/s 2024-04-01T01:54:52.828 DEBUG:teuthology.orchestra.run.smithi097:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-01T01:54:52.879 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-01T01:54:52.880 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi050.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi097.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-01T01:54:52.880 INFO:tasks.ceph:Generating config... 2024-04-01T01:54:52.881 INFO:tasks.ceph:[client] client mount timeout = 600 2024-04-01T01:54:52.881 INFO:tasks.ceph:[client] debug client = 20 2024-04-01T01:54:52.881 INFO:tasks.ceph:[client] debug ms = 1 2024-04-01T01:54:52.881 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-04-01T01:54:52.881 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-04-01T01:54:52.881 INFO:tasks.ceph:[global] lockdep = True 2024-04-01T01:54:52.881 INFO:tasks.ceph:[mds] debug mds = 20 2024-04-01T01:54:52.882 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-04-01T01:54:52.882 INFO:tasks.ceph:[mds] debug ms = 1 2024-04-01T01:54:52.882 INFO:tasks.ceph:[mds] mds debug frag = True 2024-04-01T01:54:52.882 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-04-01T01:54:52.882 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-04-01T01:54:52.882 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-04-01T01:54:52.882 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-04-01T01:54:52.882 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-04-01T01:54:52.882 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-04-01T01:54:52.882 INFO:tasks.ceph:[mgr] debug client = 20 2024-04-01T01:54:52.882 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-01T01:54:52.882 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-01T01:54:52.882 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-01T01:54:52.883 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-01T01:54:52.883 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-01T01:54:52.883 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-04-01T01:54:52.883 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-04-01T01:54:52.883 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-01T01:54:52.883 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2024-04-01T01:54:52.883 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-01T01:54:52.883 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-04-01T01:54:52.883 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-04-01T01:54:52.883 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-01T01:54:52.883 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-01T01:54:52.883 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-04-01T01:54:52.883 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-01T01:54:52.883 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-01T01:54:52.883 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-01T01:54:52.884 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-01T01:54:52.884 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-01T01:54:52.884 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-04-01T01:54:52.884 INFO:tasks.ceph:Setting up mon.a... 2024-04-01T01:54:52.884 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-01T01:54:52.920 INFO:teuthology.orchestra.run.smithi050.stdout:creating /etc/ceph/ceph.keyring 2024-04-01T01:54:52.960 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-01T01:54:53.038 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-01T01:54:53.094 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.50'), ('mon.b', '172.21.15.97'), ('mon.c', '[v2:172.21.15.97:3301,v1:172.21.15.97:6790]')] 2024-04-01T01:54:53.095 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.50,172.21.15.97,[v2:172.21.15.97:3301,v1:172.21.15.97:6790]', 'lockdep': True}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.e': {}, 'mds.b': {}, 'mds.d': {}, 'mds.f': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-04-01T01:54:53.095 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-04-01T01:54:53.096 DEBUG:teuthology.orchestra.run.smithi050:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-01T01:54:53.142 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.50 --add b 172.21.15.97 --addv c '[v2:172.21.15.97:3301,v1:172.21.15.97:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-01T01:54:53.228 INFO:teuthology.orchestra.run.smithi050.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-01T01:54:53.229 INFO:teuthology.orchestra.run.smithi050.stdout:monmaptool: generated fsid f67878a9-bc75-426b-962d-fa7bc2517f7d 2024-04-01T01:54:53.229 INFO:teuthology.orchestra.run.smithi050.stdout:setting min_mon_release = quincy 2024-04-01T01:54:53.229 INFO:teuthology.orchestra.run.smithi050.stdout:epoch 0 2024-04-01T01:54:53.229 INFO:teuthology.orchestra.run.smithi050.stdout:fsid f67878a9-bc75-426b-962d-fa7bc2517f7d 2024-04-01T01:54:53.229 INFO:teuthology.orchestra.run.smithi050.stdout:last_changed 2024-04-01T01:54:53.231973+0000 2024-04-01T01:54:53.229 INFO:teuthology.orchestra.run.smithi050.stdout:created 2024-04-01T01:54:53.231973+0000 2024-04-01T01:54:53.229 INFO:teuthology.orchestra.run.smithi050.stdout:min_mon_release 17 (quincy) 2024-04-01T01:54:53.229 INFO:teuthology.orchestra.run.smithi050.stdout:election_strategy: 1 2024-04-01T01:54:53.229 INFO:teuthology.orchestra.run.smithi050.stdout:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-04-01T01:54:53.229 INFO:teuthology.orchestra.run.smithi050.stdout:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-04-01T01:54:53.229 INFO:teuthology.orchestra.run.smithi050.stdout:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-04-01T01:54:53.230 INFO:teuthology.orchestra.run.smithi050.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-01T01:54:53.231 DEBUG:teuthology.orchestra.run.smithi050:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-01T01:54:53.279 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID f67878a9-bc75-426b-962d-fa7bc2517f7d... 2024-04-01T01:54:53.280 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-01T01:54:53.323 DEBUG:teuthology.orchestra.run.smithi097:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-01T01:54:53.352 INFO:teuthology.orchestra.run.smithi050.stdout:[global] 2024-04-01T01:54:53.353 INFO:teuthology.orchestra.run.smithi050.stdout: chdir = "" 2024-04-01T01:54:53.353 INFO:teuthology.orchestra.run.smithi050.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-01T01:54:53.353 INFO:teuthology.orchestra.run.smithi050.stdout: auth supported = cephx 2024-04-01T01:54:53.353 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-01T01:54:53.353 INFO:teuthology.orchestra.run.smithi050.stdout: filestore xattr use omap = true 2024-04-01T01:54:53.353 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-01T01:54:53.353 INFO:teuthology.orchestra.run.smithi050.stdout: mon clock drift allowed = 1.000 2024-04-01T01:54:53.353 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-01T01:54:53.353 INFO:teuthology.orchestra.run.smithi050.stdout: osd crush chooseleaf type = 0 2024-04-01T01:54:53.354 INFO:teuthology.orchestra.run.smithi050.stdout: auth debug = true 2024-04-01T01:54:53.354 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-01T01:54:53.354 INFO:teuthology.orchestra.run.smithi050.stdout: ms die on old message = true 2024-04-01T01:54:53.354 INFO:teuthology.orchestra.run.smithi050.stdout: ms die on bug = true 2024-04-01T01:54:53.354 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-01T01:54:53.354 INFO:teuthology.orchestra.run.smithi050.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-01T01:54:53.354 INFO:teuthology.orchestra.run.smithi050.stdout: mon pg warn max object skew = 0 2024-04-01T01:54:53.354 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-01T01:54:53.354 INFO:teuthology.orchestra.run.smithi050.stdout: # disable pg_autoscaler by default for new pools 2024-04-01T01:54:53.354 INFO:teuthology.orchestra.run.smithi050.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-01T01:54:53.354 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-01T01:54:53.354 INFO:teuthology.orchestra.run.smithi050.stdout: osd pool default size = 2 2024-04-01T01:54:53.354 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-01T01:54:53.355 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd allow primary affinity = true 2024-04-01T01:54:53.355 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd allow pg remap = true 2024-04-01T01:54:53.355 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on legacy crush tunables = false 2024-04-01T01:54:53.355 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on crush straw calc version zero = false 2024-04-01T01:54:53.355 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on no sortbitwise = false 2024-04-01T01:54:53.355 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on osd down out interval zero = false 2024-04-01T01:54:53.355 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on too few osds = false 2024-04-01T01:54:53.355 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-01T01:54:53.355 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-01T01:54:53.355 INFO:teuthology.orchestra.run.smithi050.stdout: mon_allow_pool_size_one = true 2024-04-01T01:54:53.355 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-01T01:54:53.355 INFO:teuthology.orchestra.run.smithi050.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-01T01:54:53.355 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-01T01:54:53.355 INFO:teuthology.orchestra.run.smithi050.stdout: osd default data pool replay window = 5 2024-04-01T01:54:53.355 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-01T01:54:53.356 INFO:teuthology.orchestra.run.smithi050.stdout: mon allow pool delete = true 2024-04-01T01:54:53.356 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-01T01:54:53.356 INFO:teuthology.orchestra.run.smithi050.stdout: mon cluster log file level = debug 2024-04-01T01:54:53.356 INFO:teuthology.orchestra.run.smithi050.stdout: debug asserts on shutdown = true 2024-04-01T01:54:53.356 INFO:teuthology.orchestra.run.smithi050.stdout: mon health detail to clog = false 2024-04-01T01:54:53.356 INFO:teuthology.orchestra.run.smithi050.stdout: mon host = "172.21.15.50,172.21.15.97,[v2:172.21.15.97:3301,v1:172.21.15.97:6790]" 2024-04-01T01:54:53.356 INFO:teuthology.orchestra.run.smithi050.stdout: lockdep = True 2024-04-01T01:54:53.356 INFO:teuthology.orchestra.run.smithi050.stdout: fsid = f67878a9-bc75-426b-962d-fa7bc2517f7d 2024-04-01T01:54:53.356 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-01T01:54:53.356 INFO:teuthology.orchestra.run.smithi050.stdout:[osd] 2024-04-01T01:54:53.356 INFO:teuthology.orchestra.run.smithi050.stdout: osd journal size = 100 2024-04-01T01:54:53.356 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-01T01:54:53.356 INFO:teuthology.orchestra.run.smithi050.stdout: osd scrub load threshold = 5.0 2024-04-01T01:54:53.357 INFO:teuthology.orchestra.run.smithi050.stdout: osd scrub max interval = 600 2024-04-01T01:54:53.357 INFO:teuthology.orchestra.run.smithi050.stdout: osd mclock profile = high_recovery_ops 2024-04-01T01:54:53.357 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-01T01:54:53.357 INFO:teuthology.orchestra.run.smithi050.stdout: osd recover clone overlap = true 2024-04-01T01:54:53.357 INFO:teuthology.orchestra.run.smithi050.stdout: osd recovery max chunk = 1048576 2024-04-01T01:54:53.357 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-01T01:54:53.357 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug shutdown = true 2024-04-01T01:54:53.357 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug op order = true 2024-04-01T01:54:53.357 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug verify stray on activate = true 2024-04-01T01:54:53.357 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug trim objects = true 2024-04-01T01:54:53.357 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-01T01:54:53.357 INFO:teuthology.orchestra.run.smithi050.stdout: osd open classes on start = true 2024-04-01T01:54:53.357 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug pg log writeout = true 2024-04-01T01:54:53.357 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-01T01:54:53.357 INFO:teuthology.orchestra.run.smithi050.stdout: osd deep scrub update digest min age = 30 2024-04-01T01:54:53.358 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-01T01:54:53.358 INFO:teuthology.orchestra.run.smithi050.stdout: osd map max advance = 10 2024-04-01T01:54:53.358 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-01T01:54:53.358 INFO:teuthology.orchestra.run.smithi050.stdout: journal zero on create = true 2024-04-01T01:54:53.358 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-01T01:54:53.358 INFO:teuthology.orchestra.run.smithi050.stdout: filestore ondisk finisher threads = 3 2024-04-01T01:54:53.358 INFO:teuthology.orchestra.run.smithi050.stdout: filestore apply finisher threads = 3 2024-04-01T01:54:53.358 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-01T01:54:53.358 INFO:teuthology.orchestra.run.smithi050.stdout: bdev debug aio = true 2024-04-01T01:54:53.358 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug misdirected ops = true 2024-04-01T01:54:53.358 INFO:teuthology.orchestra.run.smithi050.stdout: bluestore block size = 96636764160 2024-04-01T01:54:53.358 INFO:teuthology.orchestra.run.smithi050.stdout: bluestore compression mode = aggressive 2024-04-01T01:54:53.358 INFO:teuthology.orchestra.run.smithi050.stdout: bluestore fsck on mount = True 2024-04-01T01:54:53.359 INFO:teuthology.orchestra.run.smithi050.stdout: debug bluefs = 20 2024-04-01T01:54:53.359 INFO:teuthology.orchestra.run.smithi050.stdout: debug bluestore = 20 2024-04-01T01:54:53.359 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2024-04-01T01:54:53.359 INFO:teuthology.orchestra.run.smithi050.stdout: debug osd = 20 2024-04-01T01:54:53.359 INFO:teuthology.orchestra.run.smithi050.stdout: debug rocksdb = 10 2024-04-01T01:54:53.359 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd backfillfull_ratio = 0.85 2024-04-01T01:54:53.359 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd full ratio = 0.9 2024-04-01T01:54:53.359 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd nearfull ratio = 0.8 2024-04-01T01:54:53.359 INFO:teuthology.orchestra.run.smithi050.stdout: osd failsafe full ratio = 0.95 2024-04-01T01:54:53.359 INFO:teuthology.orchestra.run.smithi050.stdout: osd objectstore = bluestore 2024-04-01T01:54:53.359 INFO:teuthology.orchestra.run.smithi050.stdout: osd op complaint time = 180 2024-04-01T01:54:53.359 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-01T01:54:53.359 INFO:teuthology.orchestra.run.smithi050.stdout:[mgr] 2024-04-01T01:54:53.359 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2024-04-01T01:54:53.359 INFO:teuthology.orchestra.run.smithi050.stdout: debug mgr = 20 2024-04-01T01:54:53.360 INFO:teuthology.orchestra.run.smithi050.stdout: debug mon = 20 2024-04-01T01:54:53.360 INFO:teuthology.orchestra.run.smithi050.stdout: debug auth = 20 2024-04-01T01:54:53.360 INFO:teuthology.orchestra.run.smithi050.stdout: mon reweight min pgs per osd = 4 2024-04-01T01:54:53.360 INFO:teuthology.orchestra.run.smithi050.stdout: mon reweight min bytes per osd = 10 2024-04-01T01:54:53.360 INFO:teuthology.orchestra.run.smithi050.stdout: mgr/telemetry/nag = false 2024-04-01T01:54:53.360 INFO:teuthology.orchestra.run.smithi050.stdout: debug client = 20 2024-04-01T01:54:53.360 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-01T01:54:53.360 INFO:teuthology.orchestra.run.smithi050.stdout:[mon] 2024-04-01T01:54:53.360 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2024-04-01T01:54:53.360 INFO:teuthology.orchestra.run.smithi050.stdout: debug mon = 20 2024-04-01T01:54:53.360 INFO:teuthology.orchestra.run.smithi050.stdout: debug paxos = 20 2024-04-01T01:54:53.360 INFO:teuthology.orchestra.run.smithi050.stdout: debug auth = 20 2024-04-01T01:54:53.360 INFO:teuthology.orchestra.run.smithi050.stdout: mon data avail warn = 5 2024-04-01T01:54:53.360 INFO:teuthology.orchestra.run.smithi050.stdout: mon mgr mkfs grace = 240 2024-04-01T01:54:53.360 INFO:teuthology.orchestra.run.smithi050.stdout: mon reweight min pgs per osd = 4 2024-04-01T01:54:53.361 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd reporter subtree level = osd 2024-04-01T01:54:53.361 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd prime pg temp = true 2024-04-01T01:54:53.361 INFO:teuthology.orchestra.run.smithi050.stdout: mon reweight min bytes per osd = 10 2024-04-01T01:54:53.361 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-01T01:54:53.361 INFO:teuthology.orchestra.run.smithi050.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-01T01:54:53.361 INFO:teuthology.orchestra.run.smithi050.stdout: auth mon ticket ttl = 660 # 11m 2024-04-01T01:54:53.361 INFO:teuthology.orchestra.run.smithi050.stdout: auth service ticket ttl = 240 # 4m 2024-04-01T01:54:53.361 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-01T01:54:53.361 INFO:teuthology.orchestra.run.smithi050.stdout: # don't complain about insecure global_id in the test suite 2024-04-01T01:54:53.361 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-01T01:54:53.361 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-01T01:54:53.361 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-01T01:54:53.361 INFO:teuthology.orchestra.run.smithi050.stdout: # 1m isn't quite enough 2024-04-01T01:54:53.361 INFO:teuthology.orchestra.run.smithi050.stdout: mon_down_mkfs_grace = 2m 2024-04-01T01:54:53.361 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-01T01:54:53.362 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_filestore_osds = false 2024-04-01T01:54:53.362 INFO:teuthology.orchestra.run.smithi050.stdout: mon down mkfs grace = 300 2024-04-01T01:54:53.362 INFO:teuthology.orchestra.run.smithi050.stdout: mon op complaint time = 120 2024-04-01T01:54:53.362 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-01T01:54:53.362 INFO:teuthology.orchestra.run.smithi050.stdout:[client] 2024-04-01T01:54:53.362 INFO:teuthology.orchestra.run.smithi050.stdout: rgw cache enabled = true 2024-04-01T01:54:53.362 INFO:teuthology.orchestra.run.smithi050.stdout: rgw enable ops log = true 2024-04-01T01:54:53.362 INFO:teuthology.orchestra.run.smithi050.stdout: rgw enable usage log = true 2024-04-01T01:54:53.362 INFO:teuthology.orchestra.run.smithi050.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-01T01:54:53.362 INFO:teuthology.orchestra.run.smithi050.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-01T01:54:53.362 INFO:teuthology.orchestra.run.smithi050.stdout: client mount timeout = 600 2024-04-01T01:54:53.362 INFO:teuthology.orchestra.run.smithi050.stdout: debug client = 20 2024-04-01T01:54:53.362 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2024-04-01T01:54:53.362 INFO:teuthology.orchestra.run.smithi050.stdout: rados mon op timeout = 900 2024-04-01T01:54:53.363 INFO:teuthology.orchestra.run.smithi050.stdout: rados osd op timeout = 900 2024-04-01T01:54:53.363 INFO:teuthology.orchestra.run.smithi050.stdout:[mon.a] 2024-04-01T01:54:53.363 INFO:teuthology.orchestra.run.smithi050.stdout:[mon.b] 2024-04-01T01:54:53.363 INFO:teuthology.orchestra.run.smithi050.stdout:[mon.c] 2024-04-01T01:54:53.363 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.a] 2024-04-01T01:54:53.363 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.c] 2024-04-01T01:54:53.363 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.e] 2024-04-01T01:54:53.363 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.b] 2024-04-01T01:54:53.363 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.d] 2024-04-01T01:54:53.363 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.f] 2024-04-01T01:54:53.363 INFO:teuthology.orchestra.run.smithi050.stdout:[mds] 2024-04-01T01:54:53.363 INFO:teuthology.orchestra.run.smithi050.stdout: debug mds = 20 2024-04-01T01:54:53.363 INFO:teuthology.orchestra.run.smithi050.stdout: debug mds balancer = 20 2024-04-01T01:54:53.363 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2024-04-01T01:54:53.364 INFO:teuthology.orchestra.run.smithi050.stdout: mds debug frag = True 2024-04-01T01:54:53.364 INFO:teuthology.orchestra.run.smithi050.stdout: mds debug scatterstat = True 2024-04-01T01:54:53.364 INFO:teuthology.orchestra.run.smithi050.stdout: mds op complaint time = 180 2024-04-01T01:54:53.364 INFO:teuthology.orchestra.run.smithi050.stdout: mds verify scatter = True 2024-04-01T01:54:53.364 INFO:teuthology.orchestra.run.smithi050.stdout: osd op complaint time = 180 2024-04-01T01:54:53.364 INFO:teuthology.orchestra.run.smithi050.stdout: rados mon op timeout = 900 2024-04-01T01:54:53.364 INFO:teuthology.orchestra.run.smithi050.stdout: rados osd op timeout = 900 2024-04-01T01:54:53.365 INFO:teuthology.orchestra.run.smithi097.stdout:[global] 2024-04-01T01:54:53.365 INFO:teuthology.orchestra.run.smithi097.stdout: chdir = "" 2024-04-01T01:54:53.365 INFO:teuthology.orchestra.run.smithi097.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-01T01:54:53.366 INFO:teuthology.orchestra.run.smithi097.stdout: auth supported = cephx 2024-04-01T01:54:53.366 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-04-01T01:54:53.366 INFO:teuthology.orchestra.run.smithi097.stdout: filestore xattr use omap = true 2024-04-01T01:54:53.366 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-04-01T01:54:53.366 INFO:teuthology.orchestra.run.smithi097.stdout: mon clock drift allowed = 1.000 2024-04-01T01:54:53.366 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-04-01T01:54:53.366 INFO:teuthology.orchestra.run.smithi097.stdout: osd crush chooseleaf type = 0 2024-04-01T01:54:53.366 INFO:teuthology.orchestra.run.smithi097.stdout: auth debug = true 2024-04-01T01:54:53.366 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-04-01T01:54:53.366 INFO:teuthology.orchestra.run.smithi097.stdout: ms die on old message = true 2024-04-01T01:54:53.366 INFO:teuthology.orchestra.run.smithi097.stdout: ms die on bug = true 2024-04-01T01:54:53.366 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-04-01T01:54:53.366 INFO:teuthology.orchestra.run.smithi097.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-01T01:54:53.366 INFO:teuthology.orchestra.run.smithi097.stdout: mon pg warn max object skew = 0 2024-04-01T01:54:53.367 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-04-01T01:54:53.367 INFO:teuthology.orchestra.run.smithi097.stdout: # disable pg_autoscaler by default for new pools 2024-04-01T01:54:53.367 INFO:teuthology.orchestra.run.smithi097.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-01T01:54:53.367 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-04-01T01:54:53.367 INFO:teuthology.orchestra.run.smithi097.stdout: osd pool default size = 2 2024-04-01T01:54:53.367 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-04-01T01:54:53.367 INFO:teuthology.orchestra.run.smithi097.stdout: mon osd allow primary affinity = true 2024-04-01T01:54:53.367 INFO:teuthology.orchestra.run.smithi097.stdout: mon osd allow pg remap = true 2024-04-01T01:54:53.367 INFO:teuthology.orchestra.run.smithi097.stdout: mon warn on legacy crush tunables = false 2024-04-01T01:54:53.367 INFO:teuthology.orchestra.run.smithi097.stdout: mon warn on crush straw calc version zero = false 2024-04-01T01:54:53.367 INFO:teuthology.orchestra.run.smithi097.stdout: mon warn on no sortbitwise = false 2024-04-01T01:54:53.367 INFO:teuthology.orchestra.run.smithi097.stdout: mon warn on osd down out interval zero = false 2024-04-01T01:54:53.367 INFO:teuthology.orchestra.run.smithi097.stdout: mon warn on too few osds = false 2024-04-01T01:54:53.367 INFO:teuthology.orchestra.run.smithi097.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-01T01:54:53.368 INFO:teuthology.orchestra.run.smithi097.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-01T01:54:53.368 INFO:teuthology.orchestra.run.smithi097.stdout: mon_allow_pool_size_one = true 2024-04-01T01:54:53.368 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-04-01T01:54:53.368 INFO:teuthology.orchestra.run.smithi097.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-01T01:54:53.368 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-04-01T01:54:53.368 INFO:teuthology.orchestra.run.smithi097.stdout: osd default data pool replay window = 5 2024-04-01T01:54:53.368 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-04-01T01:54:53.368 INFO:teuthology.orchestra.run.smithi097.stdout: mon allow pool delete = true 2024-04-01T01:54:53.368 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-04-01T01:54:53.368 INFO:teuthology.orchestra.run.smithi097.stdout: mon cluster log file level = debug 2024-04-01T01:54:53.369 INFO:teuthology.orchestra.run.smithi097.stdout: debug asserts on shutdown = true 2024-04-01T01:54:53.369 INFO:teuthology.orchestra.run.smithi097.stdout: mon health detail to clog = false 2024-04-01T01:54:53.369 INFO:teuthology.orchestra.run.smithi097.stdout: mon host = "172.21.15.50,172.21.15.97,[v2:172.21.15.97:3301,v1:172.21.15.97:6790]" 2024-04-01T01:54:53.369 INFO:teuthology.orchestra.run.smithi097.stdout: lockdep = True 2024-04-01T01:54:53.369 INFO:teuthology.orchestra.run.smithi097.stdout: fsid = f67878a9-bc75-426b-962d-fa7bc2517f7d 2024-04-01T01:54:53.369 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-04-01T01:54:53.369 INFO:teuthology.orchestra.run.smithi097.stdout:[osd] 2024-04-01T01:54:53.369 INFO:teuthology.orchestra.run.smithi097.stdout: osd journal size = 100 2024-04-01T01:54:53.369 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-04-01T01:54:53.369 INFO:teuthology.orchestra.run.smithi097.stdout: osd scrub load threshold = 5.0 2024-04-01T01:54:53.369 INFO:teuthology.orchestra.run.smithi097.stdout: osd scrub max interval = 600 2024-04-01T01:54:53.369 INFO:teuthology.orchestra.run.smithi097.stdout: osd mclock profile = high_recovery_ops 2024-04-01T01:54:53.369 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-04-01T01:54:53.370 INFO:teuthology.orchestra.run.smithi097.stdout: osd recover clone overlap = true 2024-04-01T01:54:53.370 INFO:teuthology.orchestra.run.smithi097.stdout: osd recovery max chunk = 1048576 2024-04-01T01:54:53.370 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-04-01T01:54:53.370 INFO:teuthology.orchestra.run.smithi097.stdout: osd debug shutdown = true 2024-04-01T01:54:53.370 INFO:teuthology.orchestra.run.smithi097.stdout: osd debug op order = true 2024-04-01T01:54:53.370 INFO:teuthology.orchestra.run.smithi097.stdout: osd debug verify stray on activate = true 2024-04-01T01:54:53.370 INFO:teuthology.orchestra.run.smithi097.stdout: osd debug trim objects = true 2024-04-01T01:54:53.370 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-04-01T01:54:53.370 INFO:teuthology.orchestra.run.smithi097.stdout: osd open classes on start = true 2024-04-01T01:54:53.370 INFO:teuthology.orchestra.run.smithi097.stdout: osd debug pg log writeout = true 2024-04-01T01:54:53.370 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-04-01T01:54:53.370 INFO:teuthology.orchestra.run.smithi097.stdout: osd deep scrub update digest min age = 30 2024-04-01T01:54:53.370 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-04-01T01:54:53.371 INFO:teuthology.orchestra.run.smithi097.stdout: osd map max advance = 10 2024-04-01T01:54:53.371 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-04-01T01:54:53.371 INFO:teuthology.orchestra.run.smithi097.stdout: journal zero on create = true 2024-04-01T01:54:53.371 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-04-01T01:54:53.371 INFO:teuthology.orchestra.run.smithi097.stdout: filestore ondisk finisher threads = 3 2024-04-01T01:54:53.371 INFO:teuthology.orchestra.run.smithi097.stdout: filestore apply finisher threads = 3 2024-04-01T01:54:53.371 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-04-01T01:54:53.371 INFO:teuthology.orchestra.run.smithi097.stdout: bdev debug aio = true 2024-04-01T01:54:53.371 INFO:teuthology.orchestra.run.smithi097.stdout: osd debug misdirected ops = true 2024-04-01T01:54:53.371 INFO:teuthology.orchestra.run.smithi097.stdout: bluestore block size = 96636764160 2024-04-01T01:54:53.371 INFO:teuthology.orchestra.run.smithi097.stdout: bluestore compression mode = aggressive 2024-04-01T01:54:53.371 INFO:teuthology.orchestra.run.smithi097.stdout: bluestore fsck on mount = True 2024-04-01T01:54:53.371 INFO:teuthology.orchestra.run.smithi097.stdout: debug bluefs = 20 2024-04-01T01:54:53.371 INFO:teuthology.orchestra.run.smithi097.stdout: debug bluestore = 20 2024-04-01T01:54:53.371 INFO:teuthology.orchestra.run.smithi097.stdout: debug ms = 1 2024-04-01T01:54:53.372 INFO:teuthology.orchestra.run.smithi097.stdout: debug osd = 20 2024-04-01T01:54:53.372 INFO:teuthology.orchestra.run.smithi097.stdout: debug rocksdb = 10 2024-04-01T01:54:53.372 INFO:teuthology.orchestra.run.smithi097.stdout: mon osd backfillfull_ratio = 0.85 2024-04-01T01:54:53.372 INFO:teuthology.orchestra.run.smithi097.stdout: mon osd full ratio = 0.9 2024-04-01T01:54:53.372 INFO:teuthology.orchestra.run.smithi097.stdout: mon osd nearfull ratio = 0.8 2024-04-01T01:54:53.372 INFO:teuthology.orchestra.run.smithi097.stdout: osd failsafe full ratio = 0.95 2024-04-01T01:54:53.372 INFO:teuthology.orchestra.run.smithi097.stdout: osd objectstore = bluestore 2024-04-01T01:54:53.372 INFO:teuthology.orchestra.run.smithi097.stdout: osd op complaint time = 180 2024-04-01T01:54:53.372 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-04-01T01:54:53.372 INFO:teuthology.orchestra.run.smithi097.stdout:[mgr] 2024-04-01T01:54:53.372 INFO:teuthology.orchestra.run.smithi097.stdout: debug ms = 1 2024-04-01T01:54:53.372 INFO:teuthology.orchestra.run.smithi097.stdout: debug mgr = 20 2024-04-01T01:54:53.372 INFO:teuthology.orchestra.run.smithi097.stdout: debug mon = 20 2024-04-01T01:54:53.372 INFO:teuthology.orchestra.run.smithi097.stdout: debug auth = 20 2024-04-01T01:54:53.372 INFO:teuthology.orchestra.run.smithi097.stdout: mon reweight min pgs per osd = 4 2024-04-01T01:54:53.372 INFO:teuthology.orchestra.run.smithi097.stdout: mon reweight min bytes per osd = 10 2024-04-01T01:54:53.373 INFO:teuthology.orchestra.run.smithi097.stdout: mgr/telemetry/nag = false 2024-04-01T01:54:53.373 INFO:teuthology.orchestra.run.smithi097.stdout: debug client = 20 2024-04-01T01:54:53.373 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-04-01T01:54:53.373 INFO:teuthology.orchestra.run.smithi097.stdout:[mon] 2024-04-01T01:54:53.373 INFO:teuthology.orchestra.run.smithi097.stdout: debug ms = 1 2024-04-01T01:54:53.373 INFO:teuthology.orchestra.run.smithi097.stdout: debug mon = 20 2024-04-01T01:54:53.373 INFO:teuthology.orchestra.run.smithi097.stdout: debug paxos = 20 2024-04-01T01:54:53.373 INFO:teuthology.orchestra.run.smithi097.stdout: debug auth = 20 2024-04-01T01:54:53.373 INFO:teuthology.orchestra.run.smithi097.stdout: mon data avail warn = 5 2024-04-01T01:54:53.373 INFO:teuthology.orchestra.run.smithi097.stdout: mon mgr mkfs grace = 240 2024-04-01T01:54:53.374 INFO:teuthology.orchestra.run.smithi097.stdout: mon reweight min pgs per osd = 4 2024-04-01T01:54:53.374 INFO:teuthology.orchestra.run.smithi097.stdout: mon osd reporter subtree level = osd 2024-04-01T01:54:53.374 INFO:teuthology.orchestra.run.smithi097.stdout: mon osd prime pg temp = true 2024-04-01T01:54:53.374 INFO:teuthology.orchestra.run.smithi097.stdout: mon reweight min bytes per osd = 10 2024-04-01T01:54:53.374 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-04-01T01:54:53.374 INFO:teuthology.orchestra.run.smithi097.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-01T01:54:53.374 INFO:teuthology.orchestra.run.smithi097.stdout: auth mon ticket ttl = 660 # 11m 2024-04-01T01:54:53.374 INFO:teuthology.orchestra.run.smithi097.stdout: auth service ticket ttl = 240 # 4m 2024-04-01T01:54:53.374 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-04-01T01:54:53.374 INFO:teuthology.orchestra.run.smithi097.stdout: # don't complain about insecure global_id in the test suite 2024-04-01T01:54:53.374 INFO:teuthology.orchestra.run.smithi097.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-01T01:54:53.374 INFO:teuthology.orchestra.run.smithi097.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-01T01:54:53.374 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-04-01T01:54:53.374 INFO:teuthology.orchestra.run.smithi097.stdout: # 1m isn't quite enough 2024-04-01T01:54:53.375 INFO:teuthology.orchestra.run.smithi097.stdout: mon_down_mkfs_grace = 2m 2024-04-01T01:54:53.375 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-04-01T01:54:53.375 INFO:teuthology.orchestra.run.smithi097.stdout: mon_warn_on_filestore_osds = false 2024-04-01T01:54:53.375 INFO:teuthology.orchestra.run.smithi097.stdout: mon down mkfs grace = 300 2024-04-01T01:54:53.375 INFO:teuthology.orchestra.run.smithi097.stdout: mon op complaint time = 120 2024-04-01T01:54:53.375 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-04-01T01:54:53.375 INFO:teuthology.orchestra.run.smithi097.stdout:[client] 2024-04-01T01:54:53.375 INFO:teuthology.orchestra.run.smithi097.stdout: rgw cache enabled = true 2024-04-01T01:54:53.375 INFO:teuthology.orchestra.run.smithi097.stdout: rgw enable ops log = true 2024-04-01T01:54:53.375 INFO:teuthology.orchestra.run.smithi097.stdout: rgw enable usage log = true 2024-04-01T01:54:53.375 INFO:teuthology.orchestra.run.smithi097.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-01T01:54:53.375 INFO:teuthology.orchestra.run.smithi097.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-01T01:54:53.375 INFO:teuthology.orchestra.run.smithi097.stdout: client mount timeout = 600 2024-04-01T01:54:53.375 INFO:teuthology.orchestra.run.smithi097.stdout: debug client = 20 2024-04-01T01:54:53.375 INFO:teuthology.orchestra.run.smithi097.stdout: debug ms = 1 2024-04-01T01:54:53.375 INFO:teuthology.orchestra.run.smithi097.stdout: rados mon op timeout = 900 2024-04-01T01:54:53.376 INFO:teuthology.orchestra.run.smithi097.stdout: rados osd op timeout = 900 2024-04-01T01:54:53.376 INFO:teuthology.orchestra.run.smithi097.stdout:[mon.a] 2024-04-01T01:54:53.376 INFO:teuthology.orchestra.run.smithi097.stdout:[mon.b] 2024-04-01T01:54:53.376 INFO:teuthology.orchestra.run.smithi097.stdout:[mon.c] 2024-04-01T01:54:53.376 INFO:teuthology.orchestra.run.smithi097.stdout:[mds.a] 2024-04-01T01:54:53.376 INFO:teuthology.orchestra.run.smithi097.stdout:[mds.c] 2024-04-01T01:54:53.376 INFO:teuthology.orchestra.run.smithi097.stdout:[mds.e] 2024-04-01T01:54:53.376 INFO:teuthology.orchestra.run.smithi097.stdout:[mds.b] 2024-04-01T01:54:53.376 INFO:teuthology.orchestra.run.smithi097.stdout:[mds.d] 2024-04-01T01:54:53.376 INFO:teuthology.orchestra.run.smithi097.stdout:[mds.f] 2024-04-01T01:54:53.376 INFO:teuthology.orchestra.run.smithi097.stdout:[mds] 2024-04-01T01:54:53.376 INFO:teuthology.orchestra.run.smithi097.stdout: debug mds = 20 2024-04-01T01:54:53.376 INFO:teuthology.orchestra.run.smithi097.stdout: debug mds balancer = 20 2024-04-01T01:54:53.376 INFO:teuthology.orchestra.run.smithi097.stdout: debug ms = 1 2024-04-01T01:54:53.376 INFO:teuthology.orchestra.run.smithi097.stdout: mds debug frag = True 2024-04-01T01:54:53.377 INFO:teuthology.orchestra.run.smithi097.stdout: mds debug scatterstat = True 2024-04-01T01:54:53.377 INFO:teuthology.orchestra.run.smithi097.stdout: mds op complaint time = 180 2024-04-01T01:54:53.377 INFO:teuthology.orchestra.run.smithi097.stdout: mds verify scatter = True 2024-04-01T01:54:53.377 INFO:teuthology.orchestra.run.smithi097.stdout: osd op complaint time = 180 2024-04-01T01:54:53.377 INFO:teuthology.orchestra.run.smithi097.stdout: rados mon op timeout = 900 2024-04-01T01:54:53.377 INFO:teuthology.orchestra.run.smithi097.stdout: rados osd op timeout = 900 2024-04-01T01:54:53.377 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-01T01:54:53.377 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-01T01:54:53.460 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-01T01:54:53.460 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-04-01T01:54:53.460 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-01T01:54:53.465 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-04-01T01:54:53.465 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-01T01:54:53.518 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi050.front.sepia.ceph.com 2024-04-01T01:54:53.518 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-04-01T01:54:53.518 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-01T01:54:53.518 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-01T01:54:53.584 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-04-01T01:54:53.584 DEBUG:teuthology.orchestra.run.smithi050:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-01T01:54:53.631 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi097.front.sepia.ceph.com 2024-04-01T01:54:53.631 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-04-01T01:54:53.631 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-01T01:54:53.631 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-01T01:54:53.655 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-04-01T01:54:53.655 DEBUG:teuthology.orchestra.run.smithi097:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-01T01:54:53.704 INFO:tasks.ceph:Setting up mon nodes... 2024-04-01T01:54:53.705 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-01T01:54:53.705 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-01T01:54:53.750 INFO:teuthology.orchestra.run.smithi050.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-01T01:54:53.753 DEBUG:teuthology.orchestra.run.smithi097:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-01T01:54:53.797 INFO:teuthology.orchestra.run.smithi097.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-01T01:54:53.805 INFO:tasks.ceph:Setting up mds nodes... 2024-04-01T01:54:53.806 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-01T01:54:53.848 INFO:teuthology.orchestra.run.smithi050.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-01T01:54:53.851 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-01T01:54:53.907 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-04-01T01:54:53.990 INFO:teuthology.orchestra.run.smithi050.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-04-01T01:54:53.993 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-04-01T01:54:54.050 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/mds/ceph-e && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.e /var/lib/ceph/mds/ceph-e/keyring 2024-04-01T01:54:54.135 INFO:teuthology.orchestra.run.smithi050.stdout:creating /var/lib/ceph/mds/ceph-e/keyring 2024-04-01T01:54:54.138 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-e 2024-04-01T01:54:54.194 DEBUG:teuthology.orchestra.run.smithi097:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-04-01T01:54:54.238 INFO:teuthology.orchestra.run.smithi097.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-04-01T01:54:54.241 DEBUG:teuthology.orchestra.run.smithi097:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-04-01T01:54:54.300 DEBUG:teuthology.orchestra.run.smithi097:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-04-01T01:54:54.382 INFO:teuthology.orchestra.run.smithi097.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-04-01T01:54:54.385 DEBUG:teuthology.orchestra.run.smithi097:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-04-01T01:54:54.440 DEBUG:teuthology.orchestra.run.smithi097:> sudo mkdir -p /var/lib/ceph/mds/ceph-f && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.f /var/lib/ceph/mds/ceph-f/keyring 2024-04-01T01:54:54.523 INFO:teuthology.orchestra.run.smithi097.stdout:creating /var/lib/ceph/mds/ceph-f/keyring 2024-04-01T01:54:54.525 DEBUG:teuthology.orchestra.run.smithi097:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-f 2024-04-01T01:54:54.584 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-01T01:54:54.585 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-01T01:54:54.621 INFO:teuthology.orchestra.run.smithi050.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-01T01:54:54.634 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-01T01:54:54.634 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi050.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi097.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-01T01:54:54.634 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-01T01:54:54.691 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-01T01:54:54.691 INFO:tasks.ceph:role: osd.0 2024-04-01T01:54:54.691 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi050.front.sepia.ceph.com 2024-04-01T01:54:54.692 DEBUG:teuthology.orchestra.run.smithi050:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-01T01:54:54.746 INFO:teuthology.orchestra.run.smithi050.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-01T01:54:54.746 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-01T01:54:54.747 INFO:teuthology.orchestra.run.smithi050.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-01T01:54:54.747 INFO:teuthology.orchestra.run.smithi050.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-01T01:54:54.747 INFO:teuthology.orchestra.run.smithi050.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-01T01:54:54.747 INFO:teuthology.orchestra.run.smithi050.stdout: = sunit=0 swidth=0 blks 2024-04-01T01:54:54.747 INFO:teuthology.orchestra.run.smithi050.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-01T01:54:54.747 INFO:teuthology.orchestra.run.smithi050.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-01T01:54:54.747 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-01T01:54:54.747 INFO:teuthology.orchestra.run.smithi050.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-01T01:54:54.771 INFO:teuthology.orchestra.run.smithi050.stdout:Discarding blocks...Done. 2024-04-01T01:54:54.772 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi050.front.sepia.ceph.com -o noatime 2024-04-01T01:54:54.773 DEBUG:teuthology.orchestra.run.smithi050:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-01T01:54:54.830 DEBUG:teuthology.orchestra.run.smithi050:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-01T01:54:54.882 INFO:teuthology.orchestra.run.smithi050.stderr:sudo: /sbin/restorecon: command not found 2024-04-01T01:54:54.883 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-01T01:54:54.883 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-01T01:54:54.937 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-01T01:54:54.937 INFO:tasks.ceph:role: osd.1 2024-04-01T01:54:54.937 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi050.front.sepia.ceph.com 2024-04-01T01:54:54.938 DEBUG:teuthology.orchestra.run.smithi050:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-01T01:54:54.994 INFO:teuthology.orchestra.run.smithi050.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-01T01:54:54.994 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-01T01:54:54.995 INFO:teuthology.orchestra.run.smithi050.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-01T01:54:54.995 INFO:teuthology.orchestra.run.smithi050.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-01T01:54:54.995 INFO:teuthology.orchestra.run.smithi050.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-01T01:54:54.995 INFO:teuthology.orchestra.run.smithi050.stdout: = sunit=0 swidth=0 blks 2024-04-01T01:54:54.995 INFO:teuthology.orchestra.run.smithi050.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-01T01:54:54.995 INFO:teuthology.orchestra.run.smithi050.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-01T01:54:54.995 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-01T01:54:54.995 INFO:teuthology.orchestra.run.smithi050.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-01T01:54:55.019 INFO:teuthology.orchestra.run.smithi050.stdout:Discarding blocks...Done. 2024-04-01T01:54:55.021 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi050.front.sepia.ceph.com -o noatime 2024-04-01T01:54:55.021 DEBUG:teuthology.orchestra.run.smithi050:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-04-01T01:54:55.079 DEBUG:teuthology.orchestra.run.smithi050:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-01T01:54:55.130 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-01T01:54:55.131 INFO:teuthology.orchestra.run.smithi050.stderr:sudo: /sbin/restorecon: command not found 2024-04-01T01:54:55.131 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-01T01:54:55.183 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-01T01:54:55.184 INFO:tasks.ceph:role: osd.2 2024-04-01T01:54:55.184 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi050.front.sepia.ceph.com 2024-04-01T01:54:55.184 DEBUG:teuthology.orchestra.run.smithi050:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-01T01:54:55.239 INFO:teuthology.orchestra.run.smithi050.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-01T01:54:55.239 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-01T01:54:55.239 INFO:teuthology.orchestra.run.smithi050.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-01T01:54:55.239 INFO:teuthology.orchestra.run.smithi050.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-01T01:54:55.239 INFO:teuthology.orchestra.run.smithi050.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-01T01:54:55.239 INFO:teuthology.orchestra.run.smithi050.stdout: = sunit=0 swidth=0 blks 2024-04-01T01:54:55.239 INFO:teuthology.orchestra.run.smithi050.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-01T01:54:55.239 INFO:teuthology.orchestra.run.smithi050.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-01T01:54:55.239 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-01T01:54:55.240 INFO:teuthology.orchestra.run.smithi050.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-01T01:54:55.263 INFO:teuthology.orchestra.run.smithi050.stdout:Discarding blocks...Done. 2024-04-01T01:54:55.265 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi050.front.sepia.ceph.com -o noatime 2024-04-01T01:54:55.265 DEBUG:teuthology.orchestra.run.smithi050:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-04-01T01:54:55.321 DEBUG:teuthology.orchestra.run.smithi050:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-01T01:54:55.375 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-01T01:54:55.375 INFO:teuthology.orchestra.run.smithi050.stderr:sudo: /sbin/restorecon: command not found 2024-04-01T01:54:55.376 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-01T01:54:55.430 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-01T01:54:55.430 INFO:tasks.ceph:role: osd.3 2024-04-01T01:54:55.430 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi050.front.sepia.ceph.com 2024-04-01T01:54:55.431 DEBUG:teuthology.orchestra.run.smithi050:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-01T01:54:55.485 INFO:teuthology.orchestra.run.smithi050.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-01T01:54:55.485 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-01T01:54:55.486 INFO:teuthology.orchestra.run.smithi050.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-01T01:54:55.486 INFO:teuthology.orchestra.run.smithi050.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-01T01:54:55.486 INFO:teuthology.orchestra.run.smithi050.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-01T01:54:55.486 INFO:teuthology.orchestra.run.smithi050.stdout: = sunit=0 swidth=0 blks 2024-04-01T01:54:55.486 INFO:teuthology.orchestra.run.smithi050.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-01T01:54:55.486 INFO:teuthology.orchestra.run.smithi050.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-01T01:54:55.486 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-01T01:54:55.486 INFO:teuthology.orchestra.run.smithi050.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-01T01:54:55.509 INFO:teuthology.orchestra.run.smithi050.stdout:Discarding blocks...Done. 2024-04-01T01:54:55.511 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi050.front.sepia.ceph.com -o noatime 2024-04-01T01:54:55.511 DEBUG:teuthology.orchestra.run.smithi050:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-04-01T01:54:55.571 DEBUG:teuthology.orchestra.run.smithi050:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-01T01:54:55.624 INFO:teuthology.orchestra.run.smithi050.stderr:sudo: /sbin/restorecon: command not found 2024-04-01T01:54:55.625 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-01T01:54:55.625 DEBUG:teuthology.orchestra.run.smithi050:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-01T01:54:55.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:54:55.740+0000 7fd7fc8237c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-01T01:54:55.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:54:55.740+0000 7fd7fc8237c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-01T01:54:55.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:54:55.740+0000 7fd7fc8237c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-01T01:54:55.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:54:55.740+0000 7fd7fc8237c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-01T01:54:55.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:54:55.740+0000 7fd7fc8237c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-01T01:54:55.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:54:55.744+0000 7fd7fc8237c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-01T01:54:58.699 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-01T01:54:58.714 DEBUG:teuthology.orchestra.run.smithi050:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-01T01:54:58.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:54:58.800+0000 7f9cbd4167c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-01T01:54:58.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:54:58.800+0000 7f9cbd4167c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-01T01:54:58.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:54:58.800+0000 7f9cbd4167c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-01T01:54:58.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:54:58.800+0000 7f9cbd4167c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-01T01:54:58.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:54:58.800+0000 7f9cbd4167c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-01T01:54:58.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:54:58.800+0000 7f9cbd4167c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-01T01:55:01.790 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-01T01:55:01.847 DEBUG:teuthology.orchestra.run.smithi050:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-01T01:55:01.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:01.928+0000 7f0e5862f7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-01T01:55:01.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:01.928+0000 7f0e5862f7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-01T01:55:01.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:01.928+0000 7f0e5862f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-01T01:55:01.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:01.932+0000 7f0e5862f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-01T01:55:01.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:01.932+0000 7f0e5862f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-01T01:55:01.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:01.932+0000 7f0e5862f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-01T01:55:04.896 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-01T01:55:04.951 DEBUG:teuthology.orchestra.run.smithi050:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-01T01:55:05.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:05.032+0000 7f82f4c3e7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-01T01:55:05.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:05.032+0000 7f82f4c3e7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-01T01:55:05.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:05.032+0000 7f82f4c3e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-01T01:55:05.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:05.032+0000 7f82f4c3e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-01T01:55:05.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:05.032+0000 7f82f4c3e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-01T01:55:05.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:05.036+0000 7f82f4c3e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-01T01:55:08.008 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-01T01:55:08.063 DEBUG:teuthology.orchestra.run.smithi097:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-04-01T01:55:08.078 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-01T01:55:08.078 INFO:tasks.ceph:role: osd.4 2024-04-01T01:55:08.078 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi097.front.sepia.ceph.com 2024-04-01T01:55:08.078 DEBUG:teuthology.orchestra.run.smithi097:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-01T01:55:08.138 INFO:teuthology.orchestra.run.smithi097.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-01T01:55:08.138 INFO:teuthology.orchestra.run.smithi097.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-01T01:55:08.139 INFO:teuthology.orchestra.run.smithi097.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-01T01:55:08.139 INFO:teuthology.orchestra.run.smithi097.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-01T01:55:08.139 INFO:teuthology.orchestra.run.smithi097.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-01T01:55:08.139 INFO:teuthology.orchestra.run.smithi097.stdout: = sunit=0 swidth=0 blks 2024-04-01T01:55:08.139 INFO:teuthology.orchestra.run.smithi097.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-01T01:55:08.139 INFO:teuthology.orchestra.run.smithi097.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-01T01:55:08.139 INFO:teuthology.orchestra.run.smithi097.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-01T01:55:08.139 INFO:teuthology.orchestra.run.smithi097.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-01T01:55:08.595 INFO:teuthology.orchestra.run.smithi097.stdout:Discarding blocks...Done. 2024-04-01T01:55:08.597 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi097.front.sepia.ceph.com -o noatime 2024-04-01T01:55:08.597 DEBUG:teuthology.orchestra.run.smithi097:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-04-01T01:55:08.699 DEBUG:teuthology.orchestra.run.smithi097:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-04-01T01:55:08.709 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-01T01:55:08.709 INFO:teuthology.orchestra.run.smithi097.stderr:sudo: /sbin/restorecon: command not found 2024-04-01T01:55:08.710 DEBUG:teuthology.orchestra.run.smithi097:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-04-01T01:55:08.762 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-01T01:55:08.762 INFO:tasks.ceph:role: osd.5 2024-04-01T01:55:08.762 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi097.front.sepia.ceph.com 2024-04-01T01:55:08.762 DEBUG:teuthology.orchestra.run.smithi097:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-01T01:55:08.825 INFO:teuthology.orchestra.run.smithi097.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-01T01:55:08.825 INFO:teuthology.orchestra.run.smithi097.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-01T01:55:08.825 INFO:teuthology.orchestra.run.smithi097.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-01T01:55:08.825 INFO:teuthology.orchestra.run.smithi097.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-01T01:55:08.825 INFO:teuthology.orchestra.run.smithi097.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-01T01:55:08.825 INFO:teuthology.orchestra.run.smithi097.stdout: = sunit=0 swidth=0 blks 2024-04-01T01:55:08.825 INFO:teuthology.orchestra.run.smithi097.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-01T01:55:08.825 INFO:teuthology.orchestra.run.smithi097.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-01T01:55:08.825 INFO:teuthology.orchestra.run.smithi097.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-01T01:55:08.825 INFO:teuthology.orchestra.run.smithi097.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-01T01:55:09.289 INFO:teuthology.orchestra.run.smithi097.stdout:Discarding blocks...Done. 2024-04-01T01:55:09.292 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi097.front.sepia.ceph.com -o noatime 2024-04-01T01:55:09.292 DEBUG:teuthology.orchestra.run.smithi097:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-04-01T01:55:09.439 DEBUG:teuthology.orchestra.run.smithi097:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-04-01T01:55:09.450 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-01T01:55:09.450 INFO:teuthology.orchestra.run.smithi097.stderr:sudo: /sbin/restorecon: command not found 2024-04-01T01:55:09.450 DEBUG:teuthology.orchestra.run.smithi097:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-04-01T01:55:09.503 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-01T01:55:09.503 INFO:tasks.ceph:role: osd.6 2024-04-01T01:55:09.503 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi097.front.sepia.ceph.com 2024-04-01T01:55:09.503 DEBUG:teuthology.orchestra.run.smithi097:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-01T01:55:09.566 INFO:teuthology.orchestra.run.smithi097.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-01T01:55:09.567 INFO:teuthology.orchestra.run.smithi097.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-01T01:55:09.567 INFO:teuthology.orchestra.run.smithi097.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-01T01:55:09.567 INFO:teuthology.orchestra.run.smithi097.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-01T01:55:09.567 INFO:teuthology.orchestra.run.smithi097.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-01T01:55:09.567 INFO:teuthology.orchestra.run.smithi097.stdout: = sunit=0 swidth=0 blks 2024-04-01T01:55:09.567 INFO:teuthology.orchestra.run.smithi097.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-01T01:55:09.567 INFO:teuthology.orchestra.run.smithi097.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-01T01:55:09.567 INFO:teuthology.orchestra.run.smithi097.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-01T01:55:09.567 INFO:teuthology.orchestra.run.smithi097.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-01T01:55:10.051 INFO:teuthology.orchestra.run.smithi097.stdout:Discarding blocks...Done. 2024-04-01T01:55:10.053 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi097.front.sepia.ceph.com -o noatime 2024-04-01T01:55:10.053 DEBUG:teuthology.orchestra.run.smithi097:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-04-01T01:55:10.185 DEBUG:teuthology.orchestra.run.smithi097:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-04-01T01:55:10.197 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-01T01:55:10.197 INFO:teuthology.orchestra.run.smithi097.stderr:sudo: /sbin/restorecon: command not found 2024-04-01T01:55:10.197 DEBUG:teuthology.orchestra.run.smithi097:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-04-01T01:55:10.252 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-01T01:55:10.252 INFO:tasks.ceph:role: osd.7 2024-04-01T01:55:10.252 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi097.front.sepia.ceph.com 2024-04-01T01:55:10.252 DEBUG:teuthology.orchestra.run.smithi097:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-01T01:55:10.315 INFO:teuthology.orchestra.run.smithi097.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-01T01:55:10.315 INFO:teuthology.orchestra.run.smithi097.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-01T01:55:10.315 INFO:teuthology.orchestra.run.smithi097.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-01T01:55:10.315 INFO:teuthology.orchestra.run.smithi097.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-01T01:55:10.315 INFO:teuthology.orchestra.run.smithi097.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-01T01:55:10.316 INFO:teuthology.orchestra.run.smithi097.stdout: = sunit=0 swidth=0 blks 2024-04-01T01:55:10.316 INFO:teuthology.orchestra.run.smithi097.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-01T01:55:10.316 INFO:teuthology.orchestra.run.smithi097.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-01T01:55:10.316 INFO:teuthology.orchestra.run.smithi097.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-01T01:55:10.316 INFO:teuthology.orchestra.run.smithi097.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-01T01:55:10.735 INFO:teuthology.orchestra.run.smithi097.stdout:Discarding blocks...Done. 2024-04-01T01:55:10.737 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi097.front.sepia.ceph.com -o noatime 2024-04-01T01:55:10.737 DEBUG:teuthology.orchestra.run.smithi097:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-04-01T01:55:10.841 DEBUG:teuthology.orchestra.run.smithi097:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-04-01T01:55:10.850 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-01T01:55:10.851 INFO:teuthology.orchestra.run.smithi097.stderr:sudo: /sbin/restorecon: command not found 2024-04-01T01:55:10.851 DEBUG:teuthology.orchestra.run.smithi097:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-01T01:55:10.963 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:10.962+0000 7f52b3dd97c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-04-01T01:55:10.966 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:10.966+0000 7f52b3dd97c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-04-01T01:55:10.966 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:10.966+0000 7f52b3dd97c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-01T01:55:10.966 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:10.966+0000 7f52b3dd97c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-01T01:55:10.966 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:10.966+0000 7f52b3dd97c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-01T01:55:10.968 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:10.970+0000 7f52b3dd97c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-04-01T01:55:13.958 DEBUG:teuthology.orchestra.run.smithi097:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-01T01:55:13.972 DEBUG:teuthology.orchestra.run.smithi097:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-01T01:55:14.055 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:14.054+0000 7f29d1c2f7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-04-01T01:55:14.056 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:14.054+0000 7f29d1c2f7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-04-01T01:55:14.056 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:14.054+0000 7f29d1c2f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-01T01:55:14.056 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:14.054+0000 7f29d1c2f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-01T01:55:14.056 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:14.054+0000 7f29d1c2f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-01T01:55:14.056 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:14.058+0000 7f29d1c2f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-04-01T01:55:17.032 DEBUG:teuthology.orchestra.run.smithi097:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-01T01:55:17.094 DEBUG:teuthology.orchestra.run.smithi097:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-01T01:55:17.174 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:17.174+0000 7f1f47d0c7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-04-01T01:55:17.175 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:17.174+0000 7f1f47d0c7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-04-01T01:55:17.175 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:17.174+0000 7f1f47d0c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-01T01:55:17.175 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:17.174+0000 7f1f47d0c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-01T01:55:17.175 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:17.174+0000 7f1f47d0c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-01T01:55:17.175 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:17.174+0000 7f1f47d0c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-04-01T01:55:20.167 DEBUG:teuthology.orchestra.run.smithi097:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-04-01T01:55:20.221 DEBUG:teuthology.orchestra.run.smithi097:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-01T01:55:20.303 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:20.302+0000 7f33b6e727c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-04-01T01:55:20.305 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:20.306+0000 7f33b6e727c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-04-01T01:55:20.305 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:20.306+0000 7f33b6e727c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-01T01:55:20.305 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:20.306+0000 7f33b6e727c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-01T01:55:20.305 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:20.306+0000 7f33b6e727c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-01T01:55:20.305 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:20.306+0000 7f33b6e727c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-04-01T01:55:21.534 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T01:55:21.537 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T01:55:23.304 DEBUG:teuthology.orchestra.run.smithi097:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-04-01T01:55:23.318 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-01T01:55:23.318 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-04-01T01:55:23.318 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-01T01:55:23.333 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-04-01T01:55:23.333 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-01T01:55:23.391 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-04-01T01:55:23.391 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-04-01T01:55:23.450 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-04-01T01:55:23.450 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/mds/ceph-e/keyring of=/dev/stdout 2024-04-01T01:55:23.509 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-04-01T01:55:23.509 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-01T01:55:23.569 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-04-01T01:55:23.569 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-01T01:55:23.626 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-04-01T01:55:23.626 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-01T01:55:23.681 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-04-01T01:55:23.681 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-01T01:55:23.738 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-04-01T01:55:23.738 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-01T01:55:23.752 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-04-01T01:55:23.752 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-04-01T01:55:23.811 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-04-01T01:55:23.811 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-04-01T01:55:23.867 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-04-01T01:55:23.867 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/mds/ceph-f/keyring of=/dev/stdout 2024-04-01T01:55:23.923 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-04-01T01:55:23.923 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-04-01T01:55:23.979 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-04-01T01:55:23.979 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-04-01T01:55:24.031 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-04-01T01:55:24.031 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-04-01T01:55:24.084 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-04-01T01:55:24.084 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-04-01T01:55:24.144 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-04-01T01:55:24.144 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-01T01:55:24.149 INFO:tasks.ceph:Adding keys to all mons... 2024-04-01T01:55:24.150 DEBUG:teuthology.orchestra.run.smithi050:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-01T01:55:24.195 DEBUG:teuthology.orchestra.run.smithi097:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-01T01:55:24.205 INFO:teuthology.orchestra.run.smithi050.stdout:[mgr.y] 2024-04-01T01:55:24.205 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQDtEwpmfYzoLBAA045FJC2uQmZm+Sr+K1h2sA== 2024-04-01T01:55:24.205 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.a] 2024-04-01T01:55:24.205 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQDtEwpmSirFMhAApTCuTz1oyYFtCXLQAumqgg== 2024-04-01T01:55:24.205 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.c] 2024-04-01T01:55:24.205 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQDtEwpmMAc/OxAAFp58az8dUtjzNdteP3fz3Q== 2024-04-01T01:55:24.205 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.e] 2024-04-01T01:55:24.205 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQDuEwpmaXtCCBAA7GnKDjcsYuVh/uXxIJV4JQ== 2024-04-01T01:55:24.205 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.0] 2024-04-01T01:55:24.205 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQDvEwpm7sVhLBAAn7ryQyxHRnhevC+lKn8NRQ== 2024-04-01T01:55:24.205 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.1] 2024-04-01T01:55:24.206 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQDyEwpm5ojGLxAAF7ezfDhCs1KJ1YhJ3ZUQIw== 2024-04-01T01:55:24.206 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.2] 2024-04-01T01:55:24.206 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQD1EwpmeUqbNxAAy3AUE+DnyUGfAUPJ8UF9vw== 2024-04-01T01:55:24.206 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.3] 2024-04-01T01:55:24.206 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQD5EwpmwGIyAhAAxSZ1RUNb7gYA9xpT/eVPSQ== 2024-04-01T01:55:24.206 INFO:teuthology.orchestra.run.smithi050.stdout:[mgr.x] 2024-04-01T01:55:24.206 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQDtEwpm+1mrLxAAdEydHGuQyE00FGYMT+Gs9g== 2024-04-01T01:55:24.206 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.b] 2024-04-01T01:55:24.206 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQDuEwpmhJNbDhAAuqhhU2XpOStkQ2TfkSYyrg== 2024-04-01T01:55:24.206 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.d] 2024-04-01T01:55:24.206 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQDuEwpmtDLxFhAAkV0Qu6mIIAptzl4fz8vrYQ== 2024-04-01T01:55:24.207 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.f] 2024-04-01T01:55:24.207 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQDuEwpm9N1SHxAAhNx8rnqLB5TGL/vN6phxlw== 2024-04-01T01:55:24.207 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.4] 2024-04-01T01:55:24.207 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQD+EwpmjKOaORAAVNy54+BMVVGXM9ZUUwKbRA== 2024-04-01T01:55:24.207 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.5] 2024-04-01T01:55:24.207 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQACFApm1DpyAxAAHlubKh7wrHlg8W5a++a2zw== 2024-04-01T01:55:24.207 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.6] 2024-04-01T01:55:24.207 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQAFFApmb1SRChAANRc6eaUqOcCQgbjwBRXS6g== 2024-04-01T01:55:24.207 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.7] 2024-04-01T01:55:24.207 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQAIFApmu+VEEhAADWz+POh5IJNC9Mj1MmMlmA== 2024-04-01T01:55:24.207 INFO:teuthology.orchestra.run.smithi050.stdout:[client.0] 2024-04-01T01:55:24.208 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQDuEwpmrglBJRAA00AZPTWqxwxy4/R2uea6nw== 2024-04-01T01:55:24.209 INFO:teuthology.orchestra.run.smithi097.stdout:[mgr.y] 2024-04-01T01:55:24.209 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQDtEwpmfYzoLBAA045FJC2uQmZm+Sr+K1h2sA== 2024-04-01T01:55:24.209 INFO:teuthology.orchestra.run.smithi097.stdout:[mds.a] 2024-04-01T01:55:24.209 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQDtEwpmSirFMhAApTCuTz1oyYFtCXLQAumqgg== 2024-04-01T01:55:24.209 INFO:teuthology.orchestra.run.smithi097.stdout:[mds.c] 2024-04-01T01:55:24.209 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQDtEwpmMAc/OxAAFp58az8dUtjzNdteP3fz3Q== 2024-04-01T01:55:24.209 INFO:teuthology.orchestra.run.smithi097.stdout:[mds.e] 2024-04-01T01:55:24.210 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQDuEwpmaXtCCBAA7GnKDjcsYuVh/uXxIJV4JQ== 2024-04-01T01:55:24.210 INFO:teuthology.orchestra.run.smithi097.stdout:[osd.0] 2024-04-01T01:55:24.210 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQDvEwpm7sVhLBAAn7ryQyxHRnhevC+lKn8NRQ== 2024-04-01T01:55:24.210 INFO:teuthology.orchestra.run.smithi097.stdout:[osd.1] 2024-04-01T01:55:24.210 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQDyEwpm5ojGLxAAF7ezfDhCs1KJ1YhJ3ZUQIw== 2024-04-01T01:55:24.210 INFO:teuthology.orchestra.run.smithi097.stdout:[osd.2] 2024-04-01T01:55:24.210 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQD1EwpmeUqbNxAAy3AUE+DnyUGfAUPJ8UF9vw== 2024-04-01T01:55:24.210 INFO:teuthology.orchestra.run.smithi097.stdout:[osd.3] 2024-04-01T01:55:24.210 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQD5EwpmwGIyAhAAxSZ1RUNb7gYA9xpT/eVPSQ== 2024-04-01T01:55:24.210 INFO:teuthology.orchestra.run.smithi097.stdout:[mgr.x] 2024-04-01T01:55:24.210 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQDtEwpm+1mrLxAAdEydHGuQyE00FGYMT+Gs9g== 2024-04-01T01:55:24.210 INFO:teuthology.orchestra.run.smithi097.stdout:[mds.b] 2024-04-01T01:55:24.211 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQDuEwpmhJNbDhAAuqhhU2XpOStkQ2TfkSYyrg== 2024-04-01T01:55:24.211 INFO:teuthology.orchestra.run.smithi097.stdout:[mds.d] 2024-04-01T01:55:24.211 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQDuEwpmtDLxFhAAkV0Qu6mIIAptzl4fz8vrYQ== 2024-04-01T01:55:24.211 INFO:teuthology.orchestra.run.smithi097.stdout:[mds.f] 2024-04-01T01:55:24.211 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQDuEwpm9N1SHxAAhNx8rnqLB5TGL/vN6phxlw== 2024-04-01T01:55:24.211 INFO:teuthology.orchestra.run.smithi097.stdout:[osd.4] 2024-04-01T01:55:24.211 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQD+EwpmjKOaORAAVNy54+BMVVGXM9ZUUwKbRA== 2024-04-01T01:55:24.211 INFO:teuthology.orchestra.run.smithi097.stdout:[osd.5] 2024-04-01T01:55:24.211 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQACFApm1DpyAxAAHlubKh7wrHlg8W5a++a2zw== 2024-04-01T01:55:24.211 INFO:teuthology.orchestra.run.smithi097.stdout:[osd.6] 2024-04-01T01:55:24.212 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQAFFApmb1SRChAANRc6eaUqOcCQgbjwBRXS6g== 2024-04-01T01:55:24.212 INFO:teuthology.orchestra.run.smithi097.stdout:[osd.7] 2024-04-01T01:55:24.212 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQAIFApmu+VEEhAADWz+POh5IJNC9Mj1MmMlmA== 2024-04-01T01:55:24.212 INFO:teuthology.orchestra.run.smithi097.stdout:[client.0] 2024-04-01T01:55:24.212 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQDuEwpmrglBJRAA00AZPTWqxwxy4/R2uea6nw== 2024-04-01T01:55:24.212 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-01T01:55:24.255 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-01T01:55:24.302 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-01T01:55:24.305 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-01T01:55:24.350 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-01T01:55:24.395 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-01T01:55:24.440 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-01T01:55:24.443 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-01T01:55:24.534 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-01T01:55:24.537 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-01T01:55:24.617 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-01T01:55:24.619 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-01T01:55:24.701 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-01T01:55:24.703 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-01T01:55:24.786 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-01T01:55:24.789 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-01T01:55:24.875 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-01T01:55:24.877 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-01T01:55:24.960 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-01T01:55:24.963 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-01T01:55:25.047 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-01T01:55:25.051 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-01T01:55:25.129 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-01T01:55:25.139 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-01T01:55:25.222 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-01T01:55:25.225 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-01T01:55:25.307 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-01T01:55:25.311 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-01T01:55:25.392 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-01T01:55:25.399 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-01T01:55:25.477 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-01T01:55:25.487 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-01T01:55:25.558 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-01T01:55:25.561 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-01T01:55:25.648 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-01T01:55:25.648 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-01T01:55:25.661 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-01T01:55:25.755 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-01T01:55:25.766 DEBUG:teuthology.orchestra.run.smithi097:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-01T01:55:25.780 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-01T01:55:25.872 DEBUG:teuthology.orchestra.run.smithi097:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-01T01:55:25.883 DEBUG:teuthology.orchestra.run.smithi097:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-01T01:55:25.938 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-01T01:55:26.027 DEBUG:teuthology.orchestra.run.smithi097:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-01T01:55:26.081 DEBUG:teuthology.orchestra.run.smithi050:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-01T01:55:26.084 DEBUG:teuthology.orchestra.run.smithi097:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-01T01:55:26.131 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-01T01:55:26.132 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-01T01:55:26.132 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mon -f --cluster ceph -i a 2024-04-01T01:55:26.134 INFO:tasks.ceph.mon.a:Started 2024-04-01T01:55:26.134 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-01T01:55:26.135 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mon -f --cluster ceph -i b 2024-04-01T01:55:26.177 INFO:tasks.ceph.mon.b:Started 2024-04-01T01:55:26.177 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-01T01:55:26.177 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mon -f --cluster ceph -i c 2024-04-01T01:55:26.179 INFO:tasks.ceph.mon.c:Started 2024-04-01T01:55:26.179 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-01T01:55:26.179 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-01T01:55:26.180 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i y 2024-04-01T01:55:26.182 INFO:tasks.ceph.mgr.y:Started 2024-04-01T01:55:26.182 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-01T01:55:26.182 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i x 2024-04-01T01:55:26.184 INFO:tasks.ceph.mgr.x:Started 2024-04-01T01:55:26.184 INFO:tasks.ceph:Setting crush tunables to default 2024-04-01T01:55:26.184 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph --cluster ceph osd crush tunables default 2024-04-01T01:55:26.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:26.300+0000 7effcce36640 1 Processor -- start 2024-04-01T01:55:26.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:26.300+0000 7effcce36640 1 -- start start 2024-04-01T01:55:26.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:26.300+0000 7effcce36640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7effc80ca260 0x7effc80cad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:26.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:26.300+0000 7effcce36640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7effc80cb2b0 0x7effc815d970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:26.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:26.300+0000 7effcce36640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effc8159ea0 con 0x7effc8154060 2024-04-01T01:55:26.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:26.300+0000 7effcce36640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7effc80ca6b0 con 0x7effc80cb2b0 2024-04-01T01:55:26.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:26.300+0000 7effcce36640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7effc815a140 con 0x7effc80ca260 2024-04-01T01:55:26.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:26.300+0000 7effc6d9d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7effc80cb2b0 0x7effc815d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:26.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:26.300+0000 7effc6d9d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7effc80cb2b0 0x7effc815d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58156/0 (socket says 172.21.15.50:58156) 2024-04-01T01:55:26.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:26.300+0000 7effc6d9d640 1 -- 172.21.15.50:0/1328666470 learned_addr learned my addr 172.21.15.50:0/1328666470 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T01:55:26.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:26.300+0000 7effc5d9b640 1 --2- 172.21.15.50:0/1328666470 >> v2:172.21.15.97:3300/0 conn(0x7effc80ca260 0x7effc80cad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:26.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:26.300+0000 7effc6d9d640 1 -- 172.21.15.50:0/1328666470 >> v2:172.21.15.50:3300/0 conn(0x7effc80cb2b0 msgr2=0x7effc815d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-01T01:55:26.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:26.300+0000 7effc6d9d640 1 -- 172.21.15.50:0/1328666470 >> v2:172.21.15.50:3300/0 conn(0x7effc80cb2b0 msgr2=0x7effc815d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-01T01:55:26.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:26.300+0000 7effc6d9d640 1 --2- 172.21.15.50:0/1328666470 >> v2:172.21.15.50:3300/0 conn(0x7effc80cb2b0 0x7effc815d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-01T01:55:26.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:26.300+0000 7effc6d9d640 1 --2- 172.21.15.50:0/1328666470 >> v2:172.21.15.50:3300/0 conn(0x7effc80cb2b0 0x7effc815d970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-01T01:55:26.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:26.300+0000 7effc5d9b640 1 -- 172.21.15.50:0/1328666470 >> v2:172.21.15.97:3300/0 conn(0x7effc80ca260 msgr2=0x7effc80cad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-01T01:55:26.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:26.300+0000 7effc5d9b640 1 -- 172.21.15.50:0/1328666470 >> v2:172.21.15.97:3300/0 conn(0x7effc80ca260 msgr2=0x7effc80cad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-01T01:55:26.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:26.300+0000 7effc5d9b640 1 --2- 172.21.15.50:0/1328666470 >> v2:172.21.15.97:3300/0 conn(0x7effc80ca260 0x7effc80cad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-01T01:55:26.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:26.300+0000 7effc5d9b640 1 --2- 172.21.15.50:0/1328666470 >> v2:172.21.15.97:3300/0 conn(0x7effc80ca260 0x7effc80cad70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-01T01:55:26.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:26.504+0000 7effc6d9d640 1 --2- 172.21.15.50:0/1328666470 >> v2:172.21.15.50:3300/0 conn(0x7effc80cb2b0 0x7effc815d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:26.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:26.504+0000 7effc5d9b640 1 --2- 172.21.15.50:0/1328666470 >> v2:172.21.15.97:3300/0 conn(0x7effc80ca260 0x7effc80cad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:26.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:26.504+0000 7effc6d9d640 1 -- 172.21.15.50:0/1328666470 >> v2:172.21.15.50:3300/0 conn(0x7effc80cb2b0 msgr2=0x7effc815d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-01T01:55:26.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:26.504+0000 7effc6d9d640 1 -- 172.21.15.50:0/1328666470 >> v2:172.21.15.50:3300/0 conn(0x7effc80cb2b0 msgr2=0x7effc815d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-01T01:55:26.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:26.504+0000 7effc6d9d640 1 --2- 172.21.15.50:0/1328666470 >> v2:172.21.15.50:3300/0 conn(0x7effc80cb2b0 0x7effc815d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-01T01:55:26.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:26.504+0000 7effc5d9b640 1 -- 172.21.15.50:0/1328666470 >> v2:172.21.15.97:3300/0 conn(0x7effc80ca260 msgr2=0x7effc80cad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-01T01:55:26.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:26.504+0000 7effc6d9d640 1 --2- 172.21.15.50:0/1328666470 >> v2:172.21.15.50:3300/0 conn(0x7effc80cb2b0 0x7effc815d970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-01T01:55:26.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:26.504+0000 7effc5d9b640 1 -- 172.21.15.50:0/1328666470 >> v2:172.21.15.97:3300/0 conn(0x7effc80ca260 msgr2=0x7effc80cad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-01T01:55:26.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:26.504+0000 7effc5d9b640 1 --2- 172.21.15.50:0/1328666470 >> v2:172.21.15.97:3300/0 conn(0x7effc80ca260 0x7effc80cad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-01T01:55:26.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:26.504+0000 7effc5d9b640 1 --2- 172.21.15.50:0/1328666470 >> v2:172.21.15.97:3300/0 conn(0x7effc80ca260 0x7effc80cad70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-01T01:55:26.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:26.908+0000 7effc6d9d640 1 --2- 172.21.15.50:0/1328666470 >> v2:172.21.15.50:3300/0 conn(0x7effc80cb2b0 0x7effc815d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:26.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:26.908+0000 7effc5d9b640 1 --2- 172.21.15.50:0/1328666470 >> v2:172.21.15.97:3300/0 conn(0x7effc80ca260 0x7effc80cad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:26.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:26.908+0000 7effc6d9d640 1 -- 172.21.15.50:0/1328666470 >> v2:172.21.15.50:3300/0 conn(0x7effc80cb2b0 msgr2=0x7effc815d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-01T01:55:26.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:26.908+0000 7effc6d9d640 1 -- 172.21.15.50:0/1328666470 >> v2:172.21.15.50:3300/0 conn(0x7effc80cb2b0 msgr2=0x7effc815d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-01T01:55:26.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:26.908+0000 7effc6d9d640 1 --2- 172.21.15.50:0/1328666470 >> v2:172.21.15.50:3300/0 conn(0x7effc80cb2b0 0x7effc815d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-01T01:55:26.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:26.908+0000 7effc6d9d640 1 --2- 172.21.15.50:0/1328666470 >> v2:172.21.15.50:3300/0 conn(0x7effc80cb2b0 0x7effc815d970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-01T01:55:26.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:26.908+0000 7effc5d9b640 1 -- 172.21.15.50:0/1328666470 >> v2:172.21.15.97:3300/0 conn(0x7effc80ca260 msgr2=0x7effc80cad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-01T01:55:26.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:26.908+0000 7effc5d9b640 1 -- 172.21.15.50:0/1328666470 >> v2:172.21.15.97:3300/0 conn(0x7effc80ca260 msgr2=0x7effc80cad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-01T01:55:26.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:26.908+0000 7effc5d9b640 1 --2- 172.21.15.50:0/1328666470 >> v2:172.21.15.97:3300/0 conn(0x7effc80ca260 0x7effc80cad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-01T01:55:26.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:26.908+0000 7effc5d9b640 1 --2- 172.21.15.50:0/1328666470 >> v2:172.21.15.97:3300/0 conn(0x7effc80ca260 0x7effc80cad70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-01T01:55:27.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:27.712+0000 7effc6d9d640 1 --2- 172.21.15.50:0/1328666470 >> v2:172.21.15.50:3300/0 conn(0x7effc80cb2b0 0x7effc815d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:27.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:27.712+0000 7effc5d9b640 1 --2- 172.21.15.50:0/1328666470 >> v2:172.21.15.97:3300/0 conn(0x7effc80ca260 0x7effc80cad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:27.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:27.712+0000 7effc6d9d640 1 -- 172.21.15.50:0/1328666470 >> v2:172.21.15.50:3300/0 conn(0x7effc80cb2b0 msgr2=0x7effc815d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-01T01:55:27.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:27.712+0000 7effc6d9d640 1 -- 172.21.15.50:0/1328666470 >> v2:172.21.15.50:3300/0 conn(0x7effc80cb2b0 msgr2=0x7effc815d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-01T01:55:27.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:27.712+0000 7effc6d9d640 1 --2- 172.21.15.50:0/1328666470 >> v2:172.21.15.50:3300/0 conn(0x7effc80cb2b0 0x7effc815d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-01T01:55:27.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:27.712+0000 7effc5d9b640 1 -- 172.21.15.50:0/1328666470 >> v2:172.21.15.97:3300/0 conn(0x7effc80ca260 msgr2=0x7effc80cad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-01T01:55:27.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:27.712+0000 7effc5d9b640 1 -- 172.21.15.50:0/1328666470 >> v2:172.21.15.97:3300/0 conn(0x7effc80ca260 msgr2=0x7effc80cad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-01T01:55:27.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:27.712+0000 7effc5d9b640 1 --2- 172.21.15.50:0/1328666470 >> v2:172.21.15.97:3300/0 conn(0x7effc80ca260 0x7effc80cad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-01T01:55:27.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:27.712+0000 7effc5d9b640 1 --2- 172.21.15.50:0/1328666470 >> v2:172.21.15.97:3300/0 conn(0x7effc80ca260 0x7effc80cad70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-01T01:55:27.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:27.712+0000 7effc6d9d640 1 --2- 172.21.15.50:0/1328666470 >> v2:172.21.15.50:3300/0 conn(0x7effc80cb2b0 0x7effc815d970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-01T01:55:29.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:29.299+0000 7effbffff640 1 -- 172.21.15.50:0/1328666470 >> v2:172.21.15.97:3300/0 conn(0x7effc80ca260 msgr2=0x7effc80cad70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-01T01:55:29.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:29.299+0000 7effbffff640 1 --2- 172.21.15.50:0/1328666470 >> v2:172.21.15.97:3300/0 conn(0x7effc80ca260 0x7effc80cad70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:29.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:29.299+0000 7effbffff640 1 -- 172.21.15.50:0/1328666470 >> v2:172.21.15.50:3300/0 conn(0x7effc80cb2b0 msgr2=0x7effc815d970 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-01T01:55:29.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:29.299+0000 7effbffff640 1 --2- 172.21.15.50:0/1328666470 >> v2:172.21.15.50:3300/0 conn(0x7effc80cb2b0 0x7effc815d970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:29.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:29.299+0000 7effbffff640 1 -- 172.21.15.50:0/1328666470 >> v1:172.21.15.97:6789/0 conn(0x7effc8154060 legacy=0x7effc80cb8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:29.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:29.299+0000 7effbffff640 1 --2- 172.21.15.50:0/1328666470 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7effa80036c0 0x7effa8005af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:29.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:29.299+0000 7effbffff640 1 -- 172.21.15.50:0/1328666470 --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effc815a420 con 0x7effa8006210 2024-04-01T01:55:29.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:29.299+0000 7effbffff640 1 -- 172.21.15.50:0/1328666470 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7effc80ca6b0 con 0x7effa80036c0 2024-04-01T01:55:29.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:29.299+0000 7effc659c640 1 --2- 172.21.15.50:0/1328666470 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7effa80036c0 0x7effa8005af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:29.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:29.303+0000 7effc659c640 1 -- 172.21.15.50:0/1328666470 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7effa80036c0 msgr2=0x7effa8005af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-01T01:55:29.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:29.303+0000 7effc659c640 1 -- 172.21.15.50:0/1328666470 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7effa80036c0 msgr2=0x7effa8005af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-01T01:55:29.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:29.303+0000 7effc659c640 1 --2- 172.21.15.50:0/1328666470 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7effa80036c0 0x7effa8005af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-01T01:55:29.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:29.303+0000 7effc659c640 1 --2- 172.21.15.50:0/1328666470 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7effa80036c0 0x7effa8005af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-01T01:55:29.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:29.507+0000 7effc659c640 1 --2- 172.21.15.50:0/1328666470 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7effa80036c0 0x7effa8005af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:29.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:29.507+0000 7effc659c640 1 -- 172.21.15.50:0/1328666470 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7effa80036c0 msgr2=0x7effa8005af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-01T01:55:29.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:29.507+0000 7effc659c640 1 -- 172.21.15.50:0/1328666470 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7effa80036c0 msgr2=0x7effa8005af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-01T01:55:29.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:29.507+0000 7effc659c640 1 --2- 172.21.15.50:0/1328666470 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7effa80036c0 0x7effa8005af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-01T01:55:29.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:29.507+0000 7effc659c640 1 --2- 172.21.15.50:0/1328666470 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7effa80036c0 0x7effa8005af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-01T01:55:29.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:29.911+0000 7effc659c640 1 --2- 172.21.15.50:0/1328666470 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7effa80036c0 0x7effa8005af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:29.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:29.911+0000 7effc659c640 1 -- 172.21.15.50:0/1328666470 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7effa80036c0 msgr2=0x7effa8005af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-01T01:55:29.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:29.911+0000 7effc659c640 1 -- 172.21.15.50:0/1328666470 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7effa80036c0 msgr2=0x7effa8005af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-01T01:55:29.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:29.911+0000 7effc659c640 1 --2- 172.21.15.50:0/1328666470 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7effa80036c0 0x7effa8005af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-01T01:55:29.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:29.911+0000 7effc659c640 1 --2- 172.21.15.50:0/1328666470 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7effa80036c0 0x7effa8005af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-01T01:55:30.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:30.715+0000 7effc659c640 1 --2- 172.21.15.50:0/1328666470 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7effa80036c0 0x7effa8005af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:30.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:30.715+0000 7effc659c640 1 -- 172.21.15.50:0/1328666470 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7effa80036c0 msgr2=0x7effa8005af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-01T01:55:30.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:30.715+0000 7effc659c640 1 -- 172.21.15.50:0/1328666470 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7effa80036c0 msgr2=0x7effa8005af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-01T01:55:30.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:30.715+0000 7effc659c640 1 --2- 172.21.15.50:0/1328666470 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7effa80036c0 0x7effa8005af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-01T01:55:30.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:30.715+0000 7effc659c640 1 --2- 172.21.15.50:0/1328666470 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7effa80036c0 0x7effa8005af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-01T01:55:31.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:31.583+0000 7effc559a640 1 -- 172.21.15.50:0/1328666470 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1846856112 0 0) 0x7effc815a420 con 0x7effa8006210 2024-04-01T01:55:31.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:31.583+0000 7effc559a640 1 -- 172.21.15.50:0/1328666470 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7effb4003530 con 0x7effa8006210 2024-04-01T01:55:31.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:31.587+0000 7effc559a640 1 -- 172.21.15.50:0/1328666470 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3890771317 0 0) 0x7effb4003530 con 0x7effa8006210 2024-04-01T01:55:31.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:31.587+0000 7effc559a640 1 -- 172.21.15.50:0/1328666470 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7effa80036c0 msgr2=0x7effa8005af0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-01T01:55:31.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:31.587+0000 7effc559a640 1 --2- 172.21.15.50:0/1328666470 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7effa80036c0 0x7effa8005af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:31.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:31.587+0000 7effc559a640 1 -- 172.21.15.50:0/1328666470 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effa800b0a0 con 0x7effa8006210 2024-04-01T01:55:31.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:31.587+0000 7effc559a640 1 -- 172.21.15.50:0/1328666470 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2779672543 0 0) 0x7effb000f040 con 0x7effa8006210 2024-04-01T01:55:31.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:31.587+0000 7effc559a640 1 -- 172.21.15.50:0/1328666470 >> v1:172.21.15.50:6789/0 conn(0x7effa8006210 legacy=0x7effa80086b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:31.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:31.587+0000 7effc559a640 1 --2- 172.21.15.50:0/1328666470 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7effb40039c0 0x7effb4003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:31.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:31.587+0000 7effc559a640 1 --2- 172.21.15.50:0/1328666470 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7effb4004810 0x7effb4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:31.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:31.587+0000 7effc559a640 1 --2- 172.21.15.50:0/1328666470 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7effa80036c0 0x7effb400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:31.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:31.587+0000 7effc559a640 1 -- 172.21.15.50:0/1328666470 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7effc80ca6b0 con 0x7effb4004810 2024-04-01T01:55:31.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:31.587+0000 7effc559a640 1 -- 172.21.15.50:0/1328666470 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7effb4005550 con 0x7effb40039c0 2024-04-01T01:55:31.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:31.587+0000 7effc559a640 1 -- 172.21.15.50:0/1328666470 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7effb400bf10 con 0x7effa80036c0 2024-04-01T01:55:31.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:31.587+0000 7effc6d9d640 1 -- 172.21.15.50:0/1328666470 reap_dead start 2024-04-01T01:55:31.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:31.587+0000 7effc659c640 1 --2- 172.21.15.50:0/1328666470 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7effb40039c0 0x7effb4003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:31.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:31.587+0000 7effc5d9b640 1 --2- 172.21.15.50:0/1328666470 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7effb4004810 0x7effb4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:31.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:31.587+0000 7effc6d9d640 1 --2- 172.21.15.50:0/1328666470 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7effa80036c0 0x7effb400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:31.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:31.591+0000 7effc5d9b640 1 -- 172.21.15.50:0/1328666470 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7effa80036c0 msgr2=0x7effb400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:55:31.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:31.591+0000 7effc5d9b640 1 --2- 172.21.15.50:0/1328666470 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7effa80036c0 0x7effb400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:31.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:31.591+0000 7effc5d9b640 1 -- 172.21.15.50:0/1328666470 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7effb40039c0 msgr2=0x7effb4003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:55:31.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:31.591+0000 7effc5d9b640 1 --2- 172.21.15.50:0/1328666470 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7effb40039c0 0x7effb4003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:31.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:31.591+0000 7effc5d9b640 1 -- 172.21.15.50:0/1328666470 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effc815a420 con 0x7effb4004810 2024-04-01T01:55:31.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:31.599+0000 7effc5d9b640 1 --2- 172.21.15.50:0/1328666470 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7effb4004810 0x7effb4004c90 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7effa8009df0 tx=0x7effb001d890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90dddddfe8ae22e4 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:31.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:31.599+0000 7effc559a640 1 -- 172.21.15.50:0/1328666470 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effb00ac070 con 0x7effb4004810 2024-04-01T01:55:31.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:31.599+0000 7effc559a640 1 -- 172.21.15.50:0/1328666470 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effb00a6740 con 0x7effb4004810 2024-04-01T01:55:31.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:31.599+0000 7effc559a640 1 -- 172.21.15.50:0/1328666470 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effb000eca0 con 0x7effb4004810 2024-04-01T01:55:31.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:31.599+0000 7effcce36640 1 -- 172.21.15.50:0/1328666470 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7effb4004810 msgr2=0x7effb4004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:31.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:31.599+0000 7effcce36640 1 --2- 172.21.15.50:0/1328666470 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7effb4004810 0x7effb4004c90 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7effa8009df0 tx=0x7effb001d890 comp rx=0 tx=0).stop 2024-04-01T01:55:31.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:31.599+0000 7effcce36640 1 -- 172.21.15.50:0/1328666470 shutdown_connections 2024-04-01T01:55:31.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:31.599+0000 7effcce36640 1 --2- 172.21.15.50:0/1328666470 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7effa80036c0 0x7effb400b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:31.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:31.599+0000 7effcce36640 1 --2- 172.21.15.50:0/1328666470 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7effb4004810 0x7effb4004c90 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:31.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:31.599+0000 7effcce36640 1 --2- 172.21.15.50:0/1328666470 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7effb40039c0 0x7effb4003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:31.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:31.599+0000 7effcce36640 1 -- 172.21.15.50:0/1328666470 >> 172.21.15.50:0/1328666470 conn(0x7effc806c930 msgr2=0x7effc806ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:55:31.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:31.599+0000 7effcce36640 1 -- 172.21.15.50:0/1328666470 shutdown_connections 2024-04-01T01:55:31.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:31.599+0000 7effcce36640 1 -- 172.21.15.50:0/1328666470 wait complete. 2024-04-01T01:55:31.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:31.603+0000 7effcce36640 1 Processor -- start 2024-04-01T01:55:31.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:31.603+0000 7effcce36640 1 -- start start 2024-04-01T01:55:31.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:31.603+0000 7effcce36640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7effa80036c0 0x7effc81f2c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:31.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:31.603+0000 7effcce36640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7effb40039c0 0x7effc81e4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:31.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:31.603+0000 7effcce36640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7effb4004810 0x7effc81e2800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:31.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:31.603+0000 7effcce36640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7effc815acc0 con 0x7effb4004810 2024-04-01T01:55:31.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:31.603+0000 7effcce36640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7effc815a9e0 con 0x7effb40039c0 2024-04-01T01:55:31.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:31.603+0000 7effcce36640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7effc815d450 con 0x7effa80036c0 2024-04-01T01:55:31.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:31.603+0000 7effc6d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7effb4004810 0x7effc81e2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:31.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:31.603+0000 7effc659c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7effa80036c0 0x7effc81f2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:31.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:31.603+0000 7effc5d9b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7effb40039c0 0x7effc81e4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:31.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:31.603+0000 7effc659c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7effa80036c0 0x7effc81f2c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.50:45666/0 (socket says 172.21.15.50:45666) 2024-04-01T01:55:31.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:31.603+0000 7effc659c640 1 -- 172.21.15.50:0/440958911 learned_addr learned my addr 172.21.15.50:0/440958911 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T01:55:31.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:31.603+0000 7effc5d9b640 1 --2- 172.21.15.50:0/440958911 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7effb40039c0 0x7effc81e4f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.50:58958/0 (socket says 172.21.15.50:58958) 2024-04-01T01:55:31.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:31.603+0000 7effc5d9b640 1 -- 172.21.15.50:0/440958911 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7effa80036c0 msgr2=0x7effc81f2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:31.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:31.603+0000 7effc5d9b640 1 --2- 172.21.15.50:0/440958911 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7effa80036c0 0x7effc81f2c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:31.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:31.603+0000 7effc5d9b640 1 -- 172.21.15.50:0/440958911 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7effb4004810 msgr2=0x7effc81e2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:31.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:31.603+0000 7effc5d9b640 1 --2- 172.21.15.50:0/440958911 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7effb4004810 0x7effc81e2800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:31.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:31.603+0000 7effc5d9b640 1 -- 172.21.15.50:0/440958911 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effc81e3220 con 0x7effb40039c0 2024-04-01T01:55:31.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:31.603+0000 7effc659c640 1 --2- 172.21.15.50:0/440958911 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7effa80036c0 0x7effc81f2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T01:55:31.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:31.603+0000 7effc5d9b640 1 --2- 172.21.15.50:0/440958911 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7effb40039c0 0x7effc81e4f60 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7effb00ae000 tx=0x7effb001a690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:31.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:31.603+0000 7effbeffd640 1 -- 172.21.15.50:0/440958911 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effb00ac040 con 0x7effb40039c0 2024-04-01T01:55:31.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:31.603+0000 7effbeffd640 1 -- 172.21.15.50:0/440958911 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effb000ec80 con 0x7effb40039c0 2024-04-01T01:55:31.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:31.603+0000 7effbeffd640 1 -- 172.21.15.50:0/440958911 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effb00bb6c0 con 0x7effb40039c0 2024-04-01T01:55:31.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:31.603+0000 7effcce36640 1 -- 172.21.15.50:0/440958911 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effc81e3500 con 0x7effb40039c0 2024-04-01T01:55:31.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:31.603+0000 7effcce36640 1 -- 172.21.15.50:0/440958911 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effc81efbb0 con 0x7effb40039c0 2024-04-01T01:55:31.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:31.603+0000 7effbeffd640 1 -- 172.21.15.50:0/440958911 <== mon.1 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7effb00c2060 con 0x7effb40039c0 2024-04-01T01:55:31.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:31.603+0000 7effbeffd640 1 -- 172.21.15.50:0/440958911 <== mon.1 v2:172.21.15.97:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7effb00b8410 con 0x7effb40039c0 2024-04-01T01:55:31.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:31.603+0000 7effcce36640 1 -- 172.21.15.50:0/440958911 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effc81ef6c0 con 0x7effb40039c0 2024-04-01T01:55:31.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:31.607+0000 7effbeffd640 1 -- 172.21.15.50:0/440958911 <== mon.1 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7effb00dbdd0 con 0x7effb40039c0 2024-04-01T01:55:31.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:31.675+0000 7effcce36640 1 -- 172.21.15.50:0/440958911 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7effc8068230 con 0x7effb40039c0 2024-04-01T01:55:31.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:31.687+0000 7effbeffd640 1 -- 172.21.15.50:0/440958911 <== mon.1 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7effb00ca070 con 0x7effb40039c0 2024-04-01T01:55:31.687 INFO:teuthology.orchestra.run.smithi050.stderr:adjusted tunables profile to default 2024-04-01T01:55:31.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:31.687+0000 7effcce36640 1 -- 172.21.15.50:0/440958911 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7effb40039c0 msgr2=0x7effc81e4f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:31.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:31.687+0000 7effcce36640 1 --2- 172.21.15.50:0/440958911 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7effb40039c0 0x7effc81e4f60 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7effb00ae000 tx=0x7effb001a690 comp rx=0 tx=0).stop 2024-04-01T01:55:31.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:31.687+0000 7effcce36640 1 -- 172.21.15.50:0/440958911 shutdown_connections 2024-04-01T01:55:31.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:31.687+0000 7effcce36640 1 --2- 172.21.15.50:0/440958911 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7effb4004810 0x7effc81e2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:31.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:31.687+0000 7effcce36640 1 --2- 172.21.15.50:0/440958911 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7effb40039c0 0x7effc81e4f60 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:31.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:31.687+0000 7effcce36640 1 --2- 172.21.15.50:0/440958911 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7effa80036c0 0x7effc81f2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:31.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:31.687+0000 7effcce36640 1 -- 172.21.15.50:0/440958911 >> 172.21.15.50:0/440958911 conn(0x7effc806c930 msgr2=0x7effc8158bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:55:31.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:31.687+0000 7effcce36640 1 -- 172.21.15.50:0/440958911 shutdown_connections 2024-04-01T01:55:31.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:31.687+0000 7effcce36640 1 -- 172.21.15.50:0/440958911 wait complete. 2024-04-01T01:55:31.708 INFO:tasks.ceph:check_enable_crimson: False 2024-04-01T01:55:31.708 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-01T01:55:31.709 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-04-01T01:55:31.709 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-01T01:55:31.721 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-04-01T01:55:31.721 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-01T01:55:31.772 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-04-01T01:55:31.773 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-01T01:55:31.791 INFO:tasks.ceph.mgr.x.smithi097.stderr:2024-04-01T01:55:31.790+0000 7f9de3d9c180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-01T01:55:31.825 INFO:tasks.ceph.mgr.y.smithi050.stderr:2024-04-01T01:55:31.823+0000 7fdaac2f8180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-01T01:55:31.825 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-04-01T01:55:31.825 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-01T01:55:31.885 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-04-01T01:55:31.885 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-04-01T01:55:31.898 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-04-01T01:55:31.898 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-04-01T01:55:31.951 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-04-01T01:55:31.951 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-04-01T01:55:32.007 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-04-01T01:55:32.007 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-04-01T01:55:32.063 DEBUG:teuthology.orchestra.run.smithi097:> sudo ceph --cluster ceph osd new 81e8ca4f-bde8-419a-875f-73a1f4a641ad 0 2024-04-01T01:55:32.223 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.222+0000 7fa195e73640 1 Processor -- start 2024-04-01T01:55:32.223 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.222+0000 7fa195e73640 1 -- start start 2024-04-01T01:55:32.224 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.222+0000 7fa195e73640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa190154460 0x7fa19006cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:32.224 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.222+0000 7fa195e73640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fa1900c20e0 0x7fa1900c6940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:32.224 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.222+0000 7fa195e73640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa19015d730 con 0x7fa1900c1c80 2024-04-01T01:55:32.224 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.222+0000 7fa195e73640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fa19015d4e0 con 0x7fa1900c20e0 2024-04-01T01:55:32.224 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.222+0000 7fa195e73640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fa19015da10 con 0x7fa190154460 2024-04-01T01:55:32.224 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.226+0000 7fa18f7fe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa190154460 0x7fa19006cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:32.225 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.226+0000 7fa18ffff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fa1900c20e0 0x7fa1900c6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:32.225 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.226+0000 7fa18f7fe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa190154460 0x7fa19006cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:59206/0 (socket says 172.21.15.97:59206) 2024-04-01T01:55:32.225 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.226+0000 7fa18f7fe640 1 -- 172.21.15.97:0/2477874395 learned_addr learned my addr 172.21.15.97:0/2477874395 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-04-01T01:55:32.225 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.226+0000 7fa18effd640 1 --1- 172.21.15.97:0/2477874395 >> v1:172.21.15.97:6789/0 conn(0x7fa1900c1c80 0x7fa19006be50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:42814/0 (socket says 172.21.15.97:42814) 2024-04-01T01:55:32.225 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.226+0000 7fa18f7fe640 1 -- 172.21.15.97:0/2477874395 >> v2:172.21.15.97:3300/0 conn(0x7fa1900c20e0 msgr2=0x7fa1900c6940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:55:32.225 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.226+0000 7fa18f7fe640 1 --2- 172.21.15.97:0/2477874395 >> v2:172.21.15.97:3300/0 conn(0x7fa1900c20e0 0x7fa1900c6940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:32.225 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.226+0000 7fa18f7fe640 1 -- 172.21.15.97:0/2477874395 >> v1:172.21.15.97:6789/0 conn(0x7fa1900c1c80 legacy=0x7fa19006be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:32.225 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.226+0000 7fa18f7fe640 1 -- 172.21.15.97:0/2477874395 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa19015dcf0 con 0x7fa190154460 2024-04-01T01:55:32.225 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.226+0000 7fa18ffff640 1 --2- 172.21.15.97:0/2477874395 >> v2:172.21.15.97:3300/0 conn(0x7fa1900c20e0 0x7fa1900c6940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T01:55:32.227 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.226+0000 7fa18f7fe640 1 --2- 172.21.15.97:0/2477874395 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa190154460 0x7fa19006cc30 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa180009870 tx=0x7fa18001c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de6ee1fb09b4384 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:32.227 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.226+0000 7fa18e7fc640 1 -- 172.21.15.97:0/2477874395 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1800a9640 con 0x7fa190154460 2024-04-01T01:55:32.227 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.226+0000 7fa18e7fc640 1 -- 172.21.15.97:0/2477874395 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1800a97e0 con 0x7fa190154460 2024-04-01T01:55:32.227 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.226+0000 7fa18e7fc640 1 -- 172.21.15.97:0/2477874395 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1800a9bb0 con 0x7fa190154460 2024-04-01T01:55:32.228 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.230+0000 7fa195e73640 1 -- 172.21.15.97:0/2477874395 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa190154460 msgr2=0x7fa19006cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:32.228 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.230+0000 7fa195e73640 1 --2- 172.21.15.97:0/2477874395 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa190154460 0x7fa19006cc30 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa180009870 tx=0x7fa18001c560 comp rx=0 tx=0).stop 2024-04-01T01:55:32.228 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.230+0000 7fa195e73640 1 -- 172.21.15.97:0/2477874395 shutdown_connections 2024-04-01T01:55:32.228 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.230+0000 7fa195e73640 1 --2- 172.21.15.97:0/2477874395 >> v2:172.21.15.97:3300/0 conn(0x7fa1900c20e0 0x7fa1900c6940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:32.228 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.230+0000 7fa195e73640 1 --2- 172.21.15.97:0/2477874395 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa190154460 0x7fa19006cc30 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:32.229 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.230+0000 7fa195e73640 1 -- 172.21.15.97:0/2477874395 >> 172.21.15.97:0/2477874395 conn(0x7fa1900c8890 msgr2=0x7fa1900c8ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:55:32.229 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.230+0000 7fa195e73640 1 -- 172.21.15.97:0/2477874395 shutdown_connections 2024-04-01T01:55:32.229 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.230+0000 7fa195e73640 1 -- 172.21.15.97:0/2477874395 wait complete. 2024-04-01T01:55:32.229 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.230+0000 7fa195e73640 1 Processor -- start 2024-04-01T01:55:32.229 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.230+0000 7fa195e73640 1 -- start start 2024-04-01T01:55:32.231 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.230+0000 7fa195e73640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1900c1c80 0x7fa1901f47d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:32.231 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.230+0000 7fa195e73640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa1900c20e0 0x7fa190155880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:32.232 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.230+0000 7fa195e73640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa190154460 0x7fa1901566a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:32.232 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.230+0000 7fa195e73640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa1900c24f0 con 0x7fa1900c1c80 2024-04-01T01:55:32.232 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.230+0000 7fa195e73640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fa19006c770 con 0x7fa1900c20e0 2024-04-01T01:55:32.232 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.230+0000 7fa195e73640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fa190167070 con 0x7fa190154460 2024-04-01T01:55:32.232 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.230+0000 7fa18ffff640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa190154460 0x7fa1901566a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:32.232 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.230+0000 7fa18effd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa1900c20e0 0x7fa190155880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:32.232 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.230+0000 7fa18ffff640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa190154460 0x7fa1901566a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:59218/0 (socket says 172.21.15.97:59218) 2024-04-01T01:55:32.232 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.230+0000 7fa18ffff640 1 -- 172.21.15.97:0/700041152 learned_addr learned my addr 172.21.15.97:0/700041152 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-04-01T01:55:32.232 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.230+0000 7fa18f7fe640 1 --2- 172.21.15.97:0/700041152 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1900c1c80 0x7fa1901f47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:32.232 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.230+0000 7fa18ffff640 1 -- 172.21.15.97:0/700041152 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa1900c20e0 msgr2=0x7fa190155880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:32.232 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.230+0000 7fa18ffff640 1 --2- 172.21.15.97:0/700041152 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa1900c20e0 0x7fa190155880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:32.232 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.230+0000 7fa18ffff640 1 -- 172.21.15.97:0/700041152 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1900c1c80 msgr2=0x7fa1901f47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:32.232 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.230+0000 7fa18ffff640 1 --2- 172.21.15.97:0/700041152 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1900c1c80 0x7fa1901f47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:32.233 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.230+0000 7fa18ffff640 1 -- 172.21.15.97:0/700041152 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1901573a0 con 0x7fa190154460 2024-04-01T01:55:32.233 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.230+0000 7fa18ffff640 1 --2- 172.21.15.97:0/700041152 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa190154460 0x7fa1901566a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa188009f00 tx=0x7fa18800c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:32.233 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.230+0000 7fa177fff640 1 -- 172.21.15.97:0/700041152 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa188018030 con 0x7fa190154460 2024-04-01T01:55:32.233 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.230+0000 7fa177fff640 1 -- 172.21.15.97:0/700041152 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa18800ce50 con 0x7fa190154460 2024-04-01T01:55:32.233 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.230+0000 7fa177fff640 1 -- 172.21.15.97:0/700041152 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa188003bc0 con 0x7fa190154460 2024-04-01T01:55:32.233 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.230+0000 7fa195e73640 1 -- 172.21.15.97:0/700041152 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa190157640 con 0x7fa190154460 2024-04-01T01:55:32.233 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.234+0000 7fa195e73640 1 -- 172.21.15.97:0/700041152 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa190155080 con 0x7fa190154460 2024-04-01T01:55:32.233 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.234+0000 7fa177fff640 1 -- 172.21.15.97:0/700041152 <== mon.2 v2:172.21.15.97:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa18801b070 con 0x7fa190154460 2024-04-01T01:55:32.233 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.234+0000 7fa177fff640 1 -- 172.21.15.97:0/700041152 <== mon.2 v2:172.21.15.97:3301/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7fa18801d910 con 0x7fa190154460 2024-04-01T01:55:32.233 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.234+0000 7fa195e73640 1 -- 172.21.15.97:0/700041152 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa190068940 con 0x7fa190154460 2024-04-01T01:55:32.234 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.234+0000 7fa177fff640 1 -- 172.21.15.97:0/700041152 <== mon.2 v2:172.21.15.97:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fa188022070 con 0x7fa190154460 2024-04-01T01:55:32.241 INFO:tasks.ceph.mgr.x.smithi097.stderr:2024-04-01T01:55:32.242+0000 7f9de3d9c180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-01T01:55:32.289 INFO:tasks.ceph.mgr.y.smithi050.stderr:2024-04-01T01:55:32.287+0000 7fdaac2f8180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-01T01:55:32.303 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.302+0000 7fa195e73640 1 -- 172.21.15.97:0/700041152 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "osd new", "uuid": "81e8ca4f-bde8-419a-875f-73a1f4a641ad", "id": 0} v 0) -- 0x7fa1900c2b70 con 0x7fa190154460 2024-04-01T01:55:32.310 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.310+0000 7fa177fff640 1 -- 172.21.15.97:0/700041152 <== mon.2 v2:172.21.15.97:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "81e8ca4f-bde8-419a-875f-73a1f4a641ad", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7fa188010040 con 0x7fa190154460 2024-04-01T01:55:32.310 INFO:teuthology.orchestra.run.smithi097.stdout:0 2024-04-01T01:55:32.311 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.310+0000 7fa195e73640 1 -- 172.21.15.97:0/700041152 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa190154460 msgr2=0x7fa1901566a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:32.311 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.310+0000 7fa195e73640 1 --2- 172.21.15.97:0/700041152 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa190154460 0x7fa1901566a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa188009f00 tx=0x7fa18800c490 comp rx=0 tx=0).stop 2024-04-01T01:55:32.312 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.310+0000 7fa195e73640 1 -- 172.21.15.97:0/700041152 shutdown_connections 2024-04-01T01:55:32.312 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.310+0000 7fa195e73640 1 --2- 172.21.15.97:0/700041152 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa190154460 0x7fa1901566a0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:32.312 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.310+0000 7fa195e73640 1 --2- 172.21.15.97:0/700041152 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa1900c20e0 0x7fa190155880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:32.312 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.310+0000 7fa195e73640 1 --2- 172.21.15.97:0/700041152 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1900c1c80 0x7fa1901f47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:32.312 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.310+0000 7fa195e73640 1 -- 172.21.15.97:0/700041152 >> 172.21.15.97:0/700041152 conn(0x7fa1900c8890 msgr2=0x7fa190153af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:55:32.312 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.310+0000 7fa195e73640 1 -- 172.21.15.97:0/700041152 shutdown_connections 2024-04-01T01:55:32.312 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.310+0000 7fa195e73640 1 -- 172.21.15.97:0/700041152 wait complete. 2024-04-01T01:55:32.326 DEBUG:teuthology.orchestra.run.smithi097:> sudo ceph --cluster ceph osd new bd060ca0-7559-4d30-987c-62e59818431d 1 2024-04-01T01:55:32.417 INFO:tasks.ceph.mgr.x.smithi097.stderr:2024-04-01T01:55:32.418+0000 7f9de3d9c180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-01T01:55:32.443 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.442+0000 7fe7b698f640 1 Processor -- start 2024-04-01T01:55:32.444 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.442+0000 7fe7b698f640 1 -- start start 2024-04-01T01:55:32.445 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.446+0000 7fe7b698f640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe7b015ae20 0x7fe7b00c6790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:32.445 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.446+0000 7fe7b698f640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe7b0072c40 0x7fe7b0073090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:32.445 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.446+0000 7fe7b698f640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7b00b1a70 con 0x7fe7b0150e50 2024-04-01T01:55:32.445 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.446+0000 7fe7b698f640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fe7b00c6cd0 con 0x7fe7b015ae20 2024-04-01T01:55:32.445 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.446+0000 7fe7b698f640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fe7b015a990 con 0x7fe7b0072c40 2024-04-01T01:55:32.445 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.446+0000 7fe7b4f2c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe7b0072c40 0x7fe7b0073090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:32.445 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.446+0000 7fe7af7fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe7b015ae20 0x7fe7b00c6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:32.446 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.446+0000 7fe7b4f2c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe7b0072c40 0x7fe7b0073090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:59220/0 (socket says 172.21.15.97:59220) 2024-04-01T01:55:32.446 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.446+0000 7fe7b4f2c640 1 -- 172.21.15.97:0/2367311768 learned_addr learned my addr 172.21.15.97:0/2367311768 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-04-01T01:55:32.446 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.446+0000 7fe7af7fe640 1 --2- 172.21.15.97:0/2367311768 >> v2:172.21.15.97:3300/0 conn(0x7fe7b015ae20 0x7fe7b00c6790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:51644/0 (socket says 172.21.15.97:51644) 2024-04-01T01:55:32.446 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.446+0000 7fe7af7fe640 1 -- 172.21.15.97:0/2367311768 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe7b0072c40 msgr2=0x7fe7b0073090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:55:32.446 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.446+0000 7fe7af7fe640 1 --2- 172.21.15.97:0/2367311768 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe7b0072c40 0x7fe7b0073090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:32.446 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.446+0000 7fe7af7fe640 1 -- 172.21.15.97:0/2367311768 >> v1:172.21.15.50:6789/0 conn(0x7fe7b0150e50 legacy=0x7fe7b00c7f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:32.446 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.446+0000 7fe7af7fe640 1 -- 172.21.15.97:0/2367311768 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7b00b1d10 con 0x7fe7b015ae20 2024-04-01T01:55:32.446 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.446+0000 7fe7b4f2c640 1 --2- 172.21.15.97:0/2367311768 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe7b0072c40 0x7fe7b0073090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T01:55:32.447 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.446+0000 7fe7af7fe640 1 --2- 172.21.15.97:0/2367311768 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe7b015ae20 0x7fe7b00c6790 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fe7a40097c0 tx=0x7fe7a401ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d8e07a598fa4315 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:32.447 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.446+0000 7fe7aeffd640 1 -- 172.21.15.97:0/2367311768 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7a40b5070 con 0x7fe7b015ae20 2024-04-01T01:55:32.447 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.446+0000 7fe7aeffd640 1 -- 172.21.15.97:0/2367311768 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7a40a8990 con 0x7fe7b015ae20 2024-04-01T01:55:32.448 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.446+0000 7fe7aeffd640 1 -- 172.21.15.97:0/2367311768 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7a40a8d60 con 0x7fe7b015ae20 2024-04-01T01:55:32.448 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.450+0000 7fe7b698f640 1 -- 172.21.15.97:0/2367311768 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe7b015ae20 msgr2=0x7fe7b00c6790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:32.448 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.450+0000 7fe7b698f640 1 --2- 172.21.15.97:0/2367311768 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe7b015ae20 0x7fe7b00c6790 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fe7a40097c0 tx=0x7fe7a401ec90 comp rx=0 tx=0).stop 2024-04-01T01:55:32.449 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.450+0000 7fe7b698f640 1 -- 172.21.15.97:0/2367311768 shutdown_connections 2024-04-01T01:55:32.449 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.450+0000 7fe7b698f640 1 --2- 172.21.15.97:0/2367311768 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe7b0072c40 0x7fe7b0073090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:32.449 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.450+0000 7fe7b698f640 1 --2- 172.21.15.97:0/2367311768 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe7b015ae20 0x7fe7b00c6790 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:32.449 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.450+0000 7fe7b698f640 1 -- 172.21.15.97:0/2367311768 >> 172.21.15.97:0/2367311768 conn(0x7fe7b00c8890 msgr2=0x7fe7b00c8ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:55:32.449 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.450+0000 7fe7b698f640 1 -- 172.21.15.97:0/2367311768 shutdown_connections 2024-04-01T01:55:32.449 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.450+0000 7fe7b698f640 1 -- 172.21.15.97:0/2367311768 wait complete. 2024-04-01T01:55:32.449 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.450+0000 7fe7b698f640 1 Processor -- start 2024-04-01T01:55:32.449 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.450+0000 7fe7b698f640 1 -- start start 2024-04-01T01:55:32.452 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.450+0000 7fe7b698f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7b0072c40 0x7fe7b01ee420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:32.452 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.450+0000 7fe7b698f640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe7b0150e50 0x7fe7b014a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:32.452 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.450+0000 7fe7b698f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe7b015ae20 0x7fe7b0142430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:32.452 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.450+0000 7fe7b698f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe7b00c8630 con 0x7fe7b0072c40 2024-04-01T01:55:32.452 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.450+0000 7fe7b698f640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fe7b015a620 con 0x7fe7b015ae20 2024-04-01T01:55:32.452 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.450+0000 7fe7b698f640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fe7b00b16c0 con 0x7fe7b0150e50 2024-04-01T01:55:32.452 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.450+0000 7fe7af7fe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe7b0150e50 0x7fe7b014a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:32.452 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.450+0000 7fe7b4f2c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe7b015ae20 0x7fe7b0142430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:32.452 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.450+0000 7fe7af7fe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe7b0150e50 0x7fe7b014a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:59226/0 (socket says 172.21.15.97:59226) 2024-04-01T01:55:32.452 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.450+0000 7fe7af7fe640 1 -- 172.21.15.97:0/3521187131 learned_addr learned my addr 172.21.15.97:0/3521187131 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-04-01T01:55:32.452 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.450+0000 7fe7affff640 1 --2- 172.21.15.97:0/3521187131 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7b0072c40 0x7fe7b01ee420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:32.452 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.450+0000 7fe7af7fe640 1 -- 172.21.15.97:0/3521187131 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe7b015ae20 msgr2=0x7fe7b0142430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:32.453 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.450+0000 7fe7af7fe640 1 --2- 172.21.15.97:0/3521187131 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe7b015ae20 0x7fe7b0142430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:32.453 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.450+0000 7fe7af7fe640 1 -- 172.21.15.97:0/3521187131 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7b0072c40 msgr2=0x7fe7b01ee420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:32.453 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.450+0000 7fe7af7fe640 1 --2- 172.21.15.97:0/3521187131 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7b0072c40 0x7fe7b01ee420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:32.453 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.450+0000 7fe7af7fe640 1 -- 172.21.15.97:0/3521187131 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7b0148950 con 0x7fe7b0150e50 2024-04-01T01:55:32.453 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.450+0000 7fe7af7fe640 1 --2- 172.21.15.97:0/3521187131 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe7b0150e50 0x7fe7b014a990 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe7a401c8c0 tx=0x7fe7a401ba30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:32.453 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.450+0000 7fe7acff9640 1 -- 172.21.15.97:0/3521187131 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7a40bf070 con 0x7fe7b0150e50 2024-04-01T01:55:32.453 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.450+0000 7fe7acff9640 1 -- 172.21.15.97:0/3521187131 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7a40b0720 con 0x7fe7b0150e50 2024-04-01T01:55:32.453 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.450+0000 7fe7acff9640 1 -- 172.21.15.97:0/3521187131 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7a40b5040 con 0x7fe7b0150e50 2024-04-01T01:55:32.453 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.450+0000 7fe7b698f640 1 -- 172.21.15.97:0/3521187131 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7b01583f0 con 0x7fe7b0150e50 2024-04-01T01:55:32.453 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.450+0000 7fe7b698f640 1 -- 172.21.15.97:0/3521187131 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7b0157e30 con 0x7fe7b0150e50 2024-04-01T01:55:32.453 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.450+0000 7fe7acff9640 1 -- 172.21.15.97:0/3521187131 <== mon.2 v2:172.21.15.97:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe7a40c2070 con 0x7fe7b0150e50 2024-04-01T01:55:32.453 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.450+0000 7fe7acff9640 1 -- 172.21.15.97:0/3521187131 <== mon.2 v2:172.21.15.97:3301/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7fe7a40c4ba0 con 0x7fe7b0150e50 2024-04-01T01:55:32.453 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.454+0000 7fe7b698f640 1 -- 172.21.15.97:0/3521187131 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7b0068940 con 0x7fe7b0150e50 2024-04-01T01:55:32.454 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.454+0000 7fe7acff9640 1 -- 172.21.15.97:0/3521187131 <== mon.2 v2:172.21.15.97:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fe7a40c9070 con 0x7fe7b0150e50 2024-04-01T01:55:32.482 INFO:tasks.ceph.mgr.y.smithi050.stderr:2024-04-01T01:55:32.479+0000 7fdaac2f8180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-01T01:55:32.523 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.522+0000 7fe7b698f640 1 -- 172.21.15.97:0/3521187131 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "osd new", "uuid": "bd060ca0-7559-4d30-987c-62e59818431d", "id": 1} v 0) -- 0x7fe7b006cce0 con 0x7fe7b0150e50 2024-04-01T01:55:32.527 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.526+0000 7fe7acff9640 1 -- 172.21.15.97:0/3521187131 <== mon.2 v2:172.21.15.97:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "bd060ca0-7559-4d30-987c-62e59818431d", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7fe7a40187f0 con 0x7fe7b0150e50 2024-04-01T01:55:32.528 INFO:teuthology.orchestra.run.smithi097.stdout:1 2024-04-01T01:55:32.529 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.530+0000 7fe7b698f640 1 -- 172.21.15.97:0/3521187131 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe7b0150e50 msgr2=0x7fe7b014a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:32.529 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.530+0000 7fe7b698f640 1 --2- 172.21.15.97:0/3521187131 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe7b0150e50 0x7fe7b014a990 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe7a401c8c0 tx=0x7fe7a401ba30 comp rx=0 tx=0).stop 2024-04-01T01:55:32.529 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.530+0000 7fe7b698f640 1 -- 172.21.15.97:0/3521187131 shutdown_connections 2024-04-01T01:55:32.529 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.530+0000 7fe7b698f640 1 --2- 172.21.15.97:0/3521187131 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe7b015ae20 0x7fe7b0142430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:32.529 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.530+0000 7fe7b698f640 1 --2- 172.21.15.97:0/3521187131 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe7b0150e50 0x7fe7b014a990 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:32.529 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.530+0000 7fe7b698f640 1 --2- 172.21.15.97:0/3521187131 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7b0072c40 0x7fe7b01ee420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:32.529 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.530+0000 7fe7b698f640 1 -- 172.21.15.97:0/3521187131 >> 172.21.15.97:0/3521187131 conn(0x7fe7b00c8890 msgr2=0x7fe7b014beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:55:32.529 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.530+0000 7fe7b698f640 1 -- 172.21.15.97:0/3521187131 shutdown_connections 2024-04-01T01:55:32.529 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.530+0000 7fe7b698f640 1 -- 172.21.15.97:0/3521187131 wait complete. 2024-04-01T01:55:32.544 DEBUG:teuthology.orchestra.run.smithi097:> sudo ceph --cluster ceph osd new eac5d816-a281-4acd-aa7d-b96a8e0aa962 2 2024-04-01T01:55:32.658 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.658+0000 7fc25d044640 1 Processor -- start 2024-04-01T01:55:32.659 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.658+0000 7fc25d044640 1 -- start start 2024-04-01T01:55:32.660 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.658+0000 7fc25d044640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc2581544d0 0x7fc25806b220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:32.660 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.658+0000 7fc25d044640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fc25806b760 0x7fc25806be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:32.660 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.658+0000 7fc25d044640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc25806c3b0 0x7fc25815dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:32.660 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.658+0000 7fc25d044640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fc25815aff0 con 0x7fc25806c3b0 2024-04-01T01:55:32.660 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.658+0000 7fc25d044640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fc25815a470 con 0x7fc25806b760 2024-04-01T01:55:32.660 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.658+0000 7fc25d044640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fc25815a750 con 0x7fc2581544d0 2024-04-01T01:55:32.661 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.658+0000 7fc25659c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fc25806b760 0x7fc25806be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:32.661 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.662+0000 7fc256d9d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc2581544d0 0x7fc25806b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:32.661 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.662+0000 7fc256d9d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc2581544d0 0x7fc25806b220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:59242/0 (socket says 172.21.15.97:59242) 2024-04-01T01:55:32.661 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.662+0000 7fc25659c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fc25806b760 0x7fc25806be70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:51656/0 (socket says 172.21.15.97:51656) 2024-04-01T01:55:32.661 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.662+0000 7fc256d9d640 1 -- 172.21.15.97:0/4198314909 learned_addr learned my addr 172.21.15.97:0/4198314909 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-04-01T01:55:32.661 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.662+0000 7fc25759e640 1 --2- 172.21.15.97:0/4198314909 >> v2:172.21.15.50:3300/0 conn(0x7fc25806c3b0 0x7fc25815dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:32.661 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.662+0000 7fc25659c640 1 -- 172.21.15.97:0/4198314909 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc2581544d0 msgr2=0x7fc25806b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:55:32.661 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.662+0000 7fc25659c640 1 --2- 172.21.15.97:0/4198314909 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc2581544d0 0x7fc25806b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:32.661 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.662+0000 7fc25659c640 1 -- 172.21.15.97:0/4198314909 >> v2:172.21.15.50:3300/0 conn(0x7fc25806c3b0 msgr2=0x7fc25815dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:55:32.661 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.662+0000 7fc25659c640 1 --2- 172.21.15.97:0/4198314909 >> v2:172.21.15.50:3300/0 conn(0x7fc25806c3b0 0x7fc25815dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:32.661 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.662+0000 7fc25659c640 1 -- 172.21.15.97:0/4198314909 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc25815aa30 con 0x7fc25806b760 2024-04-01T01:55:32.662 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.662+0000 7fc256d9d640 1 --2- 172.21.15.97:0/4198314909 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc2581544d0 0x7fc25806b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T01:55:32.663 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.662+0000 7fc25659c640 1 --2- 172.21.15.97:0/4198314909 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc25806b760 0x7fc25806be70 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc258073660 tx=0x7fc24c01c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4499e2b713807add server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:32.664 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.662+0000 7fc255d9b640 1 -- 172.21.15.97:0/4198314909 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc24c0b0070 con 0x7fc25806b760 2024-04-01T01:55:32.664 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.662+0000 7fc255d9b640 1 -- 172.21.15.97:0/4198314909 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc24c0ab600 con 0x7fc25806b760 2024-04-01T01:55:32.664 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.662+0000 7fc255d9b640 1 -- 172.21.15.97:0/4198314909 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc24c0ab9d0 con 0x7fc25806b760 2024-04-01T01:55:32.664 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.662+0000 7fc25d044640 1 -- 172.21.15.97:0/4198314909 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc25806b760 msgr2=0x7fc25806be70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:32.664 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.662+0000 7fc25d044640 1 --2- 172.21.15.97:0/4198314909 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc25806b760 0x7fc25806be70 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc258073660 tx=0x7fc24c01c3c0 comp rx=0 tx=0).stop 2024-04-01T01:55:32.664 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.662+0000 7fc25d044640 1 -- 172.21.15.97:0/4198314909 shutdown_connections 2024-04-01T01:55:32.664 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.662+0000 7fc25d044640 1 --2- 172.21.15.97:0/4198314909 >> v2:172.21.15.50:3300/0 conn(0x7fc25806c3b0 0x7fc25815dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:32.664 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.662+0000 7fc25d044640 1 --2- 172.21.15.97:0/4198314909 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc25806b760 0x7fc25806be70 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:32.664 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.662+0000 7fc25d044640 1 --2- 172.21.15.97:0/4198314909 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc2581544d0 0x7fc25806b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:32.664 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.662+0000 7fc25d044640 1 -- 172.21.15.97:0/4198314909 >> 172.21.15.97:0/4198314909 conn(0x7fc258070030 msgr2=0x7fc2580cbc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:55:32.664 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.662+0000 7fc25d044640 1 -- 172.21.15.97:0/4198314909 shutdown_connections 2024-04-01T01:55:32.664 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.662+0000 7fc25d044640 1 -- 172.21.15.97:0/4198314909 wait complete. 2024-04-01T01:55:32.667 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.666+0000 7fc25d044640 1 Processor -- start 2024-04-01T01:55:32.667 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.666+0000 7fc25d044640 1 -- start start 2024-04-01T01:55:32.667 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.666+0000 7fc25d044640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc25806b760 0x7fc25815cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:32.667 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.666+0000 7fc25d044640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc25806c3b0 0x7fc2581f6460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:32.667 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.666+0000 7fc25d044640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc2581544d0 0x7fc2581f69a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:32.667 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.666+0000 7fc25d044640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc2580c7800 con 0x7fc25806b760 2024-04-01T01:55:32.667 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.666+0000 7fc25d044640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fc25815e5a0 con 0x7fc2581544d0 2024-04-01T01:55:32.667 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.666+0000 7fc25d044640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fc2580c7980 con 0x7fc25806c3b0 2024-04-01T01:55:32.667 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.666+0000 7fc25759e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc2581544d0 0x7fc2581f69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:32.667 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.666+0000 7fc25659c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc25806c3b0 0x7fc2581f6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:32.668 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.666+0000 7fc25659c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc25806c3b0 0x7fc2581f6460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:59258/0 (socket says 172.21.15.97:59258) 2024-04-01T01:55:32.668 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.666+0000 7fc25659c640 1 -- 172.21.15.97:0/2008119231 learned_addr learned my addr 172.21.15.97:0/2008119231 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-04-01T01:55:32.668 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.666+0000 7fc25759e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc2581544d0 0x7fc2581f69a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:51664/0 (socket says 172.21.15.97:51664) 2024-04-01T01:55:32.668 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.666+0000 7fc256d9d640 1 --2- 172.21.15.97:0/2008119231 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc25806b760 0x7fc25815cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:32.668 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.666+0000 7fc25759e640 1 -- 172.21.15.97:0/2008119231 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc25806c3b0 msgr2=0x7fc2581f6460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:32.668 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.666+0000 7fc25759e640 1 --2- 172.21.15.97:0/2008119231 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc25806c3b0 0x7fc2581f6460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:32.668 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.666+0000 7fc25759e640 1 -- 172.21.15.97:0/2008119231 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc25806b760 msgr2=0x7fc25815cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:32.668 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.666+0000 7fc25759e640 1 --2- 172.21.15.97:0/2008119231 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc25806b760 0x7fc25815cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:32.668 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.666+0000 7fc25759e640 1 -- 172.21.15.97:0/2008119231 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc258072b30 con 0x7fc2581544d0 2024-04-01T01:55:32.668 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.666+0000 7fc25659c640 1 --2- 172.21.15.97:0/2008119231 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc25806c3b0 0x7fc2581f6460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T01:55:32.668 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.666+0000 7fc25759e640 1 --2- 172.21.15.97:0/2008119231 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc2581544d0 0x7fc2581f69a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc24800d550 tx=0x7fc24800da10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:32.668 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.666+0000 7fc23f7fe640 1 -- 172.21.15.97:0/2008119231 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc248018020 con 0x7fc2581544d0 2024-04-01T01:55:32.669 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.666+0000 7fc23f7fe640 1 -- 172.21.15.97:0/2008119231 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc248014620 con 0x7fc2581544d0 2024-04-01T01:55:32.669 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.666+0000 7fc25d044640 1 -- 172.21.15.97:0/2008119231 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc258154dd0 con 0x7fc2581544d0 2024-04-01T01:55:32.669 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.666+0000 7fc23f7fe640 1 -- 172.21.15.97:0/2008119231 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2480149f0 con 0x7fc2581544d0 2024-04-01T01:55:32.669 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.666+0000 7fc25d044640 1 -- 172.21.15.97:0/2008119231 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc258156a80 con 0x7fc2581544d0 2024-04-01T01:55:32.669 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.666+0000 7fc23f7fe640 1 -- 172.21.15.97:0/2008119231 <== mon.1 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc24801b020 con 0x7fc2581544d0 2024-04-01T01:55:32.669 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.666+0000 7fc23f7fe640 1 -- 172.21.15.97:0/2008119231 <== mon.1 v2:172.21.15.97:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7fc248012940 con 0x7fc2581544d0 2024-04-01T01:55:32.669 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.666+0000 7fc25d044640 1 -- 172.21.15.97:0/2008119231 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc258068940 con 0x7fc2581544d0 2024-04-01T01:55:32.669 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.670+0000 7fc23f7fe640 1 -- 172.21.15.97:0/2008119231 <== mon.1 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fc248022020 con 0x7fc2581544d0 2024-04-01T01:55:32.737 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.738+0000 7fc25d044640 1 -- 172.21.15.97:0/2008119231 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd new", "uuid": "eac5d816-a281-4acd-aa7d-b96a8e0aa962", "id": 2} v 0) -- 0x7fc2580c14a0 con 0x7fc2581544d0 2024-04-01T01:55:32.741 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.742+0000 7fc23f7fe640 1 -- 172.21.15.97:0/2008119231 <== mon.1 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "eac5d816-a281-4acd-aa7d-b96a8e0aa962", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7fc248012be0 con 0x7fc2581544d0 2024-04-01T01:55:32.741 INFO:teuthology.orchestra.run.smithi097.stdout:2 2024-04-01T01:55:32.742 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.742+0000 7fc25d044640 1 -- 172.21.15.97:0/2008119231 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc2581544d0 msgr2=0x7fc2581f69a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:32.742 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.742+0000 7fc25d044640 1 --2- 172.21.15.97:0/2008119231 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc2581544d0 0x7fc2581f69a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc24800d550 tx=0x7fc24800da10 comp rx=0 tx=0).stop 2024-04-01T01:55:32.742 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.742+0000 7fc25d044640 1 -- 172.21.15.97:0/2008119231 shutdown_connections 2024-04-01T01:55:32.743 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.742+0000 7fc25d044640 1 --2- 172.21.15.97:0/2008119231 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc2581544d0 0x7fc2581f69a0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:32.743 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.742+0000 7fc25d044640 1 --2- 172.21.15.97:0/2008119231 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc25806c3b0 0x7fc2581f6460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:32.743 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.742+0000 7fc25d044640 1 --2- 172.21.15.97:0/2008119231 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc25806b760 0x7fc25815cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:32.743 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.742+0000 7fc25d044640 1 -- 172.21.15.97:0/2008119231 >> 172.21.15.97:0/2008119231 conn(0x7fc258070030 msgr2=0x7fc258148690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:55:32.743 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.742+0000 7fc25d044640 1 -- 172.21.15.97:0/2008119231 shutdown_connections 2024-04-01T01:55:32.743 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.742+0000 7fc25d044640 1 -- 172.21.15.97:0/2008119231 wait complete. 2024-04-01T01:55:32.758 DEBUG:teuthology.orchestra.run.smithi097:> sudo ceph --cluster ceph osd new 12b23968-04a7-40b8-98c4-02b16ae28265 3 2024-04-01T01:55:32.870 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.870+0000 7f1f7b790640 1 Processor -- start 2024-04-01T01:55:32.871 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.870+0000 7f1f7b790640 1 -- start start 2024-04-01T01:55:32.872 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.870+0000 7f1f7b790640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f1f74150830 0x7f1f740c7a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:32.872 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.870+0000 7f1f7b790640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1f740c70d0 0x7f1f740c7f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:32.872 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.874+0000 7f1f7b790640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1f74156d50 0x7f1f740c2420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:32.872 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.874+0000 7f1f7b790640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f1f740b2170 con 0x7f1f740c70d0 2024-04-01T01:55:32.873 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.874+0000 7f1f7b790640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f1f740729a0 con 0x7f1f74150830 2024-04-01T01:55:32.873 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.874+0000 7f1f7b790640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f1f740733d0 con 0x7f1f74156d50 2024-04-01T01:55:32.873 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.874+0000 7f1f7952c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f1f74150830 0x7f1f740c7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:32.873 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.874+0000 7f1f79d2d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1f74156d50 0x7f1f740c2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:32.873 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.874+0000 7f1f79d2d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1f74156d50 0x7f1f740c2420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:59260/0 (socket says 172.21.15.97:59260) 2024-04-01T01:55:32.873 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.874+0000 7f1f7952c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f1f74150830 0x7f1f740c7a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:51678/0 (socket says 172.21.15.97:51678) 2024-04-01T01:55:32.873 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.874+0000 7f1f79d2d640 1 -- 172.21.15.97:0/4247787260 learned_addr learned my addr 172.21.15.97:0/4247787260 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-04-01T01:55:32.873 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.874+0000 7f1f78d2b640 1 --2- 172.21.15.97:0/4247787260 >> v2:172.21.15.50:3300/0 conn(0x7f1f740c70d0 0x7f1f740c7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:32.873 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.874+0000 7f1f7952c640 1 -- 172.21.15.97:0/4247787260 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1f74156d50 msgr2=0x7f1f740c2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:55:32.873 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.874+0000 7f1f7952c640 1 --2- 172.21.15.97:0/4247787260 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1f74156d50 0x7f1f740c2420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:32.873 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.874+0000 7f1f7952c640 1 -- 172.21.15.97:0/4247787260 >> v2:172.21.15.50:3300/0 conn(0x7f1f740c70d0 msgr2=0x7f1f740c7f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:55:32.873 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.874+0000 7f1f7952c640 1 --2- 172.21.15.97:0/4247787260 >> v2:172.21.15.50:3300/0 conn(0x7f1f740c70d0 0x7f1f740c7f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:32.873 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.874+0000 7f1f7952c640 1 -- 172.21.15.97:0/4247787260 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f74072150 con 0x7f1f74150830 2024-04-01T01:55:32.873 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.874+0000 7f1f79d2d640 1 --2- 172.21.15.97:0/4247787260 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1f74156d50 0x7f1f740c2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T01:55:32.874 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.874+0000 7f1f7952c640 1 --2- 172.21.15.97:0/4247787260 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1f74150830 0x7f1f740c7a00 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f1f74071750 tx=0x7f1f7001c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fe9cba784cbd67a3 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:32.874 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.874+0000 7f1f6bfff640 1 -- 172.21.15.97:0/4247787260 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f700b0070 con 0x7f1f74150830 2024-04-01T01:55:32.874 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.874+0000 7f1f6bfff640 1 -- 172.21.15.97:0/4247787260 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f700ab400 con 0x7f1f74150830 2024-04-01T01:55:32.874 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.874+0000 7f1f6bfff640 1 -- 172.21.15.97:0/4247787260 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f700ab7d0 con 0x7f1f74150830 2024-04-01T01:55:32.875 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.874+0000 7f1f7b790640 1 -- 172.21.15.97:0/4247787260 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1f74150830 msgr2=0x7f1f740c7a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:32.875 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.874+0000 7f1f7b790640 1 --2- 172.21.15.97:0/4247787260 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1f74150830 0x7f1f740c7a00 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f1f74071750 tx=0x7f1f7001c480 comp rx=0 tx=0).stop 2024-04-01T01:55:32.876 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.874+0000 7f1f7b790640 1 -- 172.21.15.97:0/4247787260 shutdown_connections 2024-04-01T01:55:32.876 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.874+0000 7f1f7b790640 1 --2- 172.21.15.97:0/4247787260 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1f74156d50 0x7f1f740c2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:32.876 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.874+0000 7f1f7b790640 1 --2- 172.21.15.97:0/4247787260 >> v2:172.21.15.50:3300/0 conn(0x7f1f740c70d0 0x7f1f740c7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:32.876 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.874+0000 7f1f7b790640 1 --2- 172.21.15.97:0/4247787260 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1f74150830 0x7f1f740c7a00 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:32.876 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.874+0000 7f1f7b790640 1 -- 172.21.15.97:0/4247787260 >> 172.21.15.97:0/4247787260 conn(0x7f1f740c8a70 msgr2=0x7f1f740c8e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:55:32.876 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.874+0000 7f1f7b790640 1 -- 172.21.15.97:0/4247787260 shutdown_connections 2024-04-01T01:55:32.876 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.874+0000 7f1f7b790640 1 -- 172.21.15.97:0/4247787260 wait complete. 2024-04-01T01:55:32.876 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.878+0000 7f1f7b790640 1 Processor -- start 2024-04-01T01:55:32.876 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.878+0000 7f1f7b790640 1 -- start start 2024-04-01T01:55:32.878 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.878+0000 7f1f7b790640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1f740c70d0 0x7f1f741f6f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:32.878 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.878+0000 7f1f7b790640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f74150830 0x7f1f74148290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:32.878 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.878+0000 7f1f7b790640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1f74156d50 0x7f1f741412b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:32.879 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.878+0000 7f1f7b790640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f1f74074130 con 0x7f1f74150830 2024-04-01T01:55:32.879 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.878+0000 7f1f7b790640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f1f74073fb0 con 0x7f1f74156d50 2024-04-01T01:55:32.879 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.878+0000 7f1f7b790640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f1f740742b0 con 0x7f1f740c70d0 2024-04-01T01:55:32.879 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.878+0000 7f1f79d2d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1f74156d50 0x7f1f741412b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:32.879 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.878+0000 7f1f79d2d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1f74156d50 0x7f1f741412b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:51688/0 (socket says 172.21.15.97:51688) 2024-04-01T01:55:32.879 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.878+0000 7f1f7952c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1f740c70d0 0x7f1f741f6f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:32.879 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.878+0000 7f1f79d2d640 1 -- 172.21.15.97:0/2450264921 learned_addr learned my addr 172.21.15.97:0/2450264921 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-04-01T01:55:32.879 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.878+0000 7f1f78d2b640 1 --2- 172.21.15.97:0/2450264921 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f74150830 0x7f1f74148290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:32.879 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.878+0000 7f1f79d2d640 1 -- 172.21.15.97:0/2450264921 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1f740c70d0 msgr2=0x7f1f741f6f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:32.879 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.878+0000 7f1f79d2d640 1 --2- 172.21.15.97:0/2450264921 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1f740c70d0 0x7f1f741f6f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:32.879 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.878+0000 7f1f79d2d640 1 -- 172.21.15.97:0/2450264921 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f74150830 msgr2=0x7f1f74148290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:32.879 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.878+0000 7f1f79d2d640 1 --2- 172.21.15.97:0/2450264921 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f74150830 0x7f1f74148290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:32.879 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.878+0000 7f1f79d2d640 1 -- 172.21.15.97:0/2450264921 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f741602c0 con 0x7f1f74156d50 2024-04-01T01:55:32.879 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.878+0000 7f1f79d2d640 1 --2- 172.21.15.97:0/2450264921 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1f74156d50 0x7f1f741412b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c00efc0 tx=0x7f1f6c00c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:32.879 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.878+0000 7f1f69ffb640 1 -- 172.21.15.97:0/2450264921 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f6c00cbe0 con 0x7f1f74156d50 2024-04-01T01:55:32.880 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.878+0000 7f1f69ffb640 1 -- 172.21.15.97:0/2450264921 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f6c00cd80 con 0x7f1f74156d50 2024-04-01T01:55:32.880 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.878+0000 7f1f7b790640 1 -- 172.21.15.97:0/2450264921 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f74160580 con 0x7f1f74156d50 2024-04-01T01:55:32.880 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.878+0000 7f1f69ffb640 1 -- 172.21.15.97:0/2450264921 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f6c003bc0 con 0x7f1f74156d50 2024-04-01T01:55:32.880 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.878+0000 7f1f7b790640 1 -- 172.21.15.97:0/2450264921 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f741f6710 con 0x7f1f74156d50 2024-04-01T01:55:32.880 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.878+0000 7f1f69ffb640 1 -- 172.21.15.97:0/2450264921 <== mon.1 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1f6c01b030 con 0x7f1f74156d50 2024-04-01T01:55:32.880 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.878+0000 7f1f69ffb640 1 -- 172.21.15.97:0/2450264921 <== mon.1 v2:172.21.15.97:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f1f6c01dad0 con 0x7f1f74156d50 2024-04-01T01:55:32.881 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.878+0000 7f1f7b790640 1 -- 172.21.15.97:0/2450264921 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f74068230 con 0x7f1f74156d50 2024-04-01T01:55:32.881 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.882+0000 7f1f69ffb640 1 -- 172.21.15.97:0/2450264921 <== mon.1 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f1f6c022020 con 0x7f1f74156d50 2024-04-01T01:55:32.950 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.950+0000 7f1f7b790640 1 -- 172.21.15.97:0/2450264921 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd new", "uuid": "12b23968-04a7-40b8-98c4-02b16ae28265", "id": 3} v 0) -- 0x7f1f740c61a0 con 0x7f1f74156d50 2024-04-01T01:55:32.955 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.954+0000 7f1f69ffb640 1 -- 172.21.15.97:0/2450264921 <== mon.1 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "12b23968-04a7-40b8-98c4-02b16ae28265", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f1f6c010040 con 0x7f1f74156d50 2024-04-01T01:55:32.955 INFO:teuthology.orchestra.run.smithi097.stdout:3 2024-04-01T01:55:32.956 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.958+0000 7f1f7b790640 1 -- 172.21.15.97:0/2450264921 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1f74156d50 msgr2=0x7f1f741412b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:32.957 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.958+0000 7f1f7b790640 1 --2- 172.21.15.97:0/2450264921 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1f74156d50 0x7f1f741412b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c00efc0 tx=0x7f1f6c00c490 comp rx=0 tx=0).stop 2024-04-01T01:55:32.957 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.958+0000 7f1f7b790640 1 -- 172.21.15.97:0/2450264921 shutdown_connections 2024-04-01T01:55:32.957 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.958+0000 7f1f7b790640 1 --2- 172.21.15.97:0/2450264921 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1f74156d50 0x7f1f741412b0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:32.957 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.958+0000 7f1f7b790640 1 --2- 172.21.15.97:0/2450264921 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f74150830 0x7f1f74148290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:32.957 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.958+0000 7f1f7b790640 1 --2- 172.21.15.97:0/2450264921 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1f740c70d0 0x7f1f741f6f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:32.957 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.958+0000 7f1f7b790640 1 -- 172.21.15.97:0/2450264921 >> 172.21.15.97:0/2450264921 conn(0x7f1f740c8a70 msgr2=0x7f1f7406b220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:55:32.957 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.958+0000 7f1f7b790640 1 -- 172.21.15.97:0/2450264921 shutdown_connections 2024-04-01T01:55:32.957 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:32.958+0000 7f1f7b790640 1 -- 172.21.15.97:0/2450264921 wait complete. 2024-04-01T01:55:32.971 DEBUG:teuthology.orchestra.run.smithi097:> sudo ceph --cluster ceph osd new 0e6b1639-23b0-47d9-8b08-40c8ab6df818 4 2024-04-01T01:55:32.980 INFO:tasks.ceph.mgr.x.smithi097.stderr:2024-04-01T01:55:32.982+0000 7f9de3d9c180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-01T01:55:33.036 INFO:tasks.ceph.mgr.x.smithi097.stderr:2024-04-01T01:55:33.038+0000 7f9de3d9c180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-01T01:55:33.050 INFO:tasks.ceph.mgr.y.smithi050.stderr:2024-04-01T01:55:33.051+0000 7fdaac2f8180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-01T01:55:33.087 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.086+0000 7fa947058640 1 Processor -- start 2024-04-01T01:55:33.087 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.086+0000 7fa947058640 1 -- start start 2024-04-01T01:55:33.089 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.090+0000 7fa947058640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa9400700a0 0x7fa94006b820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:33.089 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.090+0000 7fa947058640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa9400c7450 0x7fa94015d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:33.089 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.090+0000 7fa947058640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fa940070480 0x7fa94015dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:33.089 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.090+0000 7fa947058640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fa94015ad20 con 0x7fa9400700a0 2024-04-01T01:55:33.089 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.090+0000 7fa947058640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fa94015a110 con 0x7fa940070480 2024-04-01T01:55:33.089 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.090+0000 7fa947058640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fa94015a3f0 con 0x7fa9400c7450 2024-04-01T01:55:33.089 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.090+0000 7fa93ffff640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa9400c7450 0x7fa94015d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:33.089 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.090+0000 7fa9455f5640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fa940070480 0x7fa94015dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:33.090 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.090+0000 7fa93ffff640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa9400c7450 0x7fa94015d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:59286/0 (socket says 172.21.15.97:59286) 2024-04-01T01:55:33.090 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.090+0000 7fa93ffff640 1 -- 172.21.15.97:0/1087173254 learned_addr learned my addr 172.21.15.97:0/1087173254 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-04-01T01:55:33.090 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.090+0000 7fa944df4640 1 --2- 172.21.15.97:0/1087173254 >> v2:172.21.15.50:3300/0 conn(0x7fa9400700a0 0x7fa94006b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:33.090 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.090+0000 7fa9455f5640 1 -- 172.21.15.97:0/1087173254 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa9400c7450 msgr2=0x7fa94015d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:55:33.090 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.090+0000 7fa9455f5640 1 --2- 172.21.15.97:0/1087173254 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa9400c7450 0x7fa94015d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:33.090 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.090+0000 7fa9455f5640 1 -- 172.21.15.97:0/1087173254 >> v2:172.21.15.50:3300/0 conn(0x7fa9400700a0 msgr2=0x7fa94006b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:55:33.090 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.090+0000 7fa9455f5640 1 --2- 172.21.15.97:0/1087173254 >> v2:172.21.15.50:3300/0 conn(0x7fa9400700a0 0x7fa94006b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:33.090 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.090+0000 7fa9455f5640 1 -- 172.21.15.97:0/1087173254 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa94015a6d0 con 0x7fa940070480 2024-04-01T01:55:33.090 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.090+0000 7fa93ffff640 1 --2- 172.21.15.97:0/1087173254 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa9400c7450 0x7fa94015d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T01:55:33.090 INFO:tasks.ceph.mgr.x.smithi097.stderr:2024-04-01T01:55:33.090+0000 7f9de3d9c180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-01T01:55:33.092 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.094+0000 7fa9455f5640 1 --2- 172.21.15.97:0/1087173254 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa940070480 0x7fa94015dbd0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa940072d80 tx=0x7fa93801f110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2aea969b72e1cac5 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:33.092 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.094+0000 7fa93f7fe640 1 -- 172.21.15.97:0/1087173254 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9380b5070 con 0x7fa940070480 2024-04-01T01:55:33.092 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.094+0000 7fa93f7fe640 1 -- 172.21.15.97:0/1087173254 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9380b0440 con 0x7fa940070480 2024-04-01T01:55:33.092 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.094+0000 7fa93f7fe640 1 -- 172.21.15.97:0/1087173254 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9380b0810 con 0x7fa940070480 2024-04-01T01:55:33.093 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.094+0000 7fa947058640 1 -- 172.21.15.97:0/1087173254 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa940070480 msgr2=0x7fa94015dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:33.093 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.094+0000 7fa947058640 1 --2- 172.21.15.97:0/1087173254 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa940070480 0x7fa94015dbd0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa940072d80 tx=0x7fa93801f110 comp rx=0 tx=0).stop 2024-04-01T01:55:33.093 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.094+0000 7fa947058640 1 -- 172.21.15.97:0/1087173254 shutdown_connections 2024-04-01T01:55:33.093 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.094+0000 7fa947058640 1 --2- 172.21.15.97:0/1087173254 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa940070480 0x7fa94015dbd0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:33.093 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.094+0000 7fa947058640 1 --2- 172.21.15.97:0/1087173254 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa9400c7450 0x7fa94015d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:33.094 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.094+0000 7fa947058640 1 --2- 172.21.15.97:0/1087173254 >> v2:172.21.15.50:3300/0 conn(0x7fa9400700a0 0x7fa94006b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:33.094 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.094+0000 7fa947058640 1 -- 172.21.15.97:0/1087173254 >> 172.21.15.97:0/1087173254 conn(0x7fa940067560 msgr2=0x7fa9400cc4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:55:33.094 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.094+0000 7fa947058640 1 -- 172.21.15.97:0/1087173254 shutdown_connections 2024-04-01T01:55:33.094 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.094+0000 7fa947058640 1 -- 172.21.15.97:0/1087173254 wait complete. 2024-04-01T01:55:33.094 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.094+0000 7fa947058640 1 Processor -- start 2024-04-01T01:55:33.094 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.094+0000 7fa947058640 1 -- start start 2024-04-01T01:55:33.097 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.094+0000 7fa947058640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9400700a0 0x7fa9400cbd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:33.097 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.094+0000 7fa947058640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa940070480 0x7fa94015c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:33.097 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.098+0000 7fa947058640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa9400c7450 0x7fa9400ca2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:33.097 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.098+0000 7fa947058640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa940159de0 con 0x7fa9400700a0 2024-04-01T01:55:33.098 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.098+0000 7fa947058640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fa940070ab0 con 0x7fa940070480 2024-04-01T01:55:33.098 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.098+0000 7fa947058640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fa94006bd60 con 0x7fa9400c7450 2024-04-01T01:55:33.098 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.098+0000 7fa93ffff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa940070480 0x7fa94015c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:33.098 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.098+0000 7fa9455f5640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa9400c7450 0x7fa9400ca2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:33.098 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.098+0000 7fa93ffff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa940070480 0x7fa94015c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:51694/0 (socket says 172.21.15.97:51694) 2024-04-01T01:55:33.098 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.098+0000 7fa93ffff640 1 -- 172.21.15.97:0/2709134245 learned_addr learned my addr 172.21.15.97:0/2709134245 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-04-01T01:55:33.098 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.098+0000 7fa944df4640 1 --2- 172.21.15.97:0/2709134245 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9400700a0 0x7fa9400cbd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:33.098 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.098+0000 7fa9455f5640 1 -- 172.21.15.97:0/2709134245 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa940070480 msgr2=0x7fa94015c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:33.098 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.098+0000 7fa9455f5640 1 --2- 172.21.15.97:0/2709134245 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa940070480 0x7fa94015c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:33.098 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.098+0000 7fa9455f5640 1 -- 172.21.15.97:0/2709134245 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9400700a0 msgr2=0x7fa9400cbd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:33.098 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.098+0000 7fa9455f5640 1 --2- 172.21.15.97:0/2709134245 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9400700a0 0x7fa9400cbd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:33.098 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.098+0000 7fa9455f5640 1 -- 172.21.15.97:0/2709134245 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9401f2ee0 con 0x7fa9400c7450 2024-04-01T01:55:33.099 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.098+0000 7fa93ffff640 1 --2- 172.21.15.97:0/2709134245 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa940070480 0x7fa94015c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T01:55:33.099 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.098+0000 7fa9455f5640 1 --2- 172.21.15.97:0/2709134245 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa9400c7450 0x7fa9400ca2f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa9380af000 tx=0x7fa93801beb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:33.099 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.098+0000 7fa93d7fa640 1 -- 172.21.15.97:0/2709134245 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9380b5050 con 0x7fa9400c7450 2024-04-01T01:55:33.099 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.098+0000 7fa93d7fa640 1 -- 172.21.15.97:0/2709134245 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9380c1070 con 0x7fa9400c7450 2024-04-01T01:55:33.099 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.098+0000 7fa93d7fa640 1 -- 172.21.15.97:0/2709134245 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa938009450 con 0x7fa9400c7450 2024-04-01T01:55:33.099 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.098+0000 7fa947058640 1 -- 172.21.15.97:0/2709134245 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9401f04f0 con 0x7fa9400c7450 2024-04-01T01:55:33.099 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.098+0000 7fa947058640 1 -- 172.21.15.97:0/2709134245 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9401f3460 con 0x7fa9400c7450 2024-04-01T01:55:33.099 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.098+0000 7fa93d7fa640 1 -- 172.21.15.97:0/2709134245 <== mon.2 v2:172.21.15.97:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa9380bc890 con 0x7fa9400c7450 2024-04-01T01:55:33.099 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.098+0000 7fa93d7fa640 1 -- 172.21.15.97:0/2709134245 <== mon.2 v2:172.21.15.97:3301/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7fa9380ba400 con 0x7fa9400c7450 2024-04-01T01:55:33.099 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.098+0000 7fa947058640 1 -- 172.21.15.97:0/2709134245 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa94004f4c0 con 0x7fa9400c7450 2024-04-01T01:55:33.100 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.102+0000 7fa93d7fa640 1 -- 172.21.15.97:0/2709134245 <== mon.2 v2:172.21.15.97:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fa938018c70 con 0x7fa9400c7450 2024-04-01T01:55:33.107 INFO:tasks.ceph.mgr.y.smithi050.stderr:2024-04-01T01:55:33.107+0000 7fdaac2f8180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-01T01:55:33.162 INFO:tasks.ceph.mgr.y.smithi050.stderr:2024-04-01T01:55:33.163+0000 7fdaac2f8180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-01T01:55:33.167 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.170+0000 7fa947058640 1 -- 172.21.15.97:0/2709134245 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "osd new", "uuid": "0e6b1639-23b0-47d9-8b08-40c8ab6df818", "id": 4} v 0) -- 0x7fa9400cc2c0 con 0x7fa9400c7450 2024-04-01T01:55:33.169 INFO:tasks.ceph.mgr.x.smithi097.stderr:2024-04-01T01:55:33.170+0000 7f9de3d9c180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-01T01:55:33.172 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.174+0000 7fa93d7fa640 1 -- 172.21.15.97:0/2709134245 <== mon.2 v2:172.21.15.97:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0e6b1639-23b0-47d9-8b08-40c8ab6df818", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7fa9380c6460 con 0x7fa9400c7450 2024-04-01T01:55:33.172 INFO:teuthology.orchestra.run.smithi097.stdout:4 2024-04-01T01:55:33.174 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.174+0000 7fa947058640 1 -- 172.21.15.97:0/2709134245 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa9400c7450 msgr2=0x7fa9400ca2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:33.174 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.174+0000 7fa947058640 1 --2- 172.21.15.97:0/2709134245 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa9400c7450 0x7fa9400ca2f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa9380af000 tx=0x7fa93801beb0 comp rx=0 tx=0).stop 2024-04-01T01:55:33.174 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.174+0000 7fa947058640 1 -- 172.21.15.97:0/2709134245 shutdown_connections 2024-04-01T01:55:33.174 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.174+0000 7fa947058640 1 --2- 172.21.15.97:0/2709134245 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa9400c7450 0x7fa9400ca2f0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:33.174 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.174+0000 7fa947058640 1 --2- 172.21.15.97:0/2709134245 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa940070480 0x7fa94015c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:33.174 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.174+0000 7fa947058640 1 --2- 172.21.15.97:0/2709134245 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9400700a0 0x7fa9400cbd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:33.174 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.174+0000 7fa947058640 1 -- 172.21.15.97:0/2709134245 >> 172.21.15.97:0/2709134245 conn(0x7fa940067560 msgr2=0x7fa940150a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:55:33.174 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.174+0000 7fa947058640 1 -- 172.21.15.97:0/2709134245 shutdown_connections 2024-04-01T01:55:33.174 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.174+0000 7fa947058640 1 -- 172.21.15.97:0/2709134245 wait complete. 2024-04-01T01:55:33.188 DEBUG:teuthology.orchestra.run.smithi097:> sudo ceph --cluster ceph osd new f0f876ef-0823-46e9-8fe4-9b7a64a94cee 5 2024-04-01T01:55:33.223 INFO:tasks.ceph.mgr.x.smithi097.stderr:2024-04-01T01:55:33.222+0000 7f9de3d9c180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-01T01:55:33.242 INFO:tasks.ceph.mgr.y.smithi050.stderr:2024-04-01T01:55:33.243+0000 7fdaac2f8180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-01T01:55:33.296 INFO:tasks.ceph.mgr.y.smithi050.stderr:2024-04-01T01:55:33.295+0000 7fdaac2f8180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-01T01:55:33.302 INFO:tasks.ceph.mgr.x.smithi097.stderr:2024-04-01T01:55:33.302+0000 7f9de3d9c180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-01T01:55:33.342 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.342+0000 7f2976b67640 1 Processor -- start 2024-04-01T01:55:33.342 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.342+0000 7f2976b67640 1 -- start start 2024-04-01T01:55:33.344 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.342+0000 7f2976b67640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f29700c5500 0x7f29700b19e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:33.344 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.342+0000 7f2976b67640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f29700c58e0 0x7f297006c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:33.344 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.342+0000 7f2976b67640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2970073360 con 0x7f297006bda0 2024-04-01T01:55:33.344 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.342+0000 7f2976b67640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f29700c6610 con 0x7f29700c58e0 2024-04-01T01:55:33.344 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.342+0000 7f2976b67640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f2970073640 con 0x7f29700c5500 2024-04-01T01:55:33.344 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.342+0000 7f2974903640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f29700c5500 0x7f29700b19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:33.344 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.342+0000 7f2975104640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f297006bda0 0x7f2970151ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:42824/0 (socket says 172.21.15.97:42824) 2024-04-01T01:55:33.344 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.342+0000 7f2975104640 1 -- 172.21.15.97:0/1955711023 learned_addr learned my addr 172.21.15.97:0/1955711023 (peer_addr_for_me v1:172.21.15.97:0/0) 2024-04-01T01:55:33.345 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.342+0000 7f296ffff640 1 --2- 172.21.15.97:0/1955711023 >> v2:172.21.15.50:3300/0 conn(0x7f29700c58e0 0x7f297006c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:33.345 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.342+0000 7f2974903640 1 -- 172.21.15.97:0/1955711023 >> v2:172.21.15.50:3300/0 conn(0x7f29700c58e0 msgr2=0x7f297006c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:55:33.345 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.342+0000 7f296f7fe640 1 -- 172.21.15.97:0/1955711023 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1415759504 0 0) 0x7f2970073360 con 0x7f297006bda0 2024-04-01T01:55:33.345 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.342+0000 7f2974903640 1 --2- 172.21.15.97:0/1955711023 >> v2:172.21.15.50:3300/0 conn(0x7f29700c58e0 0x7f297006c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:33.345 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.342+0000 7f2974903640 1 -- 172.21.15.97:0/1955711023 >> v1:172.21.15.97:6789/0 conn(0x7f297006bda0 legacy=0x7f2970151ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:33.345 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.342+0000 7f2974903640 1 -- 172.21.15.97:0/1955711023 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29700c6860 con 0x7f29700c5500 2024-04-01T01:55:33.345 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.342+0000 7f296ffff640 1 --2- 172.21.15.97:0/1955711023 >> v2:172.21.15.50:3300/0 conn(0x7f29700c58e0 0x7f297006c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T01:55:33.346 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.346+0000 7f2974903640 1 --2- 172.21.15.97:0/1955711023 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f29700c5500 0x7f29700b19e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2968009d90 tx=0x7f296801c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8c10a91f835e5cd2 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:33.346 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.346+0000 7f296f7fe640 1 -- 172.21.15.97:0/1955711023 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29680b2070 con 0x7f29700c5500 2024-04-01T01:55:33.346 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.346+0000 7f296f7fe640 1 -- 172.21.15.97:0/1955711023 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29680a5710 con 0x7f29700c5500 2024-04-01T01:55:33.346 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.346+0000 7f296f7fe640 1 -- 172.21.15.97:0/1955711023 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29680a5ae0 con 0x7f29700c5500 2024-04-01T01:55:33.347 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.346+0000 7f2976b67640 1 -- 172.21.15.97:0/1955711023 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f29700c5500 msgr2=0x7f29700b19e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:33.347 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.346+0000 7f2976b67640 1 --2- 172.21.15.97:0/1955711023 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f29700c5500 0x7f29700b19e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2968009d90 tx=0x7f296801c850 comp rx=0 tx=0).stop 2024-04-01T01:55:33.347 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.346+0000 7f2976b67640 1 -- 172.21.15.97:0/1955711023 shutdown_connections 2024-04-01T01:55:33.347 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.346+0000 7f2976b67640 1 --2- 172.21.15.97:0/1955711023 >> v2:172.21.15.50:3300/0 conn(0x7f29700c58e0 0x7f297006c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:33.347 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.346+0000 7f2976b67640 1 --2- 172.21.15.97:0/1955711023 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f29700c5500 0x7f29700b19e0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:33.348 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.346+0000 7f2976b67640 1 -- 172.21.15.97:0/1955711023 >> 172.21.15.97:0/1955711023 conn(0x7f2970070030 msgr2=0x7f29700cbc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:55:33.348 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.346+0000 7f2976b67640 1 -- 172.21.15.97:0/1955711023 shutdown_connections 2024-04-01T01:55:33.348 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.346+0000 7f2976b67640 1 -- 172.21.15.97:0/1955711023 wait complete. 2024-04-01T01:55:33.352 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.350+0000 7f2976b67640 1 Processor -- start 2024-04-01T01:55:33.352 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.350+0000 7f2976b67640 1 -- start start 2024-04-01T01:55:33.352 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.350+0000 7f2976b67640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f297006bda0 0x7f2970136080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:33.352 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.350+0000 7f2976b67640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29700c5500 0x7f29700c9e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:33.352 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.350+0000 7f2976b67640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f29700c58e0 0x7f297013ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:33.352 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.350+0000 7f2976b67640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f2970073000 con 0x7f29700c5500 2024-04-01T01:55:33.352 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.350+0000 7f2976b67640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f2970067510 con 0x7f29700c58e0 2024-04-01T01:55:33.352 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.350+0000 7f2976b67640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f2970165060 con 0x7f297006bda0 2024-04-01T01:55:33.352 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.350+0000 7f2974903640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f297006bda0 0x7f2970136080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:33.353 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.350+0000 7f2974903640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f297006bda0 0x7f2970136080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:59318/0 (socket says 172.21.15.97:59318) 2024-04-01T01:55:33.353 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.350+0000 7f2974903640 1 -- 172.21.15.97:0/2310302705 learned_addr learned my addr 172.21.15.97:0/2310302705 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-04-01T01:55:33.353 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.350+0000 7f2975104640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f29700c58e0 0x7f297013ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:33.353 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.350+0000 7f296ffff640 1 --2- 172.21.15.97:0/2310302705 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29700c5500 0x7f29700c9e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:33.353 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.350+0000 7f2974903640 1 -- 172.21.15.97:0/2310302705 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f29700c58e0 msgr2=0x7f297013ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:33.353 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.350+0000 7f2974903640 1 --2- 172.21.15.97:0/2310302705 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f29700c58e0 0x7f297013ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:33.353 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.350+0000 7f2974903640 1 -- 172.21.15.97:0/2310302705 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29700c5500 msgr2=0x7f29700c9e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:33.353 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.350+0000 7f2974903640 1 --2- 172.21.15.97:0/2310302705 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29700c5500 0x7f29700c9e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:33.353 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.350+0000 7f2974903640 1 -- 172.21.15.97:0/2310302705 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2970137fb0 con 0x7f297006bda0 2024-04-01T01:55:33.353 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.350+0000 7f2975104640 1 --2- 172.21.15.97:0/2310302705 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f29700c58e0 0x7f297013ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T01:55:33.353 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.350+0000 7f2974903640 1 --2- 172.21.15.97:0/2310302705 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f297006bda0 0x7f2970136080 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f29680b0040 tx=0x7f29680195f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:33.353 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.350+0000 7f296d7fa640 1 -- 172.21.15.97:0/2310302705 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29680bd020 con 0x7f297006bda0 2024-04-01T01:55:33.353 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.350+0000 7f296d7fa640 1 -- 172.21.15.97:0/2310302705 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29680b8670 con 0x7f297006bda0 2024-04-01T01:55:33.353 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.350+0000 7f296d7fa640 1 -- 172.21.15.97:0/2310302705 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29680b2040 con 0x7f297006bda0 2024-04-01T01:55:33.353 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.350+0000 7f2976b67640 1 -- 172.21.15.97:0/2310302705 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2970146710 con 0x7f297006bda0 2024-04-01T01:55:33.354 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.350+0000 7f2976b67640 1 -- 172.21.15.97:0/2310302705 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f2970137cd0 con 0x7f297006bda0 2024-04-01T01:55:33.354 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.350+0000 7f296d7fa640 1 -- 172.21.15.97:0/2310302705 <== mon.2 v2:172.21.15.97:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f29680c0020 con 0x7f297006bda0 2024-04-01T01:55:33.354 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.350+0000 7f296d7fa640 1 -- 172.21.15.97:0/2310302705 <== mon.2 v2:172.21.15.97:3301/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f29680adb70 con 0x7f297006bda0 2024-04-01T01:55:33.354 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.350+0000 7f2976b67640 1 -- 172.21.15.97:0/2310302705 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2970068940 con 0x7f297006bda0 2024-04-01T01:55:33.354 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.354+0000 7f296d7fa640 1 -- 172.21.15.97:0/2310302705 <== mon.2 v2:172.21.15.97:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f29680c7030 con 0x7f297006bda0 2024-04-01T01:55:33.358 INFO:tasks.ceph.mgr.x.smithi097.stderr:2024-04-01T01:55:33.358+0000 7f9de3d9c180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-01T01:55:33.377 INFO:tasks.ceph.mgr.y.smithi050.stderr:2024-04-01T01:55:33.375+0000 7fdaac2f8180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-01T01:55:33.421 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.422+0000 7f2976b67640 1 -- 172.21.15.97:0/2310302705 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "osd new", "uuid": "f0f876ef-0823-46e9-8fe4-9b7a64a94cee", "id": 5} v 0) -- 0x7f2970151770 con 0x7f297006bda0 2024-04-01T01:55:33.425 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.426+0000 7f296d7fa640 1 -- 172.21.15.97:0/2310302705 <== mon.2 v2:172.21.15.97:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f0f876ef-0823-46e9-8fe4-9b7a64a94cee", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f2968016560 con 0x7f297006bda0 2024-04-01T01:55:33.426 INFO:teuthology.orchestra.run.smithi097.stdout:5 2024-04-01T01:55:33.427 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.426+0000 7f2976b67640 1 -- 172.21.15.97:0/2310302705 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f297006bda0 msgr2=0x7f2970136080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:33.427 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.426+0000 7f2976b67640 1 --2- 172.21.15.97:0/2310302705 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f297006bda0 0x7f2970136080 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f29680b0040 tx=0x7f29680195f0 comp rx=0 tx=0).stop 2024-04-01T01:55:33.427 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.426+0000 7f2976b67640 1 -- 172.21.15.97:0/2310302705 shutdown_connections 2024-04-01T01:55:33.427 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.426+0000 7f2976b67640 1 --2- 172.21.15.97:0/2310302705 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f29700c58e0 0x7f297013ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:33.427 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.426+0000 7f2976b67640 1 --2- 172.21.15.97:0/2310302705 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29700c5500 0x7f29700c9e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:33.427 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.426+0000 7f2976b67640 1 --2- 172.21.15.97:0/2310302705 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f297006bda0 0x7f2970136080 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:33.427 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.426+0000 7f2976b67640 1 -- 172.21.15.97:0/2310302705 >> 172.21.15.97:0/2310302705 conn(0x7f2970070030 msgr2=0x7f2970072420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:55:33.428 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.426+0000 7f2976b67640 1 -- 172.21.15.97:0/2310302705 shutdown_connections 2024-04-01T01:55:33.428 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.426+0000 7f2976b67640 1 -- 172.21.15.97:0/2310302705 wait complete. 2024-04-01T01:55:33.432 INFO:tasks.ceph.mgr.y.smithi050.stderr:2024-04-01T01:55:33.431+0000 7fdaac2f8180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-01T01:55:33.442 DEBUG:teuthology.orchestra.run.smithi097:> sudo ceph --cluster ceph osd new d29a625e-83bf-40ef-a57e-618220b96b9d 6 2024-04-01T01:55:33.511 INFO:tasks.ceph.mgr.x.smithi097.stderr:2024-04-01T01:55:33.510+0000 7f9de3d9c180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-01T01:55:33.552 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.554+0000 7f1f60924640 1 Processor -- start 2024-04-01T01:55:33.552 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.554+0000 7f1f60924640 1 -- start start 2024-04-01T01:55:33.554 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.554+0000 7f1f60924640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1f5c0cd990 0x7f1f5c06c330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:33.554 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.554+0000 7f1f60924640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1f5c0c9d10 0x7f1f5c15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:33.554 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.554+0000 7f1f60924640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f5c0c85c0 con 0x7f1f5c0cdd70 2024-04-01T01:55:33.554 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.554+0000 7f1f60924640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f1f5c06cee0 con 0x7f1f5c0c9d10 2024-04-01T01:55:33.555 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.554+0000 7f1f60924640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f1f5c06d1c0 con 0x7f1f5c0cd990 2024-04-01T01:55:33.555 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.554+0000 7f1f5a59c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1f5c0cd990 0x7f1f5c06c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:33.555 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.554+0000 7f1f5a59c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1f5c0cd990 0x7f1f5c06c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:59326/0 (socket says 172.21.15.97:59326) 2024-04-01T01:55:33.555 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.554+0000 7f1f5a59c640 1 -- 172.21.15.97:0/1029496661 learned_addr learned my addr 172.21.15.97:0/1029496661 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-04-01T01:55:33.555 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.554+0000 7f1f5ad9d640 1 --2- 172.21.15.97:0/1029496661 >> v2:172.21.15.50:3300/0 conn(0x7f1f5c0c9d10 0x7f1f5c15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:33.555 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.554+0000 7f1f5a59c640 1 -- 172.21.15.97:0/1029496661 >> v2:172.21.15.50:3300/0 conn(0x7f1f5c0c9d10 msgr2=0x7f1f5c15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:55:33.555 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.554+0000 7f1f5a59c640 1 --2- 172.21.15.97:0/1029496661 >> v2:172.21.15.50:3300/0 conn(0x7f1f5c0c9d10 0x7f1f5c15d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:33.555 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.554+0000 7f1f5a59c640 1 -- 172.21.15.97:0/1029496661 >> v1:172.21.15.50:6789/0 conn(0x7f1f5c0cdd70 legacy=0x7f1f5c157170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:55:33.556 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.554+0000 7f1f5a59c640 1 -- 172.21.15.97:0/1029496661 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f5c06d4a0 con 0x7f1f5c0cd990 2024-04-01T01:55:33.556 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.554+0000 7f1f5ad9d640 1 --2- 172.21.15.97:0/1029496661 >> v2:172.21.15.50:3300/0 conn(0x7f1f5c0c9d10 0x7f1f5c15d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T01:55:33.561 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.554+0000 7f1f5a59c640 1 --2- 172.21.15.97:0/1029496661 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1f5c0cd990 0x7f1f5c06c330 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f1f5c0b0190 tx=0x7f1f4c01c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8de18a73ed0dbe9c server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:33.561 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.554+0000 7f1f5959a640 1 -- 172.21.15.97:0/1029496661 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f4c0b0070 con 0x7f1f5c0cd990 2024-04-01T01:55:33.561 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.554+0000 7f1f5959a640 1 -- 172.21.15.97:0/1029496661 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f4c0ab600 con 0x7f1f5c0cd990 2024-04-01T01:55:33.561 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.554+0000 7f1f5959a640 1 -- 172.21.15.97:0/1029496661 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f4c0ab9d0 con 0x7f1f5c0cd990 2024-04-01T01:55:33.561 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.558+0000 7f1f60924640 1 -- 172.21.15.97:0/1029496661 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1f5c0cd990 msgr2=0x7f1f5c06c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:33.562 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.558+0000 7f1f60924640 1 --2- 172.21.15.97:0/1029496661 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1f5c0cd990 0x7f1f5c06c330 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f1f5c0b0190 tx=0x7f1f4c01c4e0 comp rx=0 tx=0).stop 2024-04-01T01:55:33.562 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.558+0000 7f1f60924640 1 -- 172.21.15.97:0/1029496661 shutdown_connections 2024-04-01T01:55:33.562 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.558+0000 7f1f60924640 1 --2- 172.21.15.97:0/1029496661 >> v2:172.21.15.50:3300/0 conn(0x7f1f5c0c9d10 0x7f1f5c15d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:33.562 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.558+0000 7f1f60924640 1 --2- 172.21.15.97:0/1029496661 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1f5c0cd990 0x7f1f5c06c330 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:33.562 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.558+0000 7f1f60924640 1 -- 172.21.15.97:0/1029496661 >> 172.21.15.97:0/1029496661 conn(0x7f1f5c06f650 msgr2=0x7f1f5c06b220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:55:33.562 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.558+0000 7f1f60924640 1 -- 172.21.15.97:0/1029496661 shutdown_connections 2024-04-01T01:55:33.562 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.558+0000 7f1f60924640 1 -- 172.21.15.97:0/1029496661 wait complete. 2024-04-01T01:55:33.563 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.558+0000 7f1f60924640 1 Processor -- start 2024-04-01T01:55:33.563 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.558+0000 7f1f60924640 1 -- start start 2024-04-01T01:55:33.563 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.558+0000 7f1f60924640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f5c0c9d10 0x7f1f5c1495c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:33.563 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.558+0000 7f1f60924640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1f5c0cd990 0x7f1f5c1476a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:33.563 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.558+0000 7f1f60924640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1f5c0cdd70 0x7f1f5c147be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:33.563 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.558+0000 7f1f60924640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f1f5c0c8320 con 0x7f1f5c0c9d10 2024-04-01T01:55:33.563 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.558+0000 7f1f60924640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f1f5c0c81a0 con 0x7f1f5c0cd990 2024-04-01T01:55:33.563 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.558+0000 7f1f60924640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f1f5c157880 con 0x7f1f5c0cdd70 2024-04-01T01:55:33.563 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.558+0000 7f1f59d9b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1f5c0cd990 0x7f1f5c1476a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:33.564 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.558+0000 7f1f5ad9d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1f5c0cdd70 0x7f1f5c147be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:33.564 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.558+0000 7f1f59d9b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1f5c0cd990 0x7f1f5c1476a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:51718/0 (socket says 172.21.15.97:51718) 2024-04-01T01:55:33.564 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.558+0000 7f1f59d9b640 1 -- 172.21.15.97:0/1026519908 learned_addr learned my addr 172.21.15.97:0/1026519908 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-04-01T01:55:33.564 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.558+0000 7f1f5a59c640 1 --2- 172.21.15.97:0/1026519908 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f5c0c9d10 0x7f1f5c1495c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:33.564 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.558+0000 7f1f5ad9d640 1 -- 172.21.15.97:0/1026519908 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1f5c0cd990 msgr2=0x7f1f5c1476a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:33.564 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.558+0000 7f1f5ad9d640 1 --2- 172.21.15.97:0/1026519908 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1f5c0cd990 0x7f1f5c1476a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:33.564 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.558+0000 7f1f5ad9d640 1 -- 172.21.15.97:0/1026519908 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f5c0c9d10 msgr2=0x7f1f5c1495c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:33.564 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.558+0000 7f1f5ad9d640 1 --2- 172.21.15.97:0/1026519908 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f5c0c9d10 0x7f1f5c1495c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:33.565 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.558+0000 7f1f5ad9d640 1 -- 172.21.15.97:0/1026519908 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f5c1f6690 con 0x7f1f5c0cdd70 2024-04-01T01:55:33.565 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.558+0000 7f1f59d9b640 1 --2- 172.21.15.97:0/1026519908 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1f5c0cd990 0x7f1f5c1476a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T01:55:33.565 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.558+0000 7f1f5a59c640 1 --2- 172.21.15.97:0/1026519908 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f5c0c9d10 0x7f1f5c1495c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T01:55:33.565 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.558+0000 7f1f5ad9d640 1 --2- 172.21.15.97:0/1026519908 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1f5c0cdd70 0x7f1f5c147be0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f1f5400cdf0 tx=0x7f1f5400a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:33.565 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.558+0000 7f1f4affd640 1 -- 172.21.15.97:0/1026519908 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f5401a070 con 0x7f1f5c0cdd70 2024-04-01T01:55:33.565 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.558+0000 7f1f4affd640 1 -- 172.21.15.97:0/1026519908 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f5400d840 con 0x7f1f5c0cdd70 2024-04-01T01:55:33.565 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.558+0000 7f1f60924640 1 -- 172.21.15.97:0/1026519908 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f5c1f6930 con 0x7f1f5c0cdd70 2024-04-01T01:55:33.565 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.558+0000 7f1f4affd640 1 -- 172.21.15.97:0/1026519908 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f5400dc30 con 0x7f1f5c0cdd70 2024-04-01T01:55:33.566 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.558+0000 7f1f60924640 1 -- 172.21.15.97:0/1026519908 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f5c1f6ef0 con 0x7f1f5c0cdd70 2024-04-01T01:55:33.566 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.562+0000 7f1f4affd640 1 -- 172.21.15.97:0/1026519908 <== mon.2 v2:172.21.15.97:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1f5401d070 con 0x7f1f5c0cdd70 2024-04-01T01:55:33.566 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.562+0000 7f1f4affd640 1 -- 172.21.15.97:0/1026519908 <== mon.2 v2:172.21.15.97:3301/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f1f54015a30 con 0x7f1f5c0cdd70 2024-04-01T01:55:33.566 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.562+0000 7f1f60924640 1 -- 172.21.15.97:0/1026519908 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f5c068940 con 0x7f1f5c0cdd70 2024-04-01T01:55:33.566 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.562+0000 7f1f4affd640 1 -- 172.21.15.97:0/1026519908 <== mon.2 v2:172.21.15.97:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f1f54024020 con 0x7f1f5c0cdd70 2024-04-01T01:55:33.575 INFO:tasks.ceph.mgr.x.smithi097.stderr:2024-04-01T01:55:33.574+0000 7f9de3d9c180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-01T01:55:33.587 INFO:tasks.ceph.mgr.y.smithi050.stderr:2024-04-01T01:55:33.587+0000 7fdaac2f8180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-01T01:55:33.628 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.630+0000 7f1f60924640 1 -- 172.21.15.97:0/1026519908 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "osd new", "uuid": "d29a625e-83bf-40ef-a57e-618220b96b9d", "id": 6} v 0) -- 0x7f1f5c0c3bf0 con 0x7f1f5c0cdd70 2024-04-01T01:55:33.632 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.634+0000 7f1f4affd640 1 -- 172.21.15.97:0/1026519908 <== mon.2 v2:172.21.15.97:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d29a625e-83bf-40ef-a57e-618220b96b9d", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f1f54015440 con 0x7f1f5c0cdd70 2024-04-01T01:55:33.632 INFO:teuthology.orchestra.run.smithi097.stdout:6 2024-04-01T01:55:33.633 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.634+0000 7f1f60924640 1 -- 172.21.15.97:0/1026519908 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1f5c0cdd70 msgr2=0x7f1f5c147be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:33.634 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.634+0000 7f1f60924640 1 --2- 172.21.15.97:0/1026519908 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1f5c0cdd70 0x7f1f5c147be0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f1f5400cdf0 tx=0x7f1f5400a710 comp rx=0 tx=0).stop 2024-04-01T01:55:33.634 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.634+0000 7f1f60924640 1 -- 172.21.15.97:0/1026519908 shutdown_connections 2024-04-01T01:55:33.634 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.634+0000 7f1f60924640 1 --2- 172.21.15.97:0/1026519908 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1f5c0cdd70 0x7f1f5c147be0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:33.634 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.634+0000 7f1f60924640 1 --2- 172.21.15.97:0/1026519908 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1f5c0cd990 0x7f1f5c1476a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:33.634 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.634+0000 7f1f60924640 1 --2- 172.21.15.97:0/1026519908 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f5c0c9d10 0x7f1f5c1495c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:33.634 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.634+0000 7f1f60924640 1 -- 172.21.15.97:0/1026519908 >> 172.21.15.97:0/1026519908 conn(0x7f1f5c06f650 msgr2=0x7f1f5c0c3340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:55:33.634 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.634+0000 7f1f60924640 1 -- 172.21.15.97:0/1026519908 shutdown_connections 2024-04-01T01:55:33.634 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.634+0000 7f1f60924640 1 -- 172.21.15.97:0/1026519908 wait complete. 2024-04-01T01:55:33.649 DEBUG:teuthology.orchestra.run.smithi097:> sudo ceph --cluster ceph osd new 7bcfd8f1-7dc0-4013-af17-16da5a8d931d 7 2024-04-01T01:55:33.652 INFO:tasks.ceph.mgr.y.smithi050.stderr:2024-04-01T01:55:33.651+0000 7fdaac2f8180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-01T01:55:33.764 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.766+0000 7ff9c99bc640 1 Processor -- start 2024-04-01T01:55:33.765 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.766+0000 7ff9c99bc640 1 -- start start 2024-04-01T01:55:33.768 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.766+0000 7ff9c99bc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff9c415dd50 0x7ff9c406c330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:33.768 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.766+0000 7ff9c99bc640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9c40c85c0 con 0x7ff9c4157590 2024-04-01T01:55:33.768 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.766+0000 7ff9c99bc640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9c406cf20 con 0x7ff9c40c9d10 2024-04-01T01:55:33.768 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.766+0000 7ff9c99bc640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7ff9c406dba0 con 0x7ff9c415dd50 2024-04-01T01:55:33.768 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.766+0000 7ff9c27fc640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7ff9c40c9d10 0x7ff9c415d640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:42834/0 (socket says 172.21.15.97:42834) 2024-04-01T01:55:33.768 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.766+0000 7ff9c27fc640 1 -- 172.21.15.97:0/2953138805 learned_addr learned my addr 172.21.15.97:0/2953138805 (peer_addr_for_me v1:172.21.15.97:0/0) 2024-04-01T01:55:33.768 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.766+0000 7ff9c37fe640 1 --2- 172.21.15.97:0/2953138805 >> v2:172.21.15.50:3300/0 conn(0x7ff9c415dd50 0x7ff9c406c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:33.768 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.766+0000 7ff9c1ffb640 1 -- 172.21.15.97:0/2953138805 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1785404037 0 0) 0x7ff9c406cf20 con 0x7ff9c40c9d10 2024-04-01T01:55:33.768 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.766+0000 7ff9c1ffb640 1 -- 172.21.15.97:0/2953138805 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff9b0003530 con 0x7ff9c40c9d10 2024-04-01T01:55:33.768 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.766+0000 7ff9c1ffb640 1 -- 172.21.15.97:0/2953138805 <== mon.1 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 591947879 0 0) 0x7ff9b0003530 con 0x7ff9c40c9d10 2024-04-01T01:55:33.769 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.766+0000 7ff9c1ffb640 1 -- 172.21.15.97:0/2953138805 >> v2:172.21.15.50:3300/0 conn(0x7ff9c415dd50 msgr2=0x7ff9c406c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:55:33.769 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.766+0000 7ff9c1ffb640 1 --2- 172.21.15.97:0/2953138805 >> v2:172.21.15.50:3300/0 conn(0x7ff9c415dd50 0x7ff9c406c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:33.769 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.766+0000 7ff9c1ffb640 1 -- 172.21.15.97:0/2953138805 >> v1:172.21.15.50:6789/0 conn(0x7ff9c4157590 legacy=0x7ff9c40cd730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:33.769 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.766+0000 7ff9c1ffb640 1 -- 172.21.15.97:0/2953138805 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9c406d200 con 0x7ff9c40c9d10 2024-04-01T01:55:33.769 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.766+0000 7ff9c1ffb640 1 -- 172.21.15.97:0/2953138805 <== mon.1 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2779672543 0 0) 0x7ff9ac001680 con 0x7ff9c40c9d10 2024-04-01T01:55:33.769 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.766+0000 7ff9c1ffb640 1 -- 172.21.15.97:0/2953138805 >> v1:172.21.15.97:6789/0 conn(0x7ff9c40c9d10 legacy=0x7ff9c415d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:33.769 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.766+0000 7ff9c1ffb640 1 --2- 172.21.15.97:0/2953138805 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9b00039c0 0x7ff9b0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:33.769 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.766+0000 7ff9c1ffb640 1 --2- 172.21.15.97:0/2953138805 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff9b0004810 0x7ff9b0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:33.769 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.766+0000 7ff9c1ffb640 1 --2- 172.21.15.97:0/2953138805 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff9b00051d0 0x7ff9b000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:33.769 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.766+0000 7ff9c1ffb640 1 -- 172.21.15.97:0/2953138805 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff9c406dba0 con 0x7ff9b00039c0 2024-04-01T01:55:33.769 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.766+0000 7ff9c1ffb640 1 -- 172.21.15.97:0/2953138805 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7ff9b000c170 con 0x7ff9b0004810 2024-04-01T01:55:33.769 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.766+0000 7ff9c1ffb640 1 -- 172.21.15.97:0/2953138805 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7ff9b000c370 con 0x7ff9b00051d0 2024-04-01T01:55:33.770 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.766+0000 7ff9c27fc640 1 --2- 172.21.15.97:0/2953138805 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff9b0004810 0x7ff9b0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:33.770 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.766+0000 7ff9c37fe640 1 --2- 172.21.15.97:0/2953138805 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff9b00051d0 0x7ff9b000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:33.770 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.766+0000 7ff9c2ffd640 1 --2- 172.21.15.97:0/2953138805 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9b00039c0 0x7ff9b0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:33.770 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.766+0000 7ff9c27fc640 1 -- 172.21.15.97:0/2953138805 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff9b00051d0 msgr2=0x7ff9b000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:55:33.770 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.766+0000 7ff9c27fc640 1 --2- 172.21.15.97:0/2953138805 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff9b00051d0 0x7ff9b000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:33.770 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.766+0000 7ff9c27fc640 1 -- 172.21.15.97:0/2953138805 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9b00039c0 msgr2=0x7ff9b0003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:55:33.770 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.766+0000 7ff9c27fc640 1 --2- 172.21.15.97:0/2953138805 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9b00039c0 0x7ff9b0003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:33.770 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.766+0000 7ff9c27fc640 1 -- 172.21.15.97:0/2953138805 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9b0003530 con 0x7ff9b0004810 2024-04-01T01:55:33.770 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.766+0000 7ff9c37fe640 1 --2- 172.21.15.97:0/2953138805 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff9b00051d0 0x7ff9b000b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T01:55:33.770 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.766+0000 7ff9c37fe640 1 -- 172.21.15.97:0/2953138805 reap_dead start 2024-04-01T01:55:33.774 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.770+0000 7ff9c27fc640 1 --2- 172.21.15.97:0/2953138805 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff9b0004810 0x7ff9b0004c90 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac00c1c0 tx=0x7ff9ac01cbe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f5e8026b4e5183f3 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:33.774 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.770+0000 7ff9c1ffb640 1 -- 172.21.15.97:0/2953138805 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9ac007d00 con 0x7ff9b0004810 2024-04-01T01:55:33.774 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.770+0000 7ff9c1ffb640 1 -- 172.21.15.97:0/2953138805 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9ac0a9020 con 0x7ff9b0004810 2024-04-01T01:55:33.774 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.770+0000 7ff9c1ffb640 1 -- 172.21.15.97:0/2953138805 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9ac005b00 con 0x7ff9b0004810 2024-04-01T01:55:33.774 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.770+0000 7ff9c99bc640 1 -- 172.21.15.97:0/2953138805 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff9b0004810 msgr2=0x7ff9b0004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:33.774 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.770+0000 7ff9c99bc640 1 --2- 172.21.15.97:0/2953138805 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff9b0004810 0x7ff9b0004c90 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac00c1c0 tx=0x7ff9ac01cbe0 comp rx=0 tx=0).stop 2024-04-01T01:55:33.774 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.770+0000 7ff9c99bc640 1 -- 172.21.15.97:0/2953138805 shutdown_connections 2024-04-01T01:55:33.774 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.770+0000 7ff9c99bc640 1 --2- 172.21.15.97:0/2953138805 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff9b0004810 0x7ff9b0004c90 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:33.774 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.770+0000 7ff9c99bc640 1 -- 172.21.15.97:0/2953138805 >> 172.21.15.97:0/2953138805 conn(0x7ff9c406f650 msgr2=0x7ff9c406b220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:55:33.774 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.770+0000 7ff9c99bc640 1 -- 172.21.15.97:0/2953138805 shutdown_connections 2024-04-01T01:55:33.774 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.770+0000 7ff9c99bc640 1 -- 172.21.15.97:0/2953138805 wait complete. 2024-04-01T01:55:33.774 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.770+0000 7ff9c99bc640 1 Processor -- start 2024-04-01T01:55:33.775 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.770+0000 7ff9c99bc640 1 -- start start 2024-04-01T01:55:33.775 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.774+0000 7ff9c99bc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9b0004810 0x7ff9c41e71f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:33.775 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.774+0000 7ff9c99bc640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff9c40cb610 0x7ff9c41f3950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:33.775 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.774+0000 7ff9c99bc640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff9c415b130 0x7ff9c4153b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:33.775 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.774+0000 7ff9c99bc640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff9c415da30 con 0x7ff9b0004810 2024-04-01T01:55:33.775 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.774+0000 7ff9c99bc640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7ff9c406d850 con 0x7ff9c40cb610 2024-04-01T01:55:33.775 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.774+0000 7ff9c99bc640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7ff9c415dbb0 con 0x7ff9c415b130 2024-04-01T01:55:33.775 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.774+0000 7ff9c37fe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff9c415b130 0x7ff9c4153b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:33.775 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.774+0000 7ff9c27fc640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff9c40cb610 0x7ff9c41f3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:33.775 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.774+0000 7ff9c37fe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff9c415b130 0x7ff9c4153b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:59356/0 (socket says 172.21.15.97:59356) 2024-04-01T01:55:33.775 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.774+0000 7ff9c37fe640 1 -- 172.21.15.97:0/464412919 learned_addr learned my addr 172.21.15.97:0/464412919 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-04-01T01:55:33.775 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.774+0000 7ff9c27fc640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff9c40cb610 0x7ff9c41f3950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:51738/0 (socket says 172.21.15.97:51738) 2024-04-01T01:55:33.775 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.774+0000 7ff9c2ffd640 1 --2- 172.21.15.97:0/464412919 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9b0004810 0x7ff9c41e71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:33.775 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.774+0000 7ff9c27fc640 1 -- 172.21.15.97:0/464412919 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff9c415b130 msgr2=0x7ff9c4153b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:33.776 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.774+0000 7ff9c27fc640 1 --2- 172.21.15.97:0/464412919 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff9c415b130 0x7ff9c4153b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:33.776 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.774+0000 7ff9c27fc640 1 -- 172.21.15.97:0/464412919 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9b0004810 msgr2=0x7ff9c41e71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:33.776 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.774+0000 7ff9c27fc640 1 --2- 172.21.15.97:0/464412919 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9b0004810 0x7ff9c41e71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:33.776 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.774+0000 7ff9c27fc640 1 -- 172.21.15.97:0/464412919 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9c415b5b0 con 0x7ff9c40cb610 2024-04-01T01:55:33.776 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.774+0000 7ff9c2ffd640 1 --2- 172.21.15.97:0/464412919 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9b0004810 0x7ff9c41e71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T01:55:33.776 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.774+0000 7ff9c37fe640 1 --2- 172.21.15.97:0/464412919 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff9c415b130 0x7ff9c4153b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T01:55:33.776 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.774+0000 7ff9c27fc640 1 --2- 172.21.15.97:0/464412919 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff9c40cb610 0x7ff9c41f3950 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac009000 tx=0x7ff9b0005840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:33.776 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.774+0000 7ff9bbfff640 1 -- 172.21.15.97:0/464412919 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9ac001c40 con 0x7ff9c40cb610 2024-04-01T01:55:33.776 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.774+0000 7ff9bbfff640 1 -- 172.21.15.97:0/464412919 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9ac0b2070 con 0x7ff9c40cb610 2024-04-01T01:55:33.776 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.774+0000 7ff9c99bc640 1 -- 172.21.15.97:0/464412919 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9c41587e0 con 0x7ff9c40cb610 2024-04-01T01:55:33.776 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.774+0000 7ff9bbfff640 1 -- 172.21.15.97:0/464412919 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9ac004c10 con 0x7ff9c40cb610 2024-04-01T01:55:33.776 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.774+0000 7ff9c99bc640 1 -- 172.21.15.97:0/464412919 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9c4158500 con 0x7ff9c40cb610 2024-04-01T01:55:33.776 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.774+0000 7ff9bbfff640 1 -- 172.21.15.97:0/464412919 <== mon.1 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff9ac007460 con 0x7ff9c40cb610 2024-04-01T01:55:33.776 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.774+0000 7ff9bbfff640 1 -- 172.21.15.97:0/464412919 <== mon.1 v2:172.21.15.97:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7ff9ac0aeae0 con 0x7ff9c40cb610 2024-04-01T01:55:33.777 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.774+0000 7ff9c99bc640 1 -- 172.21.15.97:0/464412919 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9c4068940 con 0x7ff9c40cb610 2024-04-01T01:55:33.777 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.774+0000 7ff9bbfff640 1 -- 172.21.15.97:0/464412919 <== mon.1 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7ff9c415b5b0 con 0x7ff9c40cb610 2024-04-01T01:55:33.845 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.846+0000 7ff9c99bc640 1 -- 172.21.15.97:0/464412919 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7bcfd8f1-7dc0-4013-af17-16da5a8d931d", "id": 7} v 0) -- 0x7ff9c4154050 con 0x7ff9c40cb610 2024-04-01T01:55:33.854 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.854+0000 7ff9bbfff640 1 -- 172.21.15.97:0/464412919 <== mon.1 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7bcfd8f1-7dc0-4013-af17-16da5a8d931d", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7ff9ac016930 con 0x7ff9c40cb610 2024-04-01T01:55:33.854 INFO:teuthology.orchestra.run.smithi097.stdout:7 2024-04-01T01:55:33.856 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.854+0000 7ff9b9ffb640 1 -- 172.21.15.97:0/464412919 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff9c40cb610 msgr2=0x7ff9c41f3950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:33.856 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.854+0000 7ff9b9ffb640 1 --2- 172.21.15.97:0/464412919 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff9c40cb610 0x7ff9c41f3950 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac009000 tx=0x7ff9b0005840 comp rx=0 tx=0).stop 2024-04-01T01:55:33.856 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.858+0000 7ff9b9ffb640 1 -- 172.21.15.97:0/464412919 shutdown_connections 2024-04-01T01:55:33.856 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.858+0000 7ff9b9ffb640 1 --2- 172.21.15.97:0/464412919 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff9c415b130 0x7ff9c4153b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:33.856 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.858+0000 7ff9b9ffb640 1 --2- 172.21.15.97:0/464412919 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff9c40cb610 0x7ff9c41f3950 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:33.856 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.858+0000 7ff9b9ffb640 1 --2- 172.21.15.97:0/464412919 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9b0004810 0x7ff9c41e71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:33.856 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.858+0000 7ff9b9ffb640 1 -- 172.21.15.97:0/464412919 >> 172.21.15.97:0/464412919 conn(0x7ff9c406f650 msgr2=0x7ff9c406b220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:55:33.857 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.858+0000 7ff9b9ffb640 1 -- 172.21.15.97:0/464412919 shutdown_connections 2024-04-01T01:55:33.857 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-01T01:55:33.858+0000 7ff9b9ffb640 1 -- 172.21.15.97:0/464412919 wait complete. 2024-04-01T01:55:33.883 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-01T01:55:33.884 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 0 2024-04-01T01:55:33.886 INFO:tasks.ceph.osd.0:Started 2024-04-01T01:55:33.886 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-01T01:55:33.886 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 1 2024-04-01T01:55:33.889 INFO:tasks.ceph.osd.1:Started 2024-04-01T01:55:33.889 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-01T01:55:33.890 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 2 2024-04-01T01:55:33.892 INFO:tasks.ceph.osd.2:Started 2024-04-01T01:55:33.892 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-01T01:55:33.892 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 3 2024-04-01T01:55:33.894 INFO:tasks.ceph.osd.3:Started 2024-04-01T01:55:33.895 INFO:tasks.ceph.osd.4:Restarting daemon 2024-04-01T01:55:33.895 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 4 2024-04-01T01:55:33.897 INFO:tasks.ceph.osd.4:Started 2024-04-01T01:55:33.897 INFO:tasks.ceph.osd.5:Restarting daemon 2024-04-01T01:55:33.897 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 5 2024-04-01T01:55:33.899 INFO:tasks.ceph.osd.5:Started 2024-04-01T01:55:33.899 INFO:tasks.ceph.osd.6:Restarting daemon 2024-04-01T01:55:33.899 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 6 2024-04-01T01:55:33.901 INFO:tasks.ceph.osd.6:Started 2024-04-01T01:55:33.901 INFO:tasks.ceph.osd.7:Restarting daemon 2024-04-01T01:55:33.901 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 7 2024-04-01T01:55:33.906 INFO:tasks.ceph.osd.7:Started 2024-04-01T01:55:33.906 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-01T01:55:34.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:34.031+0000 7f8f9926a640 1 Processor -- start 2024-04-01T01:55:34.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:34.031+0000 7f8f9926a640 1 -- start start 2024-04-01T01:55:34.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:34.031+0000 7f8f9926a640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f8f94072c20 0x7f8f940c5c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:34.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:34.031+0000 7f8f9926a640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f940731d0 con 0x7f8f940c61b0 2024-04-01T01:55:34.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:34.031+0000 7f8f9926a640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f9406b710 con 0x7f8f94151e10 2024-04-01T01:55:34.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:34.031+0000 7f8f9926a640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f8f9406b4c0 con 0x7f8f94072c20 2024-04-01T01:55:34.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:34.031+0000 7f8f937fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f8f940c61b0 0x7f8f94157e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52086/0 (socket says 172.21.15.50:52086) 2024-04-01T01:55:34.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:34.031+0000 7f8f937fe640 1 -- 172.21.15.50:0/2284317511 learned_addr learned my addr 172.21.15.50:0/2284317511 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-04-01T01:55:34.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:34.031+0000 7f8f927fc640 1 --2- 172.21.15.50:0/2284317511 >> v2:172.21.15.97:3300/0 conn(0x7f8f94072c20 0x7f8f940c5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:34.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:34.031+0000 7f8f91ffb640 1 -- 172.21.15.50:0/2284317511 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2556199282 0 0) 0x7f8f940731d0 con 0x7f8f940c61b0 2024-04-01T01:55:34.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:34.031+0000 7f8f91ffb640 1 -- 172.21.15.50:0/2284317511 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8f7c003530 con 0x7f8f940c61b0 2024-04-01T01:55:34.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:34.031+0000 7f8f927fc640 1 -- 172.21.15.50:0/2284317511 >> v1:172.21.15.97:6789/0 conn(0x7f8f94151e10 legacy=0x7f8f940c9970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:34.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:34.031+0000 7f8f927fc640 1 -- 172.21.15.50:0/2284317511 >> v1:172.21.15.50:6789/0 conn(0x7f8f940c61b0 legacy=0x7f8f94157e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:34.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:34.031+0000 7f8f927fc640 1 -- 172.21.15.50:0/2284317511 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f9406b9f0 con 0x7f8f94072c20 2024-04-01T01:55:34.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:34.035+0000 7f8f927fc640 1 --2- 172.21.15.50:0/2284317511 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8f94072c20 0x7f8f940c5c70 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f8f880097c0 tx=0x7f8f8801c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f5ea8f2f9d16809d server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:34.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:34.035+0000 7f8f91ffb640 1 -- 172.21.15.50:0/2284317511 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f880b0070 con 0x7f8f94072c20 2024-04-01T01:55:34.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:34.035+0000 7f8f91ffb640 1 -- 172.21.15.50:0/2284317511 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f880ab600 con 0x7f8f94072c20 2024-04-01T01:55:34.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:34.035+0000 7f8f91ffb640 1 -- 172.21.15.50:0/2284317511 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f880ab9b0 con 0x7f8f94072c20 2024-04-01T01:55:34.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:34.035+0000 7f8f9926a640 1 -- 172.21.15.50:0/2284317511 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8f94072c20 msgr2=0x7f8f940c5c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:34.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:34.035+0000 7f8f9926a640 1 --2- 172.21.15.50:0/2284317511 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8f94072c20 0x7f8f940c5c70 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f8f880097c0 tx=0x7f8f8801c4a0 comp rx=0 tx=0).stop 2024-04-01T01:55:34.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:34.035+0000 7f8f9926a640 1 -- 172.21.15.50:0/2284317511 shutdown_connections 2024-04-01T01:55:34.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:34.035+0000 7f8f9926a640 1 --2- 172.21.15.50:0/2284317511 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8f94072c20 0x7f8f940c5c70 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:34.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:34.035+0000 7f8f9926a640 1 -- 172.21.15.50:0/2284317511 >> 172.21.15.50:0/2284317511 conn(0x7f8f94067130 msgr2=0x7f8f9406c330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:55:34.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:34.035+0000 7f8f9926a640 1 -- 172.21.15.50:0/2284317511 shutdown_connections 2024-04-01T01:55:34.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:34.035+0000 7f8f9926a640 1 -- 172.21.15.50:0/2284317511 wait complete. 2024-04-01T01:55:34.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:34.035+0000 7f8f9926a640 1 Processor -- start 2024-04-01T01:55:34.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:34.035+0000 7f8f9926a640 1 -- start start 2024-04-01T01:55:34.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:34.035+0000 7f8f9926a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f94072c20 0x7f8f9414a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:34.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:34.035+0000 7f8f9926a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8f940c61b0 0x7f8f940cc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:34.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:34.035+0000 7f8f9926a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8f94151e10 0x7f8f940cc830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:34.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:34.035+0000 7f8f9926a640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8f94165ef0 con 0x7f8f94072c20 2024-04-01T01:55:34.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:34.035+0000 7f8f9926a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f8f94165d70 con 0x7f8f940c61b0 2024-04-01T01:55:34.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:34.035+0000 7f8f9926a640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f8f94166070 con 0x7f8f94151e10 2024-04-01T01:55:34.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:34.035+0000 7f8f92ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f94072c20 0x7f8f9414a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:34.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:34.035+0000 7f8f92ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f94072c20 0x7f8f9414a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47856/0 (socket says 172.21.15.50:47856) 2024-04-01T01:55:34.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:34.035+0000 7f8f92ffd640 1 -- 172.21.15.50:0/2971474671 learned_addr learned my addr 172.21.15.50:0/2971474671 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T01:55:34.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:34.035+0000 7f8f927fc640 1 --2- 172.21.15.50:0/2971474671 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8f940c61b0 0x7f8f940cc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:34.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:34.035+0000 7f8f937fe640 1 --2- 172.21.15.50:0/2971474671 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8f94151e10 0x7f8f940cc830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:34.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:34.039+0000 7f8f927fc640 1 -- 172.21.15.50:0/2971474671 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8f94151e10 msgr2=0x7f8f940cc830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:34.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:34.039+0000 7f8f927fc640 1 --2- 172.21.15.50:0/2971474671 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8f94151e10 0x7f8f940cc830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:34.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:34.039+0000 7f8f927fc640 1 -- 172.21.15.50:0/2971474671 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f94072c20 msgr2=0x7f8f9414a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:34.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:34.039+0000 7f8f927fc640 1 --2- 172.21.15.50:0/2971474671 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f94072c20 0x7f8f9414a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:34.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:34.039+0000 7f8f927fc640 1 -- 172.21.15.50:0/2971474671 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f941494a0 con 0x7f8f940c61b0 2024-04-01T01:55:34.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:34.039+0000 7f8f937fe640 1 --2- 172.21.15.50:0/2971474671 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8f94151e10 0x7f8f940cc830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T01:55:34.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:34.039+0000 7f8f92ffd640 1 --2- 172.21.15.50:0/2971474671 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f94072c20 0x7f8f9414a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T01:55:34.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:34.039+0000 7f8f927fc640 1 --2- 172.21.15.50:0/2971474671 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8f940c61b0 0x7f8f940cc2f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f8f940c6a20 tx=0x7f8f8801ace0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:34.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:34.039+0000 7f8f7b7fe640 1 -- 172.21.15.50:0/2971474671 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f880b0070 con 0x7f8f940c61b0 2024-04-01T01:55:34.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:34.039+0000 7f8f7b7fe640 1 -- 172.21.15.50:0/2971474671 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f880b1040 con 0x7f8f940c61b0 2024-04-01T01:55:34.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:34.039+0000 7f8f9926a640 1 -- 172.21.15.50:0/2971474671 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f940cb530 con 0x7f8f940c61b0 2024-04-01T01:55:34.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:34.039+0000 7f8f7b7fe640 1 -- 172.21.15.50:0/2971474671 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f880abbc0 con 0x7f8f940c61b0 2024-04-01T01:55:34.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:34.039+0000 7f8f9926a640 1 -- 172.21.15.50:0/2971474671 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f940cbaf0 con 0x7f8f940c61b0 2024-04-01T01:55:34.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:34.039+0000 7f8f7b7fe640 1 -- 172.21.15.50:0/2971474671 <== mon.1 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8f880bc030 con 0x7f8f940c61b0 2024-04-01T01:55:34.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:34.039+0000 7f8f7b7fe640 1 -- 172.21.15.50:0/2971474671 <== mon.1 v2:172.21.15.97:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f8f880b5b10 con 0x7f8f940c61b0 2024-04-01T01:55:34.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:34.039+0000 7f8f9926a640 1 -- 172.21.15.50:0/2971474671 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f94068940 con 0x7f8f940c61b0 2024-04-01T01:55:34.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:34.043+0000 7f8f7b7fe640 1 -- 172.21.15.50:0/2971474671 <== mon.1 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f8f880c3020 con 0x7f8f940c61b0 2024-04-01T01:55:34.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:34.147+0000 7f8f9926a640 1 -- 172.21.15.50:0/2971474671 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8f940c9750 con 0x7f8f940c61b0 2024-04-01T01:55:34.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:34.147+0000 7f8f7b7fe640 1 -- 172.21.15.50:0/2971474671 <== mon.1 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f8f88016090 con 0x7f8f940c61b0 2024-04-01T01:55:34.149 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-01T01:55:34.149 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":10,"fsid":"f67878a9-bc75-426b-962d-fa7bc2517f7d","created":"2024-04-01T01:55:31.562371+0000","modified":"2024-04-01T01:55:33.849789+0000","last_up_change":"0.000000","last_in_change":"2024-04-01T01:55:33.849789+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"81e8ca4f-bde8-419a-875f-73a1f4a641ad","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"bd060ca0-7559-4d30-987c-62e59818431d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"eac5d816-a281-4acd-aa7d-b96a8e0aa962","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"12b23968-04a7-40b8-98c4-02b16ae28265","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"0e6b1639-23b0-47d9-8b08-40c8ab6df818","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"f0f876ef-0823-46e9-8fe4-9b7a64a94cee","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d29a625e-83bf-40ef-a57e-618220b96b9d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"7bcfd8f1-7dc0-4013-af17-16da5a8d931d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-01T01:55:34.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:34.147+0000 7f8f9926a640 1 -- 172.21.15.50:0/2971474671 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8f940c61b0 msgr2=0x7f8f940cc2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:34.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:34.147+0000 7f8f9926a640 1 --2- 172.21.15.50:0/2971474671 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8f940c61b0 0x7f8f940cc2f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f8f940c6a20 tx=0x7f8f8801ace0 comp rx=0 tx=0).stop 2024-04-01T01:55:34.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:34.147+0000 7f8f9926a640 1 -- 172.21.15.50:0/2971474671 shutdown_connections 2024-04-01T01:55:34.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:34.147+0000 7f8f9926a640 1 --2- 172.21.15.50:0/2971474671 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8f94151e10 0x7f8f940cc830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:34.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:34.147+0000 7f8f9926a640 1 --2- 172.21.15.50:0/2971474671 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8f940c61b0 0x7f8f940cc2f0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:34.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:34.147+0000 7f8f9926a640 1 --2- 172.21.15.50:0/2971474671 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f94072c20 0x7f8f9414a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:34.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:34.147+0000 7f8f9926a640 1 -- 172.21.15.50:0/2971474671 >> 172.21.15.50:0/2971474671 conn(0x7f8f94067130 msgr2=0x7f8f940740b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:55:34.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:34.147+0000 7f8f9926a640 1 -- 172.21.15.50:0/2971474671 shutdown_connections 2024-04-01T01:55:34.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:34.147+0000 7f8f9926a640 1 -- 172.21.15.50:0/2971474671 wait complete. 2024-04-01T01:55:34.163 INFO:tasks.ceph.mgr.x.smithi097.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-01T01:55:34.164 INFO:tasks.ceph.mgr.x.smithi097.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-01T01:55:34.164 INFO:tasks.ceph.mgr.x.smithi097.stderr: from numpy import show_config as show_numpy_config 2024-04-01T01:55:34.165 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-01T01:55:34.165 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-01T01:55:34.243 INFO:tasks.ceph.mgr.x.smithi097.stderr:2024-04-01T01:55:34.242+0000 7f9de3d9c180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-01T01:55:34.375 INFO:tasks.ceph.mgr.y.smithi050.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-01T01:55:34.375 INFO:tasks.ceph.mgr.y.smithi050.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-01T01:55:34.375 INFO:tasks.ceph.mgr.y.smithi050.stderr: from numpy import show_config as show_numpy_config 2024-04-01T01:55:34.390 INFO:tasks.ceph.mgr.x.smithi097.stderr:2024-04-01T01:55:34.390+0000 7f9de3d9c180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-01T01:55:34.440 INFO:tasks.ceph.mgr.y.smithi050.stderr:2024-04-01T01:55:34.439+0000 7fdaac2f8180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-01T01:55:34.500 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-04-01T01:55:34.499+0000 7f9994ad37c0 -1 Falling back to public interface 2024-04-01T01:55:34.503 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-04-01T01:55:34.503+0000 7f4639d277c0 -1 Falling back to public interface 2024-04-01T01:55:34.509 INFO:tasks.ceph.osd.4.smithi097.stderr:2024-04-01T01:55:34.510+0000 7f44bd67b7c0 -1 Falling back to public interface 2024-04-01T01:55:34.514 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-04-01T01:55:34.515+0000 7fc51a5727c0 -1 Falling back to public interface 2024-04-01T01:55:34.529 INFO:tasks.ceph.osd.7.smithi097.stderr:2024-04-01T01:55:34.530+0000 7f6ec6dd27c0 -1 Falling back to public interface 2024-04-01T01:55:34.530 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-04-01T01:55:34.531+0000 7f67243a07c0 -1 Falling back to public interface 2024-04-01T01:55:34.544 INFO:tasks.ceph.osd.5.smithi097.stderr:2024-04-01T01:55:34.546+0000 7f6f1bc287c0 -1 Falling back to public interface 2024-04-01T01:55:34.559 INFO:tasks.ceph.mgr.x.smithi097.stderr:2024-04-01T01:55:34.558+0000 7f9de3d9c180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-01T01:55:34.565 INFO:tasks.ceph.osd.6.smithi097.stderr:2024-04-01T01:55:34.566+0000 7f5960fdf7c0 -1 Falling back to public interface 2024-04-01T01:55:34.626 INFO:tasks.ceph.mgr.x.smithi097.stderr:2024-04-01T01:55:34.626+0000 7f9de3d9c180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-01T01:55:34.631 INFO:tasks.ceph.mgr.y.smithi050.stderr:2024-04-01T01:55:34.631+0000 7fdaac2f8180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-01T01:55:34.757 INFO:tasks.ceph.mgr.x.smithi097.stderr:2024-04-01T01:55:34.758+0000 7f9de3d9c180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-01T01:55:34.910 INFO:tasks.ceph.mgr.y.smithi050.stderr:2024-04-01T01:55:34.911+0000 7fdaac2f8180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-01T01:55:34.970 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-01T01:55:34.982 INFO:tasks.ceph.mgr.y.smithi050.stderr:2024-04-01T01:55:34.983+0000 7fdaac2f8180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-01T01:55:35.090 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:35.091+0000 7f7abded2640 1 Processor -- start 2024-04-01T01:55:35.090 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:35.091+0000 7f7abded2640 1 -- start start 2024-04-01T01:55:35.093 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:35.091+0000 7f7abded2640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f7ab8154230 0x7f7ab815a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:35.093 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:35.091+0000 7f7abded2640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ab815e270 con 0x7f7ab80cc720 2024-04-01T01:55:35.093 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:35.091+0000 7f7abded2640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ab815acc0 con 0x7f7ab80c9fe0 2024-04-01T01:55:35.093 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:35.091+0000 7f7abded2640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f7ab815d6f0 con 0x7f7ab8154230 2024-04-01T01:55:35.093 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:35.091+0000 7f7ab7fff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f7ab80cc720 0x7f7ab80c4e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52092/0 (socket says 172.21.15.50:52092) 2024-04-01T01:55:35.093 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:35.091+0000 7f7ab7fff640 1 -- 172.21.15.50:0/3855874302 learned_addr learned my addr 172.21.15.50:0/3855874302 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-04-01T01:55:35.094 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:35.091+0000 7f7ab77fe640 1 --2- 172.21.15.50:0/3855874302 >> v2:172.21.15.97:3300/0 conn(0x7f7ab8154230 0x7f7ab815a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:35.094 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:35.091+0000 7f7ab67fc640 1 -- 172.21.15.50:0/3855874302 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3250868323 0 0) 0x7f7ab815e270 con 0x7f7ab80cc720 2024-04-01T01:55:35.094 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:35.091+0000 7f7ab67fc640 1 -- 172.21.15.50:0/3855874302 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7aa0003530 con 0x7f7ab80cc720 2024-04-01T01:55:35.094 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:35.091+0000 7f7ab67fc640 1 -- 172.21.15.50:0/3855874302 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2007538433 0 0) 0x7f7aa0003530 con 0x7f7ab80cc720 2024-04-01T01:55:35.094 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:35.091+0000 7f7ab67fc640 1 -- 172.21.15.50:0/3855874302 >> v2:172.21.15.97:3300/0 conn(0x7f7ab8154230 msgr2=0x7f7ab815a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:55:35.094 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:35.091+0000 7f7ab67fc640 1 --2- 172.21.15.50:0/3855874302 >> v2:172.21.15.97:3300/0 conn(0x7f7ab8154230 0x7f7ab815a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:35.094 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:35.091+0000 7f7ab67fc640 1 -- 172.21.15.50:0/3855874302 >> v1:172.21.15.97:6789/0 conn(0x7f7ab80c9fe0 legacy=0x7f7ab80cc010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:35.094 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:35.091+0000 7f7ab67fc640 1 -- 172.21.15.50:0/3855874302 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ab815d9d0 con 0x7f7ab80cc720 2024-04-01T01:55:35.094 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:35.091+0000 7f7ab67fc640 1 -- 172.21.15.50:0/3855874302 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2779672543 0 0) 0x7f7ab00016a0 con 0x7f7ab80cc720 2024-04-01T01:55:35.094 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:35.091+0000 7f7ab67fc640 1 -- 172.21.15.50:0/3855874302 >> v1:172.21.15.50:6789/0 conn(0x7f7ab80cc720 legacy=0x7f7ab80c4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:35.094 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:35.091+0000 7f7ab67fc640 1 --2- 172.21.15.50:0/3855874302 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7aa00039c0 0x7f7aa0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:35.094 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:35.091+0000 7f7ab67fc640 1 --2- 172.21.15.50:0/3855874302 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7aa0004810 0x7f7aa0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:35.095 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:35.091+0000 7f7ab67fc640 1 --2- 172.21.15.50:0/3855874302 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7aa00051d0 0x7f7aa000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:35.095 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:35.091+0000 7f7ab67fc640 1 -- 172.21.15.50:0/3855874302 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7ab815d6f0 con 0x7f7aa0004810 2024-04-01T01:55:35.095 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:35.091+0000 7f7ab67fc640 1 -- 172.21.15.50:0/3855874302 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f7aa000c070 con 0x7f7aa00039c0 2024-04-01T01:55:35.095 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:35.091+0000 7f7ab67fc640 1 -- 172.21.15.50:0/3855874302 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f7aa000c270 con 0x7f7aa00051d0 2024-04-01T01:55:35.095 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:35.091+0000 7f7ab6ffd640 1 --2- 172.21.15.50:0/3855874302 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7aa0004810 0x7f7aa0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:35.095 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:35.091+0000 7f7ab77fe640 1 --2- 172.21.15.50:0/3855874302 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7aa00039c0 0x7f7aa0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:35.095 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:35.091+0000 7f7ab7fff640 1 --2- 172.21.15.50:0/3855874302 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7aa00051d0 0x7f7aa000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:35.095 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:35.091+0000 7f7ab6ffd640 1 -- 172.21.15.50:0/3855874302 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7aa00051d0 msgr2=0x7f7aa000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:55:35.095 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:35.091+0000 7f7ab6ffd640 1 --2- 172.21.15.50:0/3855874302 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7aa00051d0 0x7f7aa000b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:35.095 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:35.091+0000 7f7ab6ffd640 1 -- 172.21.15.50:0/3855874302 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7aa00039c0 msgr2=0x7f7aa0003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:55:35.095 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:35.091+0000 7f7ab6ffd640 1 --2- 172.21.15.50:0/3855874302 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7aa00039c0 0x7f7aa0003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:35.095 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:35.091+0000 7f7ab6ffd640 1 -- 172.21.15.50:0/3855874302 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7aa0003530 con 0x7f7aa0004810 2024-04-01T01:55:35.095 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:35.091+0000 7f7ab7fff640 1 -- 172.21.15.50:0/3855874302 reap_dead start 2024-04-01T01:55:35.095 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:35.091+0000 7f7ab77fe640 1 --2- 172.21.15.50:0/3855874302 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7aa00039c0 0x7f7aa0003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T01:55:35.097 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:35.095+0000 7f7ab6ffd640 1 --2- 172.21.15.50:0/3855874302 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7aa0004810 0x7f7aa0004c90 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f7aac001780 tx=0x7f7aac01c220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48115ade36852eb1 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:35.097 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:35.095+0000 7f7ab67fc640 1 -- 172.21.15.50:0/3855874302 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aac0013a0 con 0x7f7aa0004810 2024-04-01T01:55:35.097 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:35.095+0000 7f7ab67fc640 1 -- 172.21.15.50:0/3855874302 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7aac0052f0 con 0x7f7aa0004810 2024-04-01T01:55:35.097 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:35.095+0000 7f7ab67fc640 1 -- 172.21.15.50:0/3855874302 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aac003840 con 0x7f7aa0004810 2024-04-01T01:55:35.097 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:35.095+0000 7f7abded2640 1 -- 172.21.15.50:0/3855874302 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7aa0004810 msgr2=0x7f7aa0004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:35.097 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:35.095+0000 7f7abded2640 1 --2- 172.21.15.50:0/3855874302 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7aa0004810 0x7f7aa0004c90 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f7aac001780 tx=0x7f7aac01c220 comp rx=0 tx=0).stop 2024-04-01T01:55:35.097 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:35.095+0000 7f7abded2640 1 -- 172.21.15.50:0/3855874302 shutdown_connections 2024-04-01T01:55:35.097 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:35.095+0000 7f7abded2640 1 --2- 172.21.15.50:0/3855874302 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7aa0004810 0x7f7aa0004c90 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:35.098 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:35.095+0000 7f7abded2640 1 -- 172.21.15.50:0/3855874302 >> 172.21.15.50:0/3855874302 conn(0x7f7ab806da10 msgr2=0x7f7ab8072850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:55:35.098 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:35.095+0000 7f7abded2640 1 -- 172.21.15.50:0/3855874302 shutdown_connections 2024-04-01T01:55:35.098 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:35.095+0000 7f7abded2640 1 -- 172.21.15.50:0/3855874302 wait complete. 2024-04-01T01:55:35.098 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:35.095+0000 7f7abded2640 1 Processor -- start 2024-04-01T01:55:35.098 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:35.095+0000 7f7abded2640 1 -- start start 2024-04-01T01:55:35.100 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:35.099+0000 7f7abded2640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7aa0004810 0x7f7ab81e2f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:35.101 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:35.099+0000 7f7abded2640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7ab81587b0 0x7f7ab81f0390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:35.101 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:35.099+0000 7f7abded2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ab80cb350 0x7f7ab814ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:35.101 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:35.099+0000 7f7abded2640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7ab80c4900 con 0x7f7ab80cb350 2024-04-01T01:55:35.101 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:35.099+0000 7f7abded2640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f7ab815df90 con 0x7f7ab81587b0 2024-04-01T01:55:35.101 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:35.099+0000 7f7abded2640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f7ab815d2f0 con 0x7f7aa0004810 2024-04-01T01:55:35.101 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:35.099+0000 7f7ab7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ab80cb350 0x7f7ab814ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:35.101 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:35.099+0000 7f7ab7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ab80cb350 0x7f7ab814ae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47882/0 (socket says 172.21.15.50:47882) 2024-04-01T01:55:35.101 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:35.099+0000 7f7ab7fff640 1 -- 172.21.15.50:0/513237835 learned_addr learned my addr 172.21.15.50:0/513237835 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T01:55:35.101 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:35.099+0000 7f7ab6ffd640 1 --2- 172.21.15.50:0/513237835 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7ab81587b0 0x7f7ab81f0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:35.101 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:35.099+0000 7f7ab77fe640 1 --2- 172.21.15.50:0/513237835 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7aa0004810 0x7f7ab81e2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:35.101 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:35.099+0000 7f7ab7fff640 1 -- 172.21.15.50:0/513237835 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7aa0004810 msgr2=0x7f7ab81e2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:35.101 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:35.099+0000 7f7ab7fff640 1 --2- 172.21.15.50:0/513237835 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7aa0004810 0x7f7ab81e2f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:35.101 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:35.099+0000 7f7ab7fff640 1 -- 172.21.15.50:0/513237835 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7ab81587b0 msgr2=0x7f7ab81f0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:35.101 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:35.099+0000 7f7ab7fff640 1 --2- 172.21.15.50:0/513237835 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7ab81587b0 0x7f7ab81f0390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:35.102 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:35.099+0000 7f7ab7fff640 1 -- 172.21.15.50:0/513237835 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ab8158560 con 0x7f7ab80cb350 2024-04-01T01:55:35.102 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:35.099+0000 7f7ab7fff640 1 --2- 172.21.15.50:0/513237835 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ab80cb350 0x7f7ab814ae90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7ab0004880 tx=0x7f7ab0010d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:35.102 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:35.099+0000 7f7a9ffff640 1 -- 172.21.15.50:0/513237835 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ab001a070 con 0x7f7ab80cb350 2024-04-01T01:55:35.102 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:35.099+0000 7f7a9ffff640 1 -- 172.21.15.50:0/513237835 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ab0011040 con 0x7f7ab80cb350 2024-04-01T01:55:35.102 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:35.099+0000 7f7abded2640 1 -- 172.21.15.50:0/513237835 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ab80b2340 con 0x7f7ab80cb350 2024-04-01T01:55:35.102 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:35.099+0000 7f7a9ffff640 1 -- 172.21.15.50:0/513237835 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ab000ed00 con 0x7f7ab80cb350 2024-04-01T01:55:35.102 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:35.099+0000 7f7abded2640 1 -- 172.21.15.50:0/513237835 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ab81efb90 con 0x7f7ab80cb350 2024-04-01T01:55:35.102 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:35.099+0000 7f7a9ffff640 1 -- 172.21.15.50:0/513237835 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f7ab001d070 con 0x7f7ab80cb350 2024-04-01T01:55:35.102 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:35.099+0000 7f7a9ffff640 1 -- 172.21.15.50:0/513237835 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f7ab0015ad0 con 0x7f7ab80cb350 2024-04-01T01:55:35.102 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:35.099+0000 7f7abded2640 1 -- 172.21.15.50:0/513237835 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ab8075450 con 0x7f7ab80cb350 2024-04-01T01:55:35.103 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:35.103+0000 7f7a9ffff640 1 -- 172.21.15.50:0/513237835 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f7ab0015400 con 0x7f7ab80cb350 2024-04-01T01:55:35.135 INFO:tasks.ceph.mgr.y.smithi050.stderr:2024-04-01T01:55:35.135+0000 7fdaac2f8180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-01T01:55:35.161 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:35.159+0000 7f7abded2640 1 -- 172.21.15.50:0/513237835 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7ab80ca660 con 0x7f7ab80cb350 2024-04-01T01:55:35.161 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:35.159+0000 7f7a9ffff640 1 -- 172.21.15.50:0/513237835 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f7ab00156f0 con 0x7f7ab80cb350 2024-04-01T01:55:35.162 INFO:teuthology.misc.health.smithi050.stdout: 2024-04-01T01:55:35.162 INFO:teuthology.misc.health.smithi050.stdout:{"epoch":10,"fsid":"f67878a9-bc75-426b-962d-fa7bc2517f7d","created":"2024-04-01T01:55:31.562371+0000","modified":"2024-04-01T01:55:33.849789+0000","last_up_change":"0.000000","last_in_change":"2024-04-01T01:55:33.849789+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"81e8ca4f-bde8-419a-875f-73a1f4a641ad","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"bd060ca0-7559-4d30-987c-62e59818431d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"eac5d816-a281-4acd-aa7d-b96a8e0aa962","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"12b23968-04a7-40b8-98c4-02b16ae28265","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"0e6b1639-23b0-47d9-8b08-40c8ab6df818","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"f0f876ef-0823-46e9-8fe4-9b7a64a94cee","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d29a625e-83bf-40ef-a57e-618220b96b9d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"7bcfd8f1-7dc0-4013-af17-16da5a8d931d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-01T01:55:35.163 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:35.163+0000 7f7abded2640 1 -- 172.21.15.50:0/513237835 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ab80cb350 msgr2=0x7f7ab814ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:35.163 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:35.163+0000 7f7abded2640 1 --2- 172.21.15.50:0/513237835 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ab80cb350 0x7f7ab814ae90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7ab0004880 tx=0x7f7ab0010d70 comp rx=0 tx=0).stop 2024-04-01T01:55:35.164 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:35.163+0000 7f7abded2640 1 -- 172.21.15.50:0/513237835 shutdown_connections 2024-04-01T01:55:35.164 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:35.163+0000 7f7abded2640 1 --2- 172.21.15.50:0/513237835 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ab80cb350 0x7f7ab814ae90 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:35.164 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:35.163+0000 7f7abded2640 1 --2- 172.21.15.50:0/513237835 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7ab81587b0 0x7f7ab81f0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:35.164 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:35.163+0000 7f7abded2640 1 --2- 172.21.15.50:0/513237835 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7aa0004810 0x7f7ab81e2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:35.164 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:35.163+0000 7f7abded2640 1 -- 172.21.15.50:0/513237835 >> 172.21.15.50:0/513237835 conn(0x7f7ab806da10 msgr2=0x7f7ab8152900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:55:35.164 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:35.163+0000 7f7abded2640 1 -- 172.21.15.50:0/513237835 shutdown_connections 2024-04-01T01:55:35.164 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:35.163+0000 7f7abded2640 1 -- 172.21.15.50:0/513237835 wait complete. 2024-04-01T01:55:35.178 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-01T01:55:35.352 INFO:tasks.ceph.mgr.x.smithi097.stderr:2024-04-01T01:55:35.354+0000 7f9de3d9c180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-01T01:55:35.426 INFO:tasks.ceph.mgr.x.smithi097.stderr:2024-04-01T01:55:35.425+0000 7f9de3d9c180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-01T01:55:35.608 INFO:tasks.ceph.mgr.x.smithi097.stderr:2024-04-01T01:55:35.605+0000 7f9de3d9c180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-01T01:55:35.680 INFO:tasks.ceph.mgr.x.smithi097.stderr:2024-04-01T01:55:35.677+0000 7f9de3d9c180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-01T01:55:35.801 INFO:tasks.ceph.mgr.y.smithi050.stderr:2024-04-01T01:55:35.799+0000 7fdaac2f8180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-01T01:55:35.882 INFO:tasks.ceph.mgr.y.smithi050.stderr:2024-04-01T01:55:35.879+0000 7fdaac2f8180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-01T01:55:35.965 INFO:tasks.ceph.mgr.x.smithi097.stderr:2024-04-01T01:55:35.965+0000 7f9de3d9c180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-01T01:55:36.025 INFO:tasks.ceph.mgr.x.smithi097.stderr:2024-04-01T01:55:36.025+0000 7f9de3d9c180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-01T01:55:36.069 INFO:tasks.ceph.mgr.y.smithi050.stderr:2024-04-01T01:55:36.067+0000 7fdaac2f8180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-01T01:55:36.147 INFO:tasks.ceph.mgr.y.smithi050.stderr:2024-04-01T01:55:36.147+0000 7fdaac2f8180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-01T01:55:36.451 INFO:tasks.ceph.mgr.y.smithi050.stderr:2024-04-01T01:55:36.451+0000 7fdaac2f8180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-01T01:55:36.515 INFO:tasks.ceph.mgr.y.smithi050.stderr:2024-04-01T01:55:36.515+0000 7fdaac2f8180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-01T01:55:37.070 INFO:tasks.ceph.mgr.x.smithi097.stderr:2024-04-01T01:55:37.069+0000 7f9d8b1e9640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-01T01:55:37.070 INFO:tasks.ceph.mgr.x.smithi097.stderr:2024-04-01T01:55:37.069+0000 7f9d8b1e9640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-01T01:55:37.756 INFO:tasks.ceph.osd.5.smithi097.stderr:2024-04-01T01:55:37.753+0000 7f6f1bc287c0 -1 osd.5 0 log_to_monitors true 2024-04-01T01:55:38.327 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-04-01T01:55:38.327+0000 7f4639d277c0 -1 osd.1 0 log_to_monitors true 2024-04-01T01:55:38.373 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-04-01T01:55:38.371+0000 7f67243a07c0 -1 osd.0 0 log_to_monitors true 2024-04-01T01:55:38.419 INFO:tasks.ceph.osd.4.smithi097.stderr:2024-04-01T01:55:38.417+0000 7f44bd67b7c0 -1 osd.4 0 log_to_monitors true 2024-04-01T01:55:38.432 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-04-01T01:55:38.431+0000 7f9994ad37c0 -1 osd.2 0 log_to_monitors true 2024-04-01T01:55:38.434 INFO:tasks.ceph.osd.7.smithi097.stderr:2024-04-01T01:55:38.433+0000 7f6ec6dd27c0 -1 osd.7 0 log_to_monitors true 2024-04-01T01:55:38.439 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-04-01T01:55:38.439+0000 7fc51a5727c0 -1 osd.3 0 log_to_monitors true 2024-04-01T01:55:38.525 INFO:tasks.ceph.osd.6.smithi097.stderr:2024-04-01T01:55:38.525+0000 7f5960fdf7c0 -1 osd.6 0 log_to_monitors true 2024-04-01T01:55:39.759 INFO:tasks.ceph.osd.5.smithi097.stderr:2024-04-01T01:55:39.757+0000 7f6f17bd1640 -1 osd.5 0 waiting for initial osdmap 2024-04-01T01:55:39.778 INFO:tasks.ceph.osd.5.smithi097.stderr:2024-04-01T01:55:39.777+0000 7f6f0fa06640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-01T01:55:41.022 INFO:tasks.ceph.osd.6.smithi097.stderr:2024-04-01T01:55:41.021+0000 7f595cf88640 -1 osd.6 0 waiting for initial osdmap 2024-04-01T01:55:41.045 INFO:tasks.ceph.osd.6.smithi097.stderr:2024-04-01T01:55:41.045+0000 7f5954dbd640 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-01T01:55:41.086 INFO:tasks.ceph.osd.4.smithi097.stderr:2024-04-01T01:55:41.085+0000 7f44b9e36640 -1 osd.4 0 waiting for initial osdmap 2024-04-01T01:55:41.102 INFO:tasks.ceph.osd.7.smithi097.stderr:2024-04-01T01:55:41.101+0000 7f6ec2d7b640 -1 osd.7 0 waiting for initial osdmap 2024-04-01T01:55:41.118 INFO:tasks.ceph.osd.4.smithi097.stderr:2024-04-01T01:55:41.117+0000 7f44b1459640 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-01T01:55:41.128 INFO:tasks.ceph.osd.7.smithi097.stderr:2024-04-01T01:55:41.129+0000 7f6ebabb0640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-01T01:55:41.278 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-04-01T01:55:41.275+0000 7fc51651b640 -1 osd.3 0 waiting for initial osdmap 2024-04-01T01:55:41.288 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-04-01T01:55:41.287+0000 7f46364e2640 -1 osd.1 0 waiting for initial osdmap 2024-04-01T01:55:41.299 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-04-01T01:55:41.299+0000 7fc50e350640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-01T01:55:41.305 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-04-01T01:55:41.303+0000 7f9990a7c640 -1 osd.2 0 waiting for initial osdmap 2024-04-01T01:55:41.314 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-04-01T01:55:41.315+0000 7f462db05640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-01T01:55:41.319 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-04-01T01:55:41.319+0000 7f6720349640 -1 osd.0 0 waiting for initial osdmap 2024-04-01T01:55:41.334 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-04-01T01:55:41.335+0000 7f99888b1640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-01T01:55:41.342 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-04-01T01:55:41.343+0000 7f671817e640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-01T01:55:41.985 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-01T01:55:42.107 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:42.107+0000 7f3910ae6640 1 Processor -- start 2024-04-01T01:55:42.107 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:42.107+0000 7f3910ae6640 1 -- start start 2024-04-01T01:55:42.108 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:42.107+0000 7f3910ae6640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f390c153ea0 0x7f390c0c79f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:42.108 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:42.107+0000 7f3910ae6640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f390c06b120 0x7f390c0c7f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:42.109 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:42.107+0000 7f3910ae6640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f390c15e210 con 0x7f390c0cc240 2024-04-01T01:55:42.109 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:42.107+0000 7f3910ae6640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f390c15d3b0 con 0x7f390c06b120 2024-04-01T01:55:42.109 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:42.107+0000 7f3910ae6640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f390c15d690 con 0x7f390c153ea0 2024-04-01T01:55:42.109 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:42.107+0000 7f3909d9b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f390c06b120 0x7f390c0c7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:42.109 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:42.107+0000 7f3909d9b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f390c06b120 0x7f390c0c7f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39574/0 (socket says 172.21.15.50:39574) 2024-04-01T01:55:42.109 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:42.107+0000 7f3909d9b640 1 -- 172.21.15.50:0/3702620171 learned_addr learned my addr 172.21.15.50:0/3702620171 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T01:55:42.109 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:42.107+0000 7f390ad9d640 1 --1- 172.21.15.50:0/3702620171 >> v1:172.21.15.50:6789/0 conn(0x7f390c0cc240 0x7f390c15a070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53778/0 (socket says 172.21.15.50:53778) 2024-04-01T01:55:42.109 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:42.107+0000 7f390a59c640 1 --2- 172.21.15.50:0/3702620171 >> v2:172.21.15.97:3300/0 conn(0x7f390c153ea0 0x7f390c0c79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:42.110 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:42.107+0000 7f3909d9b640 1 -- 172.21.15.50:0/3702620171 >> v2:172.21.15.97:3300/0 conn(0x7f390c153ea0 msgr2=0x7f390c0c79f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:55:42.110 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:42.107+0000 7f3909d9b640 1 --2- 172.21.15.50:0/3702620171 >> v2:172.21.15.97:3300/0 conn(0x7f390c153ea0 0x7f390c0c79f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:42.110 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:42.107+0000 7f3909d9b640 1 -- 172.21.15.50:0/3702620171 >> v1:172.21.15.50:6789/0 conn(0x7f390c0cc240 legacy=0x7f390c15a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:42.110 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:42.107+0000 7f3909d9b640 1 -- 172.21.15.50:0/3702620171 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f390c15d970 con 0x7f390c06b120 2024-04-01T01:55:42.112 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:42.111+0000 7f3909d9b640 1 --2- 172.21.15.50:0/3702620171 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f390c06b120 0x7f390c0c7f30 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f390c0cce80 tx=0x7f38f401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16fe8aace68af63f server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:42.132 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:42.131+0000 7f390959a640 1 -- 172.21.15.50:0/3702620171 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38f40b2070 con 0x7f390c06b120 2024-04-01T01:55:42.133 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:42.131+0000 7f390959a640 1 -- 172.21.15.50:0/3702620171 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38f40ad680 con 0x7f390c06b120 2024-04-01T01:55:42.133 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:42.131+0000 7f390959a640 1 -- 172.21.15.50:0/3702620171 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38f40ada50 con 0x7f390c06b120 2024-04-01T01:55:42.134 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:42.131+0000 7f3910ae6640 1 -- 172.21.15.50:0/3702620171 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f390c06b120 msgr2=0x7f390c0c7f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:42.134 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:42.131+0000 7f3910ae6640 1 --2- 172.21.15.50:0/3702620171 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f390c06b120 0x7f390c0c7f30 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f390c0cce80 tx=0x7f38f401c490 comp rx=0 tx=0).stop 2024-04-01T01:55:42.134 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:42.131+0000 7f3910ae6640 1 -- 172.21.15.50:0/3702620171 shutdown_connections 2024-04-01T01:55:42.134 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:42.131+0000 7f3910ae6640 1 --2- 172.21.15.50:0/3702620171 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f390c06b120 0x7f390c0c7f30 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:42.134 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:42.131+0000 7f3910ae6640 1 --2- 172.21.15.50:0/3702620171 >> v2:172.21.15.97:3300/0 conn(0x7f390c153ea0 0x7f390c0c79f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:42.134 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:42.131+0000 7f3910ae6640 1 -- 172.21.15.50:0/3702620171 >> 172.21.15.50:0/3702620171 conn(0x7f390c071fe0 msgr2=0x7f390c0723f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:55:42.134 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:42.135+0000 7f3910ae6640 1 -- 172.21.15.50:0/3702620171 shutdown_connections 2024-04-01T01:55:42.134 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:42.135+0000 7f3910ae6640 1 -- 172.21.15.50:0/3702620171 wait complete. 2024-04-01T01:55:42.136 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:42.135+0000 7f3910ae6640 1 Processor -- start 2024-04-01T01:55:42.137 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:42.135+0000 7f3910ae6640 1 -- start start 2024-04-01T01:55:42.138 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:42.135+0000 7f3910ae6640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f390c06b120 0x7f390c0cb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:42.138 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:42.135+0000 7f3910ae6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f390c0cc240 0x7f390c1430c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:42.139 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:42.135+0000 7f3910ae6640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f390c153ea0 0x7f390c1f6790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:42.139 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:42.135+0000 7f3910ae6640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f390c154400 con 0x7f390c0cc240 2024-04-01T01:55:42.139 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:42.135+0000 7f3910ae6640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f390c154280 con 0x7f390c153ea0 2024-04-01T01:55:42.139 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:42.135+0000 7f3910ae6640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f390c166ec0 con 0x7f390c06b120 2024-04-01T01:55:42.139 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:42.139+0000 7f390a59c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f390c06b120 0x7f390c0cb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:42.139 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:42.139+0000 7f390a59c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f390c06b120 0x7f390c0cb9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.50:56188/0 (socket says 172.21.15.50:56188) 2024-04-01T01:55:42.139 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:42.139+0000 7f390a59c640 1 -- 172.21.15.50:0/540871109 learned_addr learned my addr 172.21.15.50:0/540871109 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T01:55:42.139 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:42.139+0000 7f390ad9d640 1 --2- 172.21.15.50:0/540871109 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f390c153ea0 0x7f390c1f6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:42.139 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:42.139+0000 7f3909d9b640 1 --2- 172.21.15.50:0/540871109 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f390c0cc240 0x7f390c1430c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:42.140 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:42.139+0000 7f3909d9b640 1 -- 172.21.15.50:0/540871109 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f390c06b120 msgr2=0x7f390c0cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:42.140 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:42.139+0000 7f3909d9b640 1 --2- 172.21.15.50:0/540871109 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f390c06b120 0x7f390c0cb9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:42.140 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:42.139+0000 7f3909d9b640 1 -- 172.21.15.50:0/540871109 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f390c153ea0 msgr2=0x7f390c1f6790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:42.140 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:42.139+0000 7f3909d9b640 1 --2- 172.21.15.50:0/540871109 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f390c153ea0 0x7f390c1f6790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:42.140 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:42.139+0000 7f3909d9b640 1 -- 172.21.15.50:0/540871109 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f390c1496b0 con 0x7f390c0cc240 2024-04-01T01:55:42.140 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:42.139+0000 7f390a59c640 1 --2- 172.21.15.50:0/540871109 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f390c06b120 0x7f390c0cb9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T01:55:42.141 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:42.139+0000 7f3909d9b640 1 --2- 172.21.15.50:0/540871109 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f390c0cc240 0x7f390c1430c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f38f40ac000 tx=0x7f38f401acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:42.141 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:42.139+0000 7f3902ffd640 1 -- 172.21.15.50:0/540871109 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38f40b2040 con 0x7f390c0cc240 2024-04-01T01:55:42.141 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:42.139+0000 7f3910ae6640 1 -- 172.21.15.50:0/540871109 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f390c1477b0 con 0x7f390c0cc240 2024-04-01T01:55:42.143 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:42.139+0000 7f3910ae6640 1 -- 172.21.15.50:0/540871109 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f390c1474d0 con 0x7f390c0cc240 2024-04-01T01:55:42.143 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:42.143+0000 7f3902ffd640 1 -- 172.21.15.50:0/540871109 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38f40bd070 con 0x7f390c0cc240 2024-04-01T01:55:42.143 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:42.143+0000 7f3902ffd640 1 -- 172.21.15.50:0/540871109 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38f40addf0 con 0x7f390c0cc240 2024-04-01T01:55:42.144 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:42.143+0000 7f3910ae6640 1 -- 172.21.15.50:0/540871109 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f390c075450 con 0x7f390c0cc240 2024-04-01T01:55:42.145 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:42.143+0000 7f3902ffd640 1 -- 172.21.15.50:0/540871109 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 4) ==== 87047+0+0 (secure 0 0 0) 0x7f38f40c2460 con 0x7f390c0cc240 2024-04-01T01:55:42.145 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:42.143+0000 7f3902ffd640 1 --2- 172.21.15.50:0/540871109 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f38ec067390 0x7f38ec069850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:42.145 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:42.143+0000 7f3902ffd640 1 -- 172.21.15.50:0/540871109 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 4846+0+0 (secure 0 0 0) 0x7f38f411f130 con 0x7f390c0cc240 2024-04-01T01:55:42.146 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:42.147+0000 7f390a59c640 1 --2- 172.21.15.50:0/540871109 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f38ec067390 0x7f38ec069850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:42.147 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:42.147+0000 7f390a59c640 1 --2- 172.21.15.50:0/540871109 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f38ec067390 0x7f38ec069850 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f38fc0094c0 tx=0x7f38fc00b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:42.167 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:42.167+0000 7f3902ffd640 1 -- 172.21.15.50:0/540871109 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+176632 (secure 0 0 0) 0x7f38f4016110 con 0x7f390c0cc240 2024-04-01T01:55:42.321 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:42.319+0000 7f3910ae6640 1 -- 172.21.15.50:0/540871109 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f390c0c6440 con 0x7f390c0cc240 2024-04-01T01:55:42.323 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:42.323+0000 7f3902ffd640 1 -- 172.21.15.50:0/540871109 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) ==== 74+0+12666 (secure 0 0 0) 0x7f38f40efc90 con 0x7f390c0cc240 2024-04-01T01:55:42.323 INFO:teuthology.misc.health.smithi050.stdout: 2024-04-01T01:55:42.323 INFO:teuthology.misc.health.smithi050.stdout:{"epoch":15,"fsid":"f67878a9-bc75-426b-962d-fa7bc2517f7d","created":"2024-04-01T01:55:31.562371+0000","modified":"2024-04-01T01:55:42.134502+0000","last_up_change":"2024-04-01T01:55:42.134502+0000","last_in_change":"2024-04-01T01:55:33.849789+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-01T01:55:42.134418+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"81e8ca4f-bde8-419a-875f-73a1f4a641ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":4170468134},{"type":"v1","addr":"172.21.15.50:6825","nonce":4170468134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":4170468134},{"type":"v1","addr":"172.21.15.50:6827","nonce":4170468134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":4170468134},{"type":"v1","addr":"172.21.15.50:6831","nonce":4170468134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":4170468134},{"type":"v1","addr":"172.21.15.50:6829","nonce":4170468134}]},"public_addr":"172.21.15.50:6825/4170468134","cluster_addr":"172.21.15.50:6827/4170468134","heartbeat_back_addr":"172.21.15.50:6831/4170468134","heartbeat_front_addr":"172.21.15.50:6829/4170468134","state":["exists","up"]},{"osd":1,"uuid":"bd060ca0-7559-4d30-987c-62e59818431d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1794491326},{"type":"v1","addr":"172.21.15.50:6809","nonce":1794491326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1794491326},{"type":"v1","addr":"172.21.15.50:6811","nonce":1794491326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1794491326},{"type":"v1","addr":"172.21.15.50:6815","nonce":1794491326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1794491326},{"type":"v1","addr":"172.21.15.50:6813","nonce":1794491326}]},"public_addr":"172.21.15.50:6809/1794491326","cluster_addr":"172.21.15.50:6811/1794491326","heartbeat_back_addr":"172.21.15.50:6815/1794491326","heartbeat_front_addr":"172.21.15.50:6813/1794491326","state":["exists","up"]},{"osd":2,"uuid":"eac5d816-a281-4acd-aa7d-b96a8e0aa962","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":710247177},{"type":"v1","addr":"172.21.15.50:6801","nonce":710247177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":710247177},{"type":"v1","addr":"172.21.15.50:6803","nonce":710247177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":710247177},{"type":"v1","addr":"172.21.15.50:6807","nonce":710247177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":710247177},{"type":"v1","addr":"172.21.15.50:6805","nonce":710247177}]},"public_addr":"172.21.15.50:6801/710247177","cluster_addr":"172.21.15.50:6803/710247177","heartbeat_back_addr":"172.21.15.50:6807/710247177","heartbeat_front_addr":"172.21.15.50:6805/710247177","state":["exists","up"]},{"osd":3,"uuid":"12b23968-04a7-40b8-98c4-02b16ae28265","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":871680805},{"type":"v1","addr":"172.21.15.50:6817","nonce":871680805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":871680805},{"type":"v1","addr":"172.21.15.50:6819","nonce":871680805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":871680805},{"type":"v1","addr":"172.21.15.50:6823","nonce":871680805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":871680805},{"type":"v1","addr":"172.21.15.50:6821","nonce":871680805}]},"public_addr":"172.21.15.50:6817/871680805","cluster_addr":"172.21.15.50:6819/871680805","heartbeat_back_addr":"172.21.15.50:6823/871680805","heartbeat_front_addr":"172.21.15.50:6821/871680805","state":["exists","up"]},{"osd":4,"uuid":"0e6b1639-23b0-47d9-8b08-40c8ab6df818","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":1095319381},{"type":"v1","addr":"172.21.15.97:6801","nonce":1095319381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":1095319381},{"type":"v1","addr":"172.21.15.97:6803","nonce":1095319381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":1095319381},{"type":"v1","addr":"172.21.15.97:6807","nonce":1095319381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":1095319381},{"type":"v1","addr":"172.21.15.97:6805","nonce":1095319381}]},"public_addr":"172.21.15.97:6801/1095319381","cluster_addr":"172.21.15.97:6803/1095319381","heartbeat_back_addr":"172.21.15.97:6807/1095319381","heartbeat_front_addr":"172.21.15.97:6805/1095319381","state":["exists","up"]},{"osd":5,"uuid":"f0f876ef-0823-46e9-8fe4-9b7a64a94cee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":899031308},{"type":"v1","addr":"172.21.15.97:6817","nonce":899031308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":899031308},{"type":"v1","addr":"172.21.15.97:6819","nonce":899031308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":899031308},{"type":"v1","addr":"172.21.15.97:6823","nonce":899031308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":899031308},{"type":"v1","addr":"172.21.15.97:6821","nonce":899031308}]},"public_addr":"172.21.15.97:6817/899031308","cluster_addr":"172.21.15.97:6819/899031308","heartbeat_back_addr":"172.21.15.97:6823/899031308","heartbeat_front_addr":"172.21.15.97:6821/899031308","state":["exists","up"]},{"osd":6,"uuid":"d29a625e-83bf-40ef-a57e-618220b96b9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2224814961},{"type":"v1","addr":"172.21.15.97:6825","nonce":2224814961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2224814961},{"type":"v1","addr":"172.21.15.97:6827","nonce":2224814961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2224814961},{"type":"v1","addr":"172.21.15.97:6831","nonce":2224814961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2224814961},{"type":"v1","addr":"172.21.15.97:6829","nonce":2224814961}]},"public_addr":"172.21.15.97:6825/2224814961","cluster_addr":"172.21.15.97:6827/2224814961","heartbeat_back_addr":"172.21.15.97:6831/2224814961","heartbeat_front_addr":"172.21.15.97:6829/2224814961","state":["exists","up"]},{"osd":7,"uuid":"7bcfd8f1-7dc0-4013-af17-16da5a8d931d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":284968823},{"type":"v1","addr":"172.21.15.97:6809","nonce":284968823}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":284968823},{"type":"v1","addr":"172.21.15.97:6811","nonce":284968823}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6814","nonce":284968823},{"type":"v1","addr":"172.21.15.97:6815","nonce":284968823}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":284968823},{"type":"v1","addr":"172.21.15.97:6813","nonce":284968823}]},"public_addr":"172.21.15.97:6809/284968823","cluster_addr":"172.21.15.97:6811/284968823","heartbeat_back_addr":"172.21.15.97:6815/284968823","heartbeat_front_addr":"172.21.15.97:6813/284968823","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T01:55:38.728924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T01:55:39.522411+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-01T01:55:42.325 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:42.323+0000 7f3910ae6640 1 -- 172.21.15.50:0/540871109 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f38ec067390 msgr2=0x7f38ec069850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:42.325 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:42.323+0000 7f3910ae6640 1 --2- 172.21.15.50:0/540871109 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f38ec067390 0x7f38ec069850 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f38fc0094c0 tx=0x7f38fc00b040 comp rx=0 tx=0).stop 2024-04-01T01:55:42.326 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:42.323+0000 7f3910ae6640 1 -- 172.21.15.50:0/540871109 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f390c0cc240 msgr2=0x7f390c1430c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:42.326 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:42.323+0000 7f3910ae6640 1 --2- 172.21.15.50:0/540871109 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f390c0cc240 0x7f390c1430c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f38f40ac000 tx=0x7f38f401acd0 comp rx=0 tx=0).stop 2024-04-01T01:55:42.326 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:42.323+0000 7f3910ae6640 1 -- 172.21.15.50:0/540871109 shutdown_connections 2024-04-01T01:55:42.326 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:42.323+0000 7f3910ae6640 1 --2- 172.21.15.50:0/540871109 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f38ec067390 0x7f38ec069850 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:42.326 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:42.323+0000 7f3910ae6640 1 --2- 172.21.15.50:0/540871109 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f390c153ea0 0x7f390c1f6790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:42.326 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:42.323+0000 7f3910ae6640 1 --2- 172.21.15.50:0/540871109 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f390c0cc240 0x7f390c1430c0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:42.326 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:42.323+0000 7f3910ae6640 1 --2- 172.21.15.50:0/540871109 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f390c06b120 0x7f390c0cb9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:42.326 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:42.323+0000 7f3910ae6640 1 -- 172.21.15.50:0/540871109 >> 172.21.15.50:0/540871109 conn(0x7f390c071fe0 msgr2=0x7f390c0c79f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:55:42.326 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:42.323+0000 7f3910ae6640 1 -- 172.21.15.50:0/540871109 shutdown_connections 2024-04-01T01:55:42.326 INFO:teuthology.misc.health.smithi050.stderr:2024-04-01T01:55:42.323+0000 7f3910ae6640 1 -- 172.21.15.50:0/540871109 wait complete. 2024-04-01T01:55:42.339 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-04-01T01:55:42.340 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-01T01:55:42.340 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-01T01:55:42.340 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mds -f --cluster ceph -i a 2024-04-01T01:55:42.342 INFO:tasks.ceph.mds.a:Started 2024-04-01T01:55:42.342 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-01T01:55:42.342 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mds -f --cluster ceph -i c 2024-04-01T01:55:42.344 INFO:tasks.ceph.mds.c:Started 2024-04-01T01:55:42.345 INFO:tasks.ceph.mds.e:Restarting daemon 2024-04-01T01:55:42.345 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mds -f --cluster ceph -i e 2024-04-01T01:55:42.346 INFO:tasks.ceph.mds.e:Started 2024-04-01T01:55:42.347 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-01T01:55:42.347 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mds -f --cluster ceph -i b 2024-04-01T01:55:42.349 INFO:tasks.ceph.mds.b:Started 2024-04-01T01:55:42.350 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-01T01:55:42.350 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mds -f --cluster ceph -i d 2024-04-01T01:55:42.353 INFO:tasks.ceph.mds.d:Started 2024-04-01T01:55:42.353 INFO:tasks.ceph.mds.f:Restarting daemon 2024-04-01T01:55:42.353 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mds -f --cluster ceph -i f 2024-04-01T01:55:42.355 INFO:tasks.ceph.mds.f:Started 2024-04-01T01:55:42.356 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-01T01:55:42.356 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-01T01:55:42.409 INFO:tasks.ceph.mds.e.smithi050.stdout:starting mds.e at 2024-04-01T01:55:42.410 INFO:tasks.ceph.mds.c.smithi050.stdout:starting mds.c at 2024-04-01T01:55:42.410 INFO:tasks.ceph.mds.a.smithi050.stdout:starting mds.a at 2024-04-01T01:55:42.433 INFO:tasks.ceph.mds.f.smithi097.stdout:starting mds.f at 2024-04-01T01:55:42.439 INFO:tasks.ceph.mds.b.smithi097.stdout:starting mds.b at 2024-04-01T01:55:42.439 INFO:tasks.ceph.mds.d.smithi097.stdout:starting mds.d at 2024-04-01T01:55:42.440 INFO:tasks.ceph.mds.d.smithi097.stderr:2024-04-01T01:55:42.441+0000 7f45d8d17640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6836/0: (98) Address already in use 2024-04-01T01:55:42.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.467+0000 7faa33b01640 1 Processor -- start 2024-04-01T01:55:42.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.467+0000 7faa33b01640 1 -- start start 2024-04-01T01:55:42.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.467+0000 7faa33b01640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faa2c072530 0x7faa2c0c7820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:42.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.467+0000 7faa33b01640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7faa2c0c7d60 0x7faa2c1615d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:42.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.467+0000 7faa33b01640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa2c0c81b0 con 0x7faa2c150f20 2024-04-01T01:55:42.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.467+0000 7faa33b01640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7faa2c151300 con 0x7faa2c0c7d60 2024-04-01T01:55:42.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.467+0000 7faa33b01640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7faa2c0c8a40 con 0x7faa2c072530 2024-04-01T01:55:42.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.467+0000 7faa3109c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faa2c072530 0x7faa2c0c7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:42.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.467+0000 7faa3109c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faa2c072530 0x7faa2c0c7820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.50:56230/0 (socket says 172.21.15.50:56230) 2024-04-01T01:55:42.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.467+0000 7faa3109c640 1 -- 172.21.15.50:0/3781233395 learned_addr learned my addr 172.21.15.50:0/3781233395 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T01:55:42.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.467+0000 7faa3209e640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7faa2c0c7d60 0x7faa2c1615d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:42.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.467+0000 7faa3189d640 1 --1- 172.21.15.50:0/3781233395 >> v1:172.21.15.97:6789/0 conn(0x7faa2c150f20 0x7faa2c0c3a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.50:44676/0 (socket says 172.21.15.50:44676) 2024-04-01T01:55:42.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.467+0000 7faa3209e640 1 -- 172.21.15.50:0/3781233395 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faa2c072530 msgr2=0x7faa2c0c7820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:55:42.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.467+0000 7faa3209e640 1 --2- 172.21.15.50:0/3781233395 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faa2c072530 0x7faa2c0c7820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:42.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.467+0000 7faa3209e640 1 -- 172.21.15.50:0/3781233395 >> v1:172.21.15.97:6789/0 conn(0x7faa2c150f20 legacy=0x7faa2c0c3a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:42.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.467+0000 7faa3209e640 1 -- 172.21.15.50:0/3781233395 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa2c0c8d20 con 0x7faa2c0c7d60 2024-04-01T01:55:42.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.467+0000 7faa3089b640 1 -- 172.21.15.50:0/3781233395 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1576324854 0 0) 0x7faa2c0c81b0 con 0x7faa2c150f20 2024-04-01T01:55:42.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.467+0000 7faa3109c640 1 --2- 172.21.15.50:0/3781233395 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faa2c072530 0x7faa2c0c7820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T01:55:42.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.471+0000 7faa3209e640 1 --2- 172.21.15.50:0/3781233395 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faa2c0c7d60 0x7faa2c1615d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7faa24009d90 tx=0x7faa2401c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e05ae785dec3f55b server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:42.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.471+0000 7faa3089b640 1 -- 172.21.15.50:0/3781233395 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa240b2070 con 0x7faa2c0c7d60 2024-04-01T01:55:42.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.471+0000 7faa3089b640 1 -- 172.21.15.50:0/3781233395 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa240a5900 con 0x7faa2c0c7d60 2024-04-01T01:55:42.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.471+0000 7faa3089b640 1 -- 172.21.15.50:0/3781233395 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa240a5cd0 con 0x7faa2c0c7d60 2024-04-01T01:55:42.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.471+0000 7faa33b01640 1 -- 172.21.15.50:0/3781233395 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faa2c0c7d60 msgr2=0x7faa2c1615d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:42.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.471+0000 7faa33b01640 1 --2- 172.21.15.50:0/3781233395 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faa2c0c7d60 0x7faa2c1615d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7faa24009d90 tx=0x7faa2401c940 comp rx=0 tx=0).stop 2024-04-01T01:55:42.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.471+0000 7faa33b01640 1 -- 172.21.15.50:0/3781233395 shutdown_connections 2024-04-01T01:55:42.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.471+0000 7faa33b01640 1 --2- 172.21.15.50:0/3781233395 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faa2c0c7d60 0x7faa2c1615d0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:42.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.471+0000 7faa33b01640 1 --2- 172.21.15.50:0/3781233395 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faa2c072530 0x7faa2c0c7820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:42.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.471+0000 7faa33b01640 1 -- 172.21.15.50:0/3781233395 >> 172.21.15.50:0/3781233395 conn(0x7faa2c067130 msgr2=0x7faa2c06c330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:55:42.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.471+0000 7faa33b01640 1 -- 172.21.15.50:0/3781233395 shutdown_connections 2024-04-01T01:55:42.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.471+0000 7faa33b01640 1 -- 172.21.15.50:0/3781233395 wait complete. 2024-04-01T01:55:42.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.471+0000 7faa33b01640 1 Processor -- start 2024-04-01T01:55:42.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.471+0000 7faa33b01640 1 -- start start 2024-04-01T01:55:42.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.471+0000 7faa33b01640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faa2c072530 0x7faa2c14a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:42.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.471+0000 7faa33b01640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa2c0c7d60 0x7faa2c0c1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:42.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.471+0000 7faa33b01640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faa2c150f20 0x7faa2c14fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:42.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.471+0000 7faa33b01640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7faa2c0c86e0 con 0x7faa2c0c7d60 2024-04-01T01:55:42.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.471+0000 7faa33b01640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7faa2c0c6260 con 0x7faa2c072530 2024-04-01T01:55:42.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.471+0000 7faa33b01640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7faa2c072d20 con 0x7faa2c150f20 2024-04-01T01:55:42.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.471+0000 7faa3109c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa2c0c7d60 0x7faa2c0c1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:42.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.471+0000 7faa3109c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa2c0c7d60 0x7faa2c0c1860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39618/0 (socket says 172.21.15.50:39618) 2024-04-01T01:55:42.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.471+0000 7faa3109c640 1 -- 172.21.15.50:0/3508793274 learned_addr learned my addr 172.21.15.50:0/3508793274 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T01:55:42.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.471+0000 7faa3189d640 1 --2- 172.21.15.50:0/3508793274 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faa2c072530 0x7faa2c14a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:42.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.471+0000 7faa3209e640 1 --2- 172.21.15.50:0/3508793274 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faa2c150f20 0x7faa2c14fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:42.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.471+0000 7faa3109c640 1 -- 172.21.15.50:0/3508793274 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faa2c150f20 msgr2=0x7faa2c14fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:42.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.471+0000 7faa3109c640 1 --2- 172.21.15.50:0/3508793274 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faa2c150f20 0x7faa2c14fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:42.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.471+0000 7faa3109c640 1 -- 172.21.15.50:0/3508793274 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faa2c072530 msgr2=0x7faa2c14a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:42.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.471+0000 7faa3109c640 1 --2- 172.21.15.50:0/3508793274 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faa2c072530 0x7faa2c14a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:42.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.471+0000 7faa3109c640 1 -- 172.21.15.50:0/3508793274 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa2c0cc5e0 con 0x7faa2c0c7d60 2024-04-01T01:55:42.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.471+0000 7faa3209e640 1 --2- 172.21.15.50:0/3508793274 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faa2c150f20 0x7faa2c14fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T01:55:42.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.471+0000 7faa3109c640 1 --2- 172.21.15.50:0/3508793274 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa2c0c7d60 0x7faa2c0c1860 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7faa2800eda0 tx=0x7faa2800d720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:42.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.471+0000 7faa1e7fc640 1 -- 172.21.15.50:0/3508793274 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa28010850 con 0x7faa2c0c7d60 2024-04-01T01:55:42.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.471+0000 7faa1e7fc640 1 -- 172.21.15.50:0/3508793274 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa280109f0 con 0x7faa2c0c7d60 2024-04-01T01:55:42.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.471+0000 7faa33b01640 1 -- 172.21.15.50:0/3508793274 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa2c1483d0 con 0x7faa2c0c7d60 2024-04-01T01:55:42.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.471+0000 7faa1e7fc640 1 -- 172.21.15.50:0/3508793274 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa28010da0 con 0x7faa2c0c7d60 2024-04-01T01:55:42.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.471+0000 7faa33b01640 1 -- 172.21.15.50:0/3508793274 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa2c148990 con 0x7faa2c0c7d60 2024-04-01T01:55:42.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.475+0000 7faa33b01640 1 -- 172.21.15.50:0/3508793274 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa2c068940 con 0x7faa2c0c7d60 2024-04-01T01:55:42.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.475+0000 7faa1e7fc640 1 -- 172.21.15.50:0/3508793274 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 4) ==== 87047+0+0 (secure 0 0 0) 0x7faa2800f3d0 con 0x7faa2c0c7d60 2024-04-01T01:55:42.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.475+0000 7faa1e7fc640 1 --2- 172.21.15.50:0/3508793274 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7faa100673c0 0x7faa10069880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:42.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.475+0000 7faa1e7fc640 1 -- 172.21.15.50:0/3508793274 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 4846+0+0 (secure 0 0 0) 0x7faa28085c30 con 0x7faa2c0c7d60 2024-04-01T01:55:42.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.475+0000 7faa3189d640 1 --2- 172.21.15.50:0/3508793274 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7faa100673c0 0x7faa10069880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:42.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.475+0000 7faa3189d640 1 --2- 172.21.15.50:0/3508793274 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7faa100673c0 0x7faa10069880 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7faa20000f70 tx=0x7faa20007c10 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:42.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.479+0000 7faa1e7fc640 1 -- 172.21.15.50:0/3508793274 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+176632 (secure 0 0 0) 0x7faa28014030 con 0x7faa2c0c7d60 2024-04-01T01:55:42.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.635+0000 7faa33b01640 1 -- 172.21.15.50:0/3508793274 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7faa2c073030 con 0x7faa2c0c7d60 2024-04-01T01:55:42.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.635+0000 7faa1e7fc640 1 -- 172.21.15.50:0/3508793274 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) ==== 74+0+12666 (secure 0 0 0) 0x7faa28056d80 con 0x7faa2c0c7d60 2024-04-01T01:55:42.636 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-01T01:55:42.636 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":15,"fsid":"f67878a9-bc75-426b-962d-fa7bc2517f7d","created":"2024-04-01T01:55:31.562371+0000","modified":"2024-04-01T01:55:42.134502+0000","last_up_change":"2024-04-01T01:55:42.134502+0000","last_in_change":"2024-04-01T01:55:33.849789+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-01T01:55:42.134418+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"81e8ca4f-bde8-419a-875f-73a1f4a641ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":4170468134},{"type":"v1","addr":"172.21.15.50:6825","nonce":4170468134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":4170468134},{"type":"v1","addr":"172.21.15.50:6827","nonce":4170468134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":4170468134},{"type":"v1","addr":"172.21.15.50:6831","nonce":4170468134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":4170468134},{"type":"v1","addr":"172.21.15.50:6829","nonce":4170468134}]},"public_addr":"172.21.15.50:6825/4170468134","cluster_addr":"172.21.15.50:6827/4170468134","heartbeat_back_addr":"172.21.15.50:6831/4170468134","heartbeat_front_addr":"172.21.15.50:6829/4170468134","state":["exists","up"]},{"osd":1,"uuid":"bd060ca0-7559-4d30-987c-62e59818431d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1794491326},{"type":"v1","addr":"172.21.15.50:6809","nonce":1794491326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1794491326},{"type":"v1","addr":"172.21.15.50:6811","nonce":1794491326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1794491326},{"type":"v1","addr":"172.21.15.50:6815","nonce":1794491326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1794491326},{"type":"v1","addr":"172.21.15.50:6813","nonce":1794491326}]},"public_addr":"172.21.15.50:6809/1794491326","cluster_addr":"172.21.15.50:6811/1794491326","heartbeat_back_addr":"172.21.15.50:6815/1794491326","heartbeat_front_addr":"172.21.15.50:6813/1794491326","state":["exists","up"]},{"osd":2,"uuid":"eac5d816-a281-4acd-aa7d-b96a8e0aa962","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":710247177},{"type":"v1","addr":"172.21.15.50:6801","nonce":710247177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":710247177},{"type":"v1","addr":"172.21.15.50:6803","nonce":710247177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":710247177},{"type":"v1","addr":"172.21.15.50:6807","nonce":710247177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":710247177},{"type":"v1","addr":"172.21.15.50:6805","nonce":710247177}]},"public_addr":"172.21.15.50:6801/710247177","cluster_addr":"172.21.15.50:6803/710247177","heartbeat_back_addr":"172.21.15.50:6807/710247177","heartbeat_front_addr":"172.21.15.50:6805/710247177","state":["exists","up"]},{"osd":3,"uuid":"12b23968-04a7-40b8-98c4-02b16ae28265","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":871680805},{"type":"v1","addr":"172.21.15.50:6817","nonce":871680805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":871680805},{"type":"v1","addr":"172.21.15.50:6819","nonce":871680805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":871680805},{"type":"v1","addr":"172.21.15.50:6823","nonce":871680805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":871680805},{"type":"v1","addr":"172.21.15.50:6821","nonce":871680805}]},"public_addr":"172.21.15.50:6817/871680805","cluster_addr":"172.21.15.50:6819/871680805","heartbeat_back_addr":"172.21.15.50:6823/871680805","heartbeat_front_addr":"172.21.15.50:6821/871680805","state":["exists","up"]},{"osd":4,"uuid":"0e6b1639-23b0-47d9-8b08-40c8ab6df818","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":1095319381},{"type":"v1","addr":"172.21.15.97:6801","nonce":1095319381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":1095319381},{"type":"v1","addr":"172.21.15.97:6803","nonce":1095319381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":1095319381},{"type":"v1","addr":"172.21.15.97:6807","nonce":1095319381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":1095319381},{"type":"v1","addr":"172.21.15.97:6805","nonce":1095319381}]},"public_addr":"172.21.15.97:6801/1095319381","cluster_addr":"172.21.15.97:6803/1095319381","heartbeat_back_addr":"172.21.15.97:6807/1095319381","heartbeat_front_addr":"172.21.15.97:6805/1095319381","state":["exists","up"]},{"osd":5,"uuid":"f0f876ef-0823-46e9-8fe4-9b7a64a94cee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":899031308},{"type":"v1","addr":"172.21.15.97:6817","nonce":899031308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":899031308},{"type":"v1","addr":"172.21.15.97:6819","nonce":899031308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":899031308},{"type":"v1","addr":"172.21.15.97:6823","nonce":899031308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":899031308},{"type":"v1","addr":"172.21.15.97:6821","nonce":899031308}]},"public_addr":"172.21.15.97:6817/899031308","cluster_addr":"172.21.15.97:6819/899031308","heartbeat_back_addr":"172.21.15.97:6823/899031308","heartbeat_front_addr":"172.21.15.97:6821/899031308","state":["exists","up"]},{"osd":6,"uuid":"d29a625e-83bf-40ef-a57e-618220b96b9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2224814961},{"type":"v1","addr":"172.21.15.97:6825","nonce":2224814961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2224814961},{"type":"v1","addr":"172.21.15.97:6827","nonce":2224814961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2224814961},{"type":"v1","addr":"172.21.15.97:6831","nonce":2224814961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2224814961},{"type":"v1","addr":"172.21.15.97:6829","nonce":2224814961}]},"public_addr":"172.21.15.97:6825/2224814961","cluster_addr":"172.21.15.97:6827/2224814961","heartbeat_back_addr":"172.21.15.97:6831/2224814961","heartbeat_front_addr":"172.21.15.97:6829/2224814961","state":["exists","up"]},{"osd":7,"uuid":"7bcfd8f1-7dc0-4013-af17-16da5a8d931d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":284968823},{"type":"v1","addr":"172.21.15.97:6809","nonce":284968823}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":284968823},{"type":"v1","addr":"172.21.15.97:6811","nonce":284968823}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6814","nonce":284968823},{"type":"v1","addr":"172.21.15.97:6815","nonce":284968823}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":284968823},{"type":"v1","addr":"172.21.15.97:6813","nonce":284968823}]},"public_addr":"172.21.15.97:6809/284968823","cluster_addr":"172.21.15.97:6811/284968823","heartbeat_back_addr":"172.21.15.97:6815/284968823","heartbeat_front_addr":"172.21.15.97:6813/284968823","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T01:55:38.728924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T01:55:39.522411+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-01T01:55:42.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.635+0000 7faa33b01640 1 -- 172.21.15.50:0/3508793274 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7faa100673c0 msgr2=0x7faa10069880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:42.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.635+0000 7faa33b01640 1 --2- 172.21.15.50:0/3508793274 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7faa100673c0 0x7faa10069880 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7faa20000f70 tx=0x7faa20007c10 comp rx=0 tx=0).stop 2024-04-01T01:55:42.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.635+0000 7faa33b01640 1 -- 172.21.15.50:0/3508793274 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa2c0c7d60 msgr2=0x7faa2c0c1860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:42.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.635+0000 7faa33b01640 1 --2- 172.21.15.50:0/3508793274 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa2c0c7d60 0x7faa2c0c1860 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7faa2800eda0 tx=0x7faa2800d720 comp rx=0 tx=0).stop 2024-04-01T01:55:42.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.639+0000 7faa33b01640 1 -- 172.21.15.50:0/3508793274 shutdown_connections 2024-04-01T01:55:42.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.639+0000 7faa33b01640 1 --2- 172.21.15.50:0/3508793274 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7faa100673c0 0x7faa10069880 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:42.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.639+0000 7faa33b01640 1 --2- 172.21.15.50:0/3508793274 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faa2c150f20 0x7faa2c14fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:42.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.639+0000 7faa33b01640 1 --2- 172.21.15.50:0/3508793274 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa2c0c7d60 0x7faa2c0c1860 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:42.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.639+0000 7faa33b01640 1 --2- 172.21.15.50:0/3508793274 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faa2c072530 0x7faa2c14a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:42.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.639+0000 7faa33b01640 1 -- 172.21.15.50:0/3508793274 >> 172.21.15.50:0/3508793274 conn(0x7faa2c067130 msgr2=0x7faa2c070810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:55:42.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.639+0000 7faa33b01640 1 -- 172.21.15.50:0/3508793274 shutdown_connections 2024-04-01T01:55:42.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.639+0000 7faa33b01640 1 -- 172.21.15.50:0/3508793274 wait complete. 2024-04-01T01:55:42.654 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-01T01:55:42.134418+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-01T01:55:42.654 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-01T01:55:42.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.775+0000 7f64709d8640 1 Processor -- start 2024-04-01T01:55:42.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.775+0000 7f64709d8640 1 -- start start 2024-04-01T01:55:42.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.775+0000 7f64709d8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f646c150b60 0x7f646c15aa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:42.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.779+0000 7f64709d8640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f646c06f8d0 con 0x7f646c06ee40 2024-04-01T01:55:42.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.779+0000 7f64709d8640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f646c15d6c0 con 0x7f646c06f240 2024-04-01T01:55:42.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.779+0000 7f64709d8640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f646c15dff0 con 0x7f646c150b60 2024-04-01T01:55:42.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.779+0000 7f6461d9b640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f646c06ee40 0x7f646c071350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53806/0 (socket says 172.21.15.50:53806) 2024-04-01T01:55:42.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.779+0000 7f6461d9b640 1 -- 172.21.15.50:0/2009776492 learned_addr learned my addr 172.21.15.50:0/2009776492 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-04-01T01:55:42.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.779+0000 7f646a59c640 1 --2- 172.21.15.50:0/2009776492 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f646c150b60 0x7f646c15aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:42.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.779+0000 7f6469d9b640 1 -- 172.21.15.50:0/2009776492 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3401155645 0 0) 0x7f646c06f8d0 con 0x7f646c06ee40 2024-04-01T01:55:42.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.779+0000 7f6469d9b640 1 -- 172.21.15.50:0/2009776492 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6458003530 con 0x7f646c06ee40 2024-04-01T01:55:42.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.779+0000 7f6469d9b640 1 -- 172.21.15.50:0/2009776492 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1367411514 0 0) 0x7f6458003530 con 0x7f646c06ee40 2024-04-01T01:55:42.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.779+0000 7f6469d9b640 1 -- 172.21.15.50:0/2009776492 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f646c150b60 msgr2=0x7f646c15aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:55:42.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.779+0000 7f6469d9b640 1 --2- 172.21.15.50:0/2009776492 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f646c150b60 0x7f646c15aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:42.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.779+0000 7f6469d9b640 1 -- 172.21.15.50:0/2009776492 >> v1:172.21.15.97:6789/0 conn(0x7f646c06f240 legacy=0x7f646c0c6400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:42.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.779+0000 7f6469d9b640 1 -- 172.21.15.50:0/2009776492 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f646c15d9a0 con 0x7f646c06ee40 2024-04-01T01:55:42.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.779+0000 7f6469d9b640 1 -- 172.21.15.50:0/2009776492 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2779672543 0 0) 0x7f6454001680 con 0x7f646c06ee40 2024-04-01T01:55:42.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.779+0000 7f6469d9b640 1 -- 172.21.15.50:0/2009776492 >> v1:172.21.15.50:6789/0 conn(0x7f646c06ee40 legacy=0x7f646c071350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:42.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.779+0000 7f6469d9b640 1 --2- 172.21.15.50:0/2009776492 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f646c150b60 0x7f64580039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:42.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.779+0000 7f6469d9b640 1 --2- 172.21.15.50:0/2009776492 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6458003f70 0x7f6458004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:42.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.779+0000 7f6469d9b640 1 --2- 172.21.15.50:0/2009776492 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6458004d50 0x7f64580051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:42.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.779+0000 7f6469d9b640 1 -- 172.21.15.50:0/2009776492 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f646c15dff0 con 0x7f6458003f70 2024-04-01T01:55:42.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.779+0000 7f6469d9b640 1 -- 172.21.15.50:0/2009776492 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f645800bb40 con 0x7f6458004d50 2024-04-01T01:55:42.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.779+0000 7f6469d9b640 1 -- 172.21.15.50:0/2009776492 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f645800bd40 con 0x7f646c150b60 2024-04-01T01:55:42.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.779+0000 7f6461d9b640 1 --2- 172.21.15.50:0/2009776492 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6458003f70 0x7f6458004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:42.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.779+0000 7f646ad9d640 1 --2- 172.21.15.50:0/2009776492 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6458004d50 0x7f64580051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:42.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.779+0000 7f6461d9b640 1 -- 172.21.15.50:0/2009776492 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f646c150b60 msgr2=0x7f64580039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:55:42.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.779+0000 7f646a59c640 1 --2- 172.21.15.50:0/2009776492 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f646c150b60 0x7f64580039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:42.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.779+0000 7f6461d9b640 1 --2- 172.21.15.50:0/2009776492 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f646c150b60 0x7f64580039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:42.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.779+0000 7f6461d9b640 1 -- 172.21.15.50:0/2009776492 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6458004d50 msgr2=0x7f64580051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:55:42.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.779+0000 7f6461d9b640 1 --2- 172.21.15.50:0/2009776492 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6458004d50 0x7f64580051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:42.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.779+0000 7f6461d9b640 1 -- 172.21.15.50:0/2009776492 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6458003530 con 0x7f6458003f70 2024-04-01T01:55:42.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.779+0000 7f646a59c640 1 --2- 172.21.15.50:0/2009776492 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f646c150b60 0x7f64580039f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T01:55:42.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.779+0000 7f646ad9d640 1 --2- 172.21.15.50:0/2009776492 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6458004d50 0x7f64580051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T01:55:42.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.779+0000 7f6461d9b640 1 --2- 172.21.15.50:0/2009776492 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6458003f70 0x7f6458004810 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f645400c1c0 tx=0x7f645401cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9aa2a86c6f369f06 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:42.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.779+0000 7f6469d9b640 1 -- 172.21.15.50:0/2009776492 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6454007d00 con 0x7f6458003f70 2024-04-01T01:55:42.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.779+0000 7f6469d9b640 1 -- 172.21.15.50:0/2009776492 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64540a9020 con 0x7f6458003f70 2024-04-01T01:55:42.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.779+0000 7f6469d9b640 1 -- 172.21.15.50:0/2009776492 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64540a5b60 con 0x7f6458003f70 2024-04-01T01:55:42.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.779+0000 7f64709d8640 1 -- 172.21.15.50:0/2009776492 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6458003f70 msgr2=0x7f6458004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:42.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.779+0000 7f64709d8640 1 --2- 172.21.15.50:0/2009776492 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6458003f70 0x7f6458004810 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f645400c1c0 tx=0x7f645401cc60 comp rx=0 tx=0).stop 2024-04-01T01:55:42.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.783+0000 7f646ad9d640 1 -- 172.21.15.50:0/2009776492 reap_dead start 2024-04-01T01:55:42.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.783+0000 7f64709d8640 1 -- 172.21.15.50:0/2009776492 shutdown_connections 2024-04-01T01:55:42.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.783+0000 7f64709d8640 1 -- 172.21.15.50:0/2009776492 >> 172.21.15.50:0/2009776492 conn(0x7f646c0676f0 msgr2=0x7f646c0c8010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:55:42.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.783+0000 7f64709d8640 1 -- 172.21.15.50:0/2009776492 shutdown_connections 2024-04-01T01:55:42.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.783+0000 7f64709d8640 1 -- 172.21.15.50:0/2009776492 wait complete. 2024-04-01T01:55:42.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.783+0000 7f64709d8640 1 Processor -- start 2024-04-01T01:55:42.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.783+0000 7f64709d8640 1 -- start start 2024-04-01T01:55:42.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.783+0000 7f64709d8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6458003f70 0x7f646c142c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:42.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.783+0000 7f64709d8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f646c0c9610 0x7f646c144210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:42.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.783+0000 7f64709d8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f646c1521a0 0x7f646c1f3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:42.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.783+0000 7f64709d8640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f646c150f40 con 0x7f6458003f70 2024-04-01T01:55:42.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.783+0000 7f64709d8640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f646c06f670 con 0x7f646c0c9610 2024-04-01T01:55:42.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.783+0000 7f64709d8640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f646c1510c0 con 0x7f646c1521a0 2024-04-01T01:55:42.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.783+0000 7f646a59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6458003f70 0x7f646c142c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:42.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.783+0000 7f646a59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6458003f70 0x7f646c142c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39638/0 (socket says 172.21.15.50:39638) 2024-04-01T01:55:42.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.783+0000 7f646a59c640 1 -- 172.21.15.50:0/1048887631 learned_addr learned my addr 172.21.15.50:0/1048887631 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T01:55:42.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.783+0000 7f6461d9b640 1 --2- 172.21.15.50:0/1048887631 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f646c0c9610 0x7f646c144210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:42.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.783+0000 7f646a59c640 1 -- 172.21.15.50:0/1048887631 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f646c1521a0 msgr2=0x7f646c1f3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:42.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.783+0000 7f646ad9d640 1 --2- 172.21.15.50:0/1048887631 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f646c1521a0 0x7f646c1f3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:42.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.783+0000 7f646a59c640 1 --2- 172.21.15.50:0/1048887631 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f646c1521a0 0x7f646c1f3260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:42.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.783+0000 7f646a59c640 1 -- 172.21.15.50:0/1048887631 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f646c0c9610 msgr2=0x7f646c144210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:42.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.783+0000 7f646a59c640 1 --2- 172.21.15.50:0/1048887631 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f646c0c9610 0x7f646c144210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:42.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.783+0000 7f646a59c640 1 -- 172.21.15.50:0/1048887631 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f646c0cc230 con 0x7f6458003f70 2024-04-01T01:55:42.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.783+0000 7f6461d9b640 1 --2- 172.21.15.50:0/1048887631 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f646c0c9610 0x7f646c144210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T01:55:42.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.783+0000 7f646a59c640 1 --2- 172.21.15.50:0/1048887631 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6458003f70 0x7f646c142c00 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f645c010900 tx=0x7f645c010dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:42.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.783+0000 7f64637fe640 1 -- 172.21.15.50:0/1048887631 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f645c00f040 con 0x7f6458003f70 2024-04-01T01:55:42.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.783+0000 7f64637fe640 1 -- 172.21.15.50:0/1048887631 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f645c00ec20 con 0x7f6458003f70 2024-04-01T01:55:42.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.783+0000 7f64709d8640 1 -- 172.21.15.50:0/1048887631 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f646c151440 con 0x7f6458003f70 2024-04-01T01:55:42.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.783+0000 7f64637fe640 1 -- 172.21.15.50:0/1048887631 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f645c004020 con 0x7f6458003f70 2024-04-01T01:55:42.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.783+0000 7f64709d8640 1 -- 172.21.15.50:0/1048887631 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f646c14e060 con 0x7f6458003f70 2024-04-01T01:55:42.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.783+0000 7f64709d8640 1 -- 172.21.15.50:0/1048887631 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f646c14db70 con 0x7f6458003f70 2024-04-01T01:55:42.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.787+0000 7f64637fe640 1 -- 172.21.15.50:0/1048887631 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 4) ==== 87047+0+0 (secure 0 0 0) 0x7f645c0041c0 con 0x7f6458003f70 2024-04-01T01:55:42.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.787+0000 7f64637fe640 1 --2- 172.21.15.50:0/1048887631 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f644c067390 0x7f644c069850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:42.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.787+0000 7f64637fe640 1 -- 172.21.15.50:0/1048887631 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 4846+0+0 (secure 0 0 0) 0x7f645c0855f0 con 0x7f6458003f70 2024-04-01T01:55:42.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.787+0000 7f6461d9b640 1 --2- 172.21.15.50:0/1048887631 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f644c067390 0x7f644c069850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:42.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.787+0000 7f6461d9b640 1 --2- 172.21.15.50:0/1048887631 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f644c067390 0x7f644c069850 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f64540aa000 tx=0x7f646c0c71a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:42.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.791+0000 7f64637fe640 1 -- 172.21.15.50:0/1048887631 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+176632 (secure 0 0 0) 0x7f645c018030 con 0x7f6458003f70 2024-04-01T01:55:42.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.951+0000 7f64709d8640 1 -- 172.21.15.50:0/1048887631 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f646c068230 con 0x7f6458003f70 2024-04-01T01:55:42.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.955+0000 7f64637fe640 1 -- 172.21.15.50:0/1048887631 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v15) ==== 93+0+10 (secure 0 0 0) 0x7f645c056800 con 0x7f6458003f70 2024-04-01T01:55:42.955 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2024-04-01T01:55:42.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.955+0000 7f64709d8640 1 -- 172.21.15.50:0/1048887631 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f644c067390 msgr2=0x7f644c069850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:42.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.955+0000 7f64709d8640 1 --2- 172.21.15.50:0/1048887631 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f644c067390 0x7f644c069850 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f64540aa000 tx=0x7f646c0c71a0 comp rx=0 tx=0).stop 2024-04-01T01:55:42.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.955+0000 7f64709d8640 1 -- 172.21.15.50:0/1048887631 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6458003f70 msgr2=0x7f646c142c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:42.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.955+0000 7f64709d8640 1 --2- 172.21.15.50:0/1048887631 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6458003f70 0x7f646c142c00 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f645c010900 tx=0x7f645c010dc0 comp rx=0 tx=0).stop 2024-04-01T01:55:42.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.955+0000 7f64709d8640 1 -- 172.21.15.50:0/1048887631 shutdown_connections 2024-04-01T01:55:42.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.955+0000 7f64709d8640 1 --2- 172.21.15.50:0/1048887631 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f644c067390 0x7f644c069850 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:42.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.955+0000 7f64709d8640 1 --2- 172.21.15.50:0/1048887631 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f646c1521a0 0x7f646c1f3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:42.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.955+0000 7f64709d8640 1 --2- 172.21.15.50:0/1048887631 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f646c0c9610 0x7f646c144210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:42.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.955+0000 7f64709d8640 1 --2- 172.21.15.50:0/1048887631 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6458003f70 0x7f646c142c00 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:42.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.955+0000 7f64709d8640 1 -- 172.21.15.50:0/1048887631 >> 172.21.15.50:0/1048887631 conn(0x7f646c0676f0 msgr2=0x7f646c0c63c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:55:42.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.955+0000 7f64709d8640 1 -- 172.21.15.50:0/1048887631 shutdown_connections 2024-04-01T01:55:42.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:42.955+0000 7f64709d8640 1 -- 172.21.15.50:0/1048887631 wait complete. 2024-04-01T01:55:42.973 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-01T01:55:43.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:43.095+0000 7f0593413640 1 Processor -- start 2024-04-01T01:55:43.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:43.095+0000 7f0593413640 1 -- start start 2024-04-01T01:55:43.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:43.095+0000 7f0593413640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f058c151f50 0x7f058c06fec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:43.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:43.095+0000 7f0593413640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f058c0706d0 0x7f058c15b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:43.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:43.095+0000 7f0593413640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f058c15b7f0 0x7f058c0cd620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:43.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:43.095+0000 7f0593413640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f058c0c31f0 con 0x7f058c15b7f0 2024-04-01T01:55:43.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:43.095+0000 7f0593413640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f058c0c2750 con 0x7f058c0706d0 2024-04-01T01:55:43.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:43.095+0000 7f0593413640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f058c070400 con 0x7f058c151f50 2024-04-01T01:55:43.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:43.099+0000 7f05919b0640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f058c15b7f0 0x7f058c0cd620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:43.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:43.099+0000 7f05919b0640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f058c15b7f0 0x7f058c0cd620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39648/0 (socket says 172.21.15.50:39648) 2024-04-01T01:55:43.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:43.099+0000 7f05919b0640 1 -- 172.21.15.50:0/3192784438 learned_addr learned my addr 172.21.15.50:0/3192784438 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T01:55:43.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:43.099+0000 7f05911af640 1 --2- 172.21.15.50:0/3192784438 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f058c151f50 0x7f058c06fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:43.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:43.099+0000 7f05909ae640 1 --2- 172.21.15.50:0/3192784438 >> v2:172.21.15.97:3300/0 conn(0x7f058c0706d0 0x7f058c15b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:43.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:43.099+0000 7f05919b0640 1 -- 172.21.15.50:0/3192784438 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f058c151f50 msgr2=0x7f058c06fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:55:43.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:43.099+0000 7f05919b0640 1 --2- 172.21.15.50:0/3192784438 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f058c151f50 0x7f058c06fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:43.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:43.099+0000 7f05919b0640 1 -- 172.21.15.50:0/3192784438 >> v2:172.21.15.97:3300/0 conn(0x7f058c0706d0 msgr2=0x7f058c15b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:55:43.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:43.099+0000 7f05919b0640 1 --2- 172.21.15.50:0/3192784438 >> v2:172.21.15.97:3300/0 conn(0x7f058c0706d0 0x7f058c15b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:43.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:43.099+0000 7f05919b0640 1 -- 172.21.15.50:0/3192784438 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f058c0c8db0 con 0x7f058c15b7f0 2024-04-01T01:55:43.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:43.099+0000 7f05911af640 1 --2- 172.21.15.50:0/3192784438 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f058c151f50 0x7f058c06fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T01:55:43.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:43.099+0000 7f05919b0640 1 --2- 172.21.15.50:0/3192784438 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f058c15b7f0 0x7f058c0cd620 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f058c067930 tx=0x7f057c01f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17a429f656ed9ea8 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:43.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:43.099+0000 7f058bfff640 1 -- 172.21.15.50:0/3192784438 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f057c0b4070 con 0x7f058c15b7f0 2024-04-01T01:55:43.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:43.099+0000 7f058bfff640 1 -- 172.21.15.50:0/3192784438 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f057c0af400 con 0x7f058c15b7f0 2024-04-01T01:55:43.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:43.099+0000 7f058bfff640 1 -- 172.21.15.50:0/3192784438 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f057c0af7d0 con 0x7f058c15b7f0 2024-04-01T01:55:43.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:43.099+0000 7f0593413640 1 -- 172.21.15.50:0/3192784438 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f058c15b7f0 msgr2=0x7f058c0cd620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:43.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:43.099+0000 7f0593413640 1 --2- 172.21.15.50:0/3192784438 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f058c15b7f0 0x7f058c0cd620 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f058c067930 tx=0x7f057c01f1e0 comp rx=0 tx=0).stop 2024-04-01T01:55:43.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:43.099+0000 7f0593413640 1 -- 172.21.15.50:0/3192784438 shutdown_connections 2024-04-01T01:55:43.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:43.099+0000 7f0593413640 1 --2- 172.21.15.50:0/3192784438 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f058c15b7f0 0x7f058c0cd620 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:43.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:43.099+0000 7f0593413640 1 --2- 172.21.15.50:0/3192784438 >> v2:172.21.15.97:3300/0 conn(0x7f058c0706d0 0x7f058c15b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:43.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:43.099+0000 7f0593413640 1 --2- 172.21.15.50:0/3192784438 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f058c151f50 0x7f058c06fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:43.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:43.099+0000 7f0593413640 1 -- 172.21.15.50:0/3192784438 >> 172.21.15.50:0/3192784438 conn(0x7f058c06b220 msgr2=0x7f058c06b630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:55:43.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:43.099+0000 7f0593413640 1 -- 172.21.15.50:0/3192784438 shutdown_connections 2024-04-01T01:55:43.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:43.103+0000 7f0593413640 1 -- 172.21.15.50:0/3192784438 wait complete. 2024-04-01T01:55:43.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:43.103+0000 7f0593413640 1 Processor -- start 2024-04-01T01:55:43.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:43.103+0000 7f0593413640 1 -- start start 2024-04-01T01:55:43.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:43.103+0000 7f0593413640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f058c0706d0 0x7f058c0c4830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:43.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:43.103+0000 7f0593413640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f058c151f50 0x7f058c0cce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:43.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:43.103+0000 7f0593413640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f058c15b7f0 0x7f058c1ef110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:43.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:43.103+0000 7f0593413640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f058c0c29f0 con 0x7f058c0706d0 2024-04-01T01:55:43.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:43.103+0000 7f0593413640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f058c0c8510 con 0x7f058c15b7f0 2024-04-01T01:55:43.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:43.103+0000 7f0593413640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f058c0c2cd0 con 0x7f058c151f50 2024-04-01T01:55:43.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:43.103+0000 7f05911af640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f058c0706d0 0x7f058c0c4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:43.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:43.103+0000 7f05911af640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f058c0706d0 0x7f058c0c4830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39650/0 (socket says 172.21.15.50:39650) 2024-04-01T01:55:43.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:43.103+0000 7f05911af640 1 -- 172.21.15.50:0/4095281873 learned_addr learned my addr 172.21.15.50:0/4095281873 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T01:55:43.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:43.103+0000 7f05919b0640 1 --2- 172.21.15.50:0/4095281873 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f058c15b7f0 0x7f058c1ef110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:43.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:43.103+0000 7f05909ae640 1 --2- 172.21.15.50:0/4095281873 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f058c151f50 0x7f058c0cce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:43.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:43.103+0000 7f05911af640 1 -- 172.21.15.50:0/4095281873 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f058c151f50 msgr2=0x7f058c0cce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:43.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:43.103+0000 7f05911af640 1 --2- 172.21.15.50:0/4095281873 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f058c151f50 0x7f058c0cce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:43.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:43.103+0000 7f05911af640 1 -- 172.21.15.50:0/4095281873 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f058c15b7f0 msgr2=0x7f058c1ef110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:43.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:43.103+0000 7f05911af640 1 --2- 172.21.15.50:0/4095281873 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f058c15b7f0 0x7f058c1ef110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:43.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:43.103+0000 7f05911af640 1 -- 172.21.15.50:0/4095281873 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f058c1e1ce0 con 0x7f058c0706d0 2024-04-01T01:55:43.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:43.103+0000 7f05909ae640 1 --2- 172.21.15.50:0/4095281873 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f058c151f50 0x7f058c0cce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T01:55:43.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:43.103+0000 7f05911af640 1 --2- 172.21.15.50:0/4095281873 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f058c0706d0 0x7f058c0c4830 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f058400e840 tx=0x7f058400ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:43.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:43.103+0000 7f0589ffb640 1 -- 172.21.15.50:0/4095281873 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0584017070 con 0x7f058c0706d0 2024-04-01T01:55:43.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:43.103+0000 7f0589ffb640 1 -- 172.21.15.50:0/4095281873 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f058400c8d0 con 0x7f058c0706d0 2024-04-01T01:55:43.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:43.103+0000 7f0593413640 1 -- 172.21.15.50:0/4095281873 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f058c1f1650 con 0x7f058c0706d0 2024-04-01T01:55:43.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:43.103+0000 7f0589ffb640 1 -- 172.21.15.50:0/4095281873 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f058400f040 con 0x7f058c0706d0 2024-04-01T01:55:43.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:43.103+0000 7f0593413640 1 -- 172.21.15.50:0/4095281873 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f058c1ee910 con 0x7f058c0706d0 2024-04-01T01:55:43.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:43.103+0000 7f0593413640 1 -- 172.21.15.50:0/4095281873 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f058c068940 con 0x7f058c0706d0 2024-04-01T01:55:43.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:43.107+0000 7f0589ffb640 1 -- 172.21.15.50:0/4095281873 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 4) ==== 87047+0+0 (secure 0 0 0) 0x7f058401a070 con 0x7f058c0706d0 2024-04-01T01:55:43.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:43.107+0000 7f0589ffb640 1 --2- 172.21.15.50:0/4095281873 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f05780673c0 0x7f0578069880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:43.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:43.107+0000 7f0589ffb640 1 -- 172.21.15.50:0/4095281873 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 4846+0+0 (secure 0 0 0) 0x7f0584084da0 con 0x7f058c0706d0 2024-04-01T01:55:43.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:43.107+0000 7f05909ae640 1 --2- 172.21.15.50:0/4095281873 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f05780673c0 0x7f0578069880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:43.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:43.107+0000 7f05909ae640 1 --2- 172.21.15.50:0/4095281873 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f05780673c0 0x7f0578069880 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f058c0c4ea0 tx=0x7f0580008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:43.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:43.111+0000 7f0589ffb640 1 -- 172.21.15.50:0/4095281873 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+176632 (secure 0 0 0) 0x7f0584055f80 con 0x7f058c0706d0 2024-04-01T01:55:43.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:43.311+0000 7f0593413640 1 -- 172.21.15.50:0/4095281873 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f058c0b2280 con 0x7f058c0706d0 2024-04-01T01:55:43.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:43.315+0000 7f0589ffb640 1 -- 172.21.15.50:0/4095281873 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1389 (secure 0 0 0) 0x7f0584055880 con 0x7f058c0706d0 2024-04-01T01:55:43.315 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-01T01:55:43.315 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6836/194873808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":194873808},{"type":"v1","addr":"172.21.15.50:6836","nonce":194873808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-01T01:55:43.315 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 2 2024-04-01T01:55:43.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:43.315+0000 7f0593413640 1 -- 172.21.15.50:0/4095281873 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f05780673c0 msgr2=0x7f0578069880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:43.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:43.315+0000 7f0593413640 1 --2- 172.21.15.50:0/4095281873 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f05780673c0 0x7f0578069880 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f058c0c4ea0 tx=0x7f0580008040 comp rx=0 tx=0).stop 2024-04-01T01:55:43.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:43.315+0000 7f0593413640 1 -- 172.21.15.50:0/4095281873 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f058c0706d0 msgr2=0x7f058c0c4830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:43.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:43.315+0000 7f0593413640 1 --2- 172.21.15.50:0/4095281873 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f058c0706d0 0x7f058c0c4830 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f058400e840 tx=0x7f058400ed00 comp rx=0 tx=0).stop 2024-04-01T01:55:43.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:43.315+0000 7f0593413640 1 -- 172.21.15.50:0/4095281873 shutdown_connections 2024-04-01T01:55:43.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:43.315+0000 7f0593413640 1 --2- 172.21.15.50:0/4095281873 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f05780673c0 0x7f0578069880 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:43.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:43.315+0000 7f0593413640 1 --2- 172.21.15.50:0/4095281873 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f058c15b7f0 0x7f058c1ef110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:43.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:43.315+0000 7f0593413640 1 --2- 172.21.15.50:0/4095281873 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f058c151f50 0x7f058c0cce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:43.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:43.315+0000 7f0593413640 1 --2- 172.21.15.50:0/4095281873 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f058c0706d0 0x7f058c0c4830 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:43.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:43.315+0000 7f0593413640 1 -- 172.21.15.50:0/4095281873 >> 172.21.15.50:0/4095281873 conn(0x7f058c06b220 msgr2=0x7f058c06b600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:55:43.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:43.315+0000 7f0593413640 1 -- 172.21.15.50:0/4095281873 shutdown_connections 2024-04-01T01:55:43.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:43.315+0000 7f0593413640 1 -- 172.21.15.50:0/4095281873 wait complete. 2024-04-01T01:55:45.333 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-01T01:55:45.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.466+0000 7fa1eaa4c640 1 Processor -- start 2024-04-01T01:55:45.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.466+0000 7fa1eaa4c640 1 -- start start 2024-04-01T01:55:45.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.466+0000 7fa1eaa4c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa1e4150e60 0x7fa1e4072f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:45.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.466+0000 7fa1eaa4c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa1e40c73a0 0x7fa1e40c2900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:45.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.466+0000 7fa1eaa4c640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1e4073470 con 0x7fa1e40c77c0 2024-04-01T01:55:45.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.466+0000 7fa1eaa4c640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fa1e41578f0 con 0x7fa1e40c73a0 2024-04-01T01:55:45.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.466+0000 7fa1eaa4c640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fa1e4156a20 con 0x7fa1e4150e60 2024-04-01T01:55:45.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.466+0000 7fa1dbfff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa1e40c73a0 0x7fa1e40c2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:45.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.466+0000 7fa1dbfff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa1e40c73a0 0x7fa1e40c2900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39656/0 (socket says 172.21.15.50:39656) 2024-04-01T01:55:45.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.466+0000 7fa1dbfff640 1 -- 172.21.15.50:0/2279054664 learned_addr learned my addr 172.21.15.50:0/2279054664 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T01:55:45.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.470+0000 7fa1e3fff640 1 --2- 172.21.15.50:0/2279054664 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa1e4150e60 0x7fa1e4072f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:45.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.470+0000 7fa1dbfff640 1 -- 172.21.15.50:0/2279054664 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa1e4150e60 msgr2=0x7fa1e4072f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:55:45.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.470+0000 7fa1dbfff640 1 --2- 172.21.15.50:0/2279054664 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa1e4150e60 0x7fa1e4072f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:45.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.470+0000 7fa1dbfff640 1 -- 172.21.15.50:0/2279054664 >> v1:172.21.15.97:6789/0 conn(0x7fa1e40c77c0 legacy=0x7fa1e415a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:45.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.470+0000 7fa1dbfff640 1 -- 172.21.15.50:0/2279054664 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1e4156ce0 con 0x7fa1e40c73a0 2024-04-01T01:55:45.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.470+0000 7fa1dbfff640 1 --2- 172.21.15.50:0/2279054664 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1e40c73a0 0x7fa1e40c2900 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa1cc009870 tx=0x7fa1cc01ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23861004def39689 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:45.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.470+0000 7fa1e37fe640 1 -- 172.21.15.50:0/2279054664 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1cc0b5070 con 0x7fa1e40c73a0 2024-04-01T01:55:45.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.470+0000 7fa1e37fe640 1 -- 172.21.15.50:0/2279054664 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1cc0a8a50 con 0x7fa1e40c73a0 2024-04-01T01:55:45.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.470+0000 7fa1e37fe640 1 -- 172.21.15.50:0/2279054664 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1cc0a8e20 con 0x7fa1e40c73a0 2024-04-01T01:55:45.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.470+0000 7fa1eaa4c640 1 -- 172.21.15.50:0/2279054664 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1e40c73a0 msgr2=0x7fa1e40c2900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:45.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.470+0000 7fa1eaa4c640 1 --2- 172.21.15.50:0/2279054664 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1e40c73a0 0x7fa1e40c2900 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa1cc009870 tx=0x7fa1cc01ed50 comp rx=0 tx=0).stop 2024-04-01T01:55:45.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.470+0000 7fa1eaa4c640 1 -- 172.21.15.50:0/2279054664 shutdown_connections 2024-04-01T01:55:45.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.470+0000 7fa1eaa4c640 1 --2- 172.21.15.50:0/2279054664 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1e40c73a0 0x7fa1e40c2900 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:45.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.470+0000 7fa1eaa4c640 1 --2- 172.21.15.50:0/2279054664 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa1e4150e60 0x7fa1e4072f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:45.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.470+0000 7fa1eaa4c640 1 -- 172.21.15.50:0/2279054664 >> 172.21.15.50:0/2279054664 conn(0x7fa1e4067560 msgr2=0x7fa1e406b220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:55:45.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.470+0000 7fa1eaa4c640 1 -- 172.21.15.50:0/2279054664 shutdown_connections 2024-04-01T01:55:45.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.470+0000 7fa1eaa4c640 1 -- 172.21.15.50:0/2279054664 wait complete. 2024-04-01T01:55:45.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.474+0000 7fa1eaa4c640 1 Processor -- start 2024-04-01T01:55:45.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.474+0000 7fa1eaa4c640 1 -- start start 2024-04-01T01:55:45.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.474+0000 7fa1eaa4c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1e40c73a0 0x7fa1e41ee530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:45.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.474+0000 7fa1eaa4c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa1e4150e60 0x7fa1e4155b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:45.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.474+0000 7fa1eaa4c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa1e414efa0 0x7fa1e414f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:45.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.474+0000 7fa1eaa4c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa1e4157580 con 0x7fa1e40c73a0 2024-04-01T01:55:45.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.474+0000 7fa1eaa4c640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fa1e41572a0 con 0x7fa1e4150e60 2024-04-01T01:55:45.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.474+0000 7fa1eaa4c640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fa1e415aa00 con 0x7fa1e414efa0 2024-04-01T01:55:45.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.474+0000 7fa1e3fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1e40c73a0 0x7fa1e41ee530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:45.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.474+0000 7fa1e3fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1e40c73a0 0x7fa1e41ee530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39668/0 (socket says 172.21.15.50:39668) 2024-04-01T01:55:45.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.474+0000 7fa1e3fff640 1 -- 172.21.15.50:0/2487175332 learned_addr learned my addr 172.21.15.50:0/2487175332 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T01:55:45.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.474+0000 7fa1dbfff640 1 --2- 172.21.15.50:0/2487175332 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa1e4150e60 0x7fa1e4155b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:45.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.474+0000 7fa1e8fe9640 1 --2- 172.21.15.50:0/2487175332 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa1e414efa0 0x7fa1e414f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:45.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.474+0000 7fa1e3fff640 1 -- 172.21.15.50:0/2487175332 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa1e414efa0 msgr2=0x7fa1e414f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:45.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.474+0000 7fa1e3fff640 1 --2- 172.21.15.50:0/2487175332 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa1e414efa0 0x7fa1e414f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:45.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.474+0000 7fa1e3fff640 1 -- 172.21.15.50:0/2487175332 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa1e4150e60 msgr2=0x7fa1e4155b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:45.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.474+0000 7fa1e3fff640 1 --2- 172.21.15.50:0/2487175332 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa1e4150e60 0x7fa1e4155b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:45.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.474+0000 7fa1e3fff640 1 -- 172.21.15.50:0/2487175332 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1e41e1550 con 0x7fa1e40c73a0 2024-04-01T01:55:45.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.474+0000 7fa1dbfff640 1 --2- 172.21.15.50:0/2487175332 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa1e4150e60 0x7fa1e4155b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T01:55:45.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.474+0000 7fa1e3fff640 1 --2- 172.21.15.50:0/2487175332 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1e40c73a0 0x7fa1e41ee530 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa1d400d620 tx=0x7fa1d400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:45.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.474+0000 7fa1e17fa640 1 -- 172.21.15.50:0/2487175332 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1d400b620 con 0x7fa1e40c73a0 2024-04-01T01:55:45.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.474+0000 7fa1e17fa640 1 -- 172.21.15.50:0/2487175332 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1d4019070 con 0x7fa1e40c73a0 2024-04-01T01:55:45.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.474+0000 7fa1eaa4c640 1 -- 172.21.15.50:0/2487175332 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1e41e17f0 con 0x7fa1e40c73a0 2024-04-01T01:55:45.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.474+0000 7fa1e17fa640 1 -- 172.21.15.50:0/2487175332 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1d400b9e0 con 0x7fa1e40c73a0 2024-04-01T01:55:45.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.474+0000 7fa1eaa4c640 1 -- 172.21.15.50:0/2487175332 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1e414e7a0 con 0x7fa1e40c73a0 2024-04-01T01:55:45.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.474+0000 7fa1eaa4c640 1 -- 172.21.15.50:0/2487175332 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1e4068230 con 0x7fa1e40c73a0 2024-04-01T01:55:45.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.474+0000 7fa1e17fa640 1 -- 172.21.15.50:0/2487175332 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 87103+0+0 (secure 0 0 0) 0x7fa1d400bb80 con 0x7fa1e40c73a0 2024-04-01T01:55:45.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.478+0000 7fa1e17fa640 1 --2- 172.21.15.50:0/2487175332 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fa1c4067450 0x7fa1c4069910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:45.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.478+0000 7fa1e17fa640 1 -- 172.21.15.50:0/2487175332 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fa1d4085790 con 0x7fa1e40c73a0 2024-04-01T01:55:45.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.478+0000 7fa1dbfff640 1 --2- 172.21.15.50:0/2487175332 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fa1c4067450 0x7fa1c4069910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:45.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.478+0000 7fa1dbfff640 1 --2- 172.21.15.50:0/2487175332 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fa1c4067450 0x7fa1c4069910 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa1cc0b2000 tx=0x7fa1cc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:45.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.482+0000 7fa1e17fa640 1 -- 172.21.15.50:0/2487175332 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+176632 (secure 0 0 0) 0x7fa1d40567f0 con 0x7fa1e40c73a0 2024-04-01T01:55:45.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.678+0000 7fa1eaa4c640 1 -- 172.21.15.50:0/2487175332 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa1e40712b0 con 0x7fa1e40c73a0 2024-04-01T01:55:45.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.678+0000 7fa1e17fa640 1 -- 172.21.15.50:0/2487175332 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+5503 (secure 0 0 0) 0x7fa1d40560f0 con 0x7fa1e40c73a0 2024-04-01T01:55:45.680 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-01T01:55:45.680 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6839/3495253895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6837","nonce":3495253895},{"type":"v1","addr":"172.21.15.97:6839","nonce":3495253895}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6838/1055159165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":1055159165},{"type":"v1","addr":"172.21.15.97:6838","nonce":1055159165}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4251,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/716162893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":716162893},{"type":"v1","addr":"172.21.15.50:6833","nonce":716162893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6836/194873808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":194873808},{"type":"v1","addr":"172.21.15.50:6836","nonce":194873808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4264,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/2250920298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6835","nonce":2250920298},{"type":"v1","addr":"172.21.15.50:6837","nonce":2250920298}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4279,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/974386562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":974386562},{"type":"v1","addr":"172.21.15.97:6835","nonce":974386562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-04-01T01:55:45.681 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 3 2024-04-01T01:55:45.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.682+0000 7fa1eaa4c640 1 -- 172.21.15.50:0/2487175332 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fa1c4067450 msgr2=0x7fa1c4069910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:45.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.682+0000 7fa1eaa4c640 1 --2- 172.21.15.50:0/2487175332 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fa1c4067450 0x7fa1c4069910 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa1cc0b2000 tx=0x7fa1cc008040 comp rx=0 tx=0).stop 2024-04-01T01:55:45.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.682+0000 7fa1eaa4c640 1 -- 172.21.15.50:0/2487175332 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1e40c73a0 msgr2=0x7fa1e41ee530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:45.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.682+0000 7fa1eaa4c640 1 --2- 172.21.15.50:0/2487175332 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1e40c73a0 0x7fa1e41ee530 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa1d400d620 tx=0x7fa1d400dae0 comp rx=0 tx=0).stop 2024-04-01T01:55:45.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.682+0000 7fa1eaa4c640 1 -- 172.21.15.50:0/2487175332 shutdown_connections 2024-04-01T01:55:45.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.682+0000 7fa1eaa4c640 1 --2- 172.21.15.50:0/2487175332 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fa1c4067450 0x7fa1c4069910 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:45.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.682+0000 7fa1eaa4c640 1 --2- 172.21.15.50:0/2487175332 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa1e414efa0 0x7fa1e414f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:45.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.682+0000 7fa1eaa4c640 1 --2- 172.21.15.50:0/2487175332 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa1e4150e60 0x7fa1e4155b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:45.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.682+0000 7fa1eaa4c640 1 --2- 172.21.15.50:0/2487175332 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1e40c73a0 0x7fa1e41ee530 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:45.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.682+0000 7fa1eaa4c640 1 -- 172.21.15.50:0/2487175332 >> 172.21.15.50:0/2487175332 conn(0x7fa1e4067560 msgr2=0x7fa1e40714d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:55:45.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.682+0000 7fa1eaa4c640 1 -- 172.21.15.50:0/2487175332 shutdown_connections 2024-04-01T01:55:45.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.682+0000 7fa1eaa4c640 1 -- 172.21.15.50:0/2487175332 wait complete. 2024-04-01T01:55:45.699 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-01T01:55:45.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.814+0000 7f1478c73640 1 Processor -- start 2024-04-01T01:55:45.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.814+0000 7f1478c73640 1 -- start start 2024-04-01T01:55:45.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.818+0000 7f1478c73640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1474151de0 0x7f1474157be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:45.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.818+0000 7f1478c73640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f1474158120 0x7f1474162560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:45.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.818+0000 7f1478c73640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14740c30d0 con 0x7f14740c2900 2024-04-01T01:55:45.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.818+0000 7f1478c73640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f147415b370 con 0x7f1474158120 2024-04-01T01:55:45.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.818+0000 7f1478c73640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f147415c0f0 con 0x7f1474151de0 2024-04-01T01:55:45.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.818+0000 7f1472d9d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f1474158120 0x7f1474162560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:45.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.818+0000 7f147259c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1474151de0 0x7f1474157be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:45.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.818+0000 7f1472d9d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f1474158120 0x7f1474162560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.50:39190/0 (socket says 172.21.15.50:39190) 2024-04-01T01:55:45.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.818+0000 7f1471d9b640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f14740c2900 0x7f14740c5f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.50:44682/0 (socket says 172.21.15.50:44682) 2024-04-01T01:55:45.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.818+0000 7f1472d9d640 1 -- 172.21.15.50:0/1356061315 learned_addr learned my addr 172.21.15.50:0/1356061315 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T01:55:45.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.818+0000 7f147259c640 1 -- 172.21.15.50:0/1356061315 >> v2:172.21.15.97:3300/0 conn(0x7f1474158120 msgr2=0x7f1474162560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:55:45.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.818+0000 7f147259c640 1 --2- 172.21.15.50:0/1356061315 >> v2:172.21.15.97:3300/0 conn(0x7f1474158120 0x7f1474162560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:45.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.818+0000 7f147259c640 1 -- 172.21.15.50:0/1356061315 >> v1:172.21.15.97:6789/0 conn(0x7f14740c2900 legacy=0x7f14740c5f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:45.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.818+0000 7f147259c640 1 -- 172.21.15.50:0/1356061315 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14740c2df0 con 0x7f1474151de0 2024-04-01T01:55:45.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.818+0000 7f147259c640 1 --2- 172.21.15.50:0/1356061315 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1474151de0 0x7f1474157be0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f14640097c0 tx=0x7f146401ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fdf43ea1e4aad775 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:45.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.818+0000 7f147159a640 1 -- 172.21.15.50:0/1356061315 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14640b5070 con 0x7f1474151de0 2024-04-01T01:55:45.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.818+0000 7f147159a640 1 -- 172.21.15.50:0/1356061315 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14640a8990 con 0x7f1474151de0 2024-04-01T01:55:45.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.818+0000 7f147159a640 1 -- 172.21.15.50:0/1356061315 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14640a8d60 con 0x7f1474151de0 2024-04-01T01:55:45.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.822+0000 7f1478c73640 1 -- 172.21.15.50:0/1356061315 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1474151de0 msgr2=0x7f1474157be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:45.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.822+0000 7f1478c73640 1 --2- 172.21.15.50:0/1356061315 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1474151de0 0x7f1474157be0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f14640097c0 tx=0x7f146401ec90 comp rx=0 tx=0).stop 2024-04-01T01:55:45.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.822+0000 7f1478c73640 1 -- 172.21.15.50:0/1356061315 shutdown_connections 2024-04-01T01:55:45.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.822+0000 7f1478c73640 1 --2- 172.21.15.50:0/1356061315 >> v2:172.21.15.97:3300/0 conn(0x7f1474158120 0x7f1474162560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:45.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.822+0000 7f1478c73640 1 --2- 172.21.15.50:0/1356061315 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1474151de0 0x7f1474157be0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:45.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.822+0000 7f1478c73640 1 -- 172.21.15.50:0/1356061315 >> 172.21.15.50:0/1356061315 conn(0x7f1474067560 msgr2=0x7f147406b220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:55:45.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.822+0000 7f1478c73640 1 -- 172.21.15.50:0/1356061315 shutdown_connections 2024-04-01T01:55:45.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.822+0000 7f1478c73640 1 -- 172.21.15.50:0/1356061315 wait complete. 2024-04-01T01:55:45.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.822+0000 7f1478c73640 1 Processor -- start 2024-04-01T01:55:45.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.822+0000 7f1478c73640 1 -- start start 2024-04-01T01:55:45.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.822+0000 7f1478c73640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f14740c2900 0x7f14741f0330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:45.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.822+0000 7f1478c73640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1474151de0 0x7f1474156830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:45.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.822+0000 7f1478c73640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1474158120 0x7f1474071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:45.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.822+0000 7f1478c73640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f147415bbd0 con 0x7f1474151de0 2024-04-01T01:55:45.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.822+0000 7f1478c73640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f147415b8f0 con 0x7f14740c2900 2024-04-01T01:55:45.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.822+0000 7f1478c73640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f14740c88a0 con 0x7f1474158120 2024-04-01T01:55:45.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.822+0000 7f1471d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1474151de0 0x7f1474156830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:45.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.822+0000 7f1471d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1474151de0 0x7f1474156830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39678/0 (socket says 172.21.15.50:39678) 2024-04-01T01:55:45.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.822+0000 7f1471d9b640 1 -- 172.21.15.50:0/602889342 learned_addr learned my addr 172.21.15.50:0/602889342 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T01:55:45.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.822+0000 7f147259c640 1 --2- 172.21.15.50:0/602889342 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f14740c2900 0x7f14741f0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:45.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.822+0000 7f1472d9d640 1 --2- 172.21.15.50:0/602889342 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1474158120 0x7f1474071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:45.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.822+0000 7f1471d9b640 1 -- 172.21.15.50:0/602889342 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1474158120 msgr2=0x7f1474071bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:45.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.822+0000 7f1471d9b640 1 --2- 172.21.15.50:0/602889342 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1474158120 0x7f1474071bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:45.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.822+0000 7f1471d9b640 1 -- 172.21.15.50:0/602889342 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f14740c2900 msgr2=0x7f14741f0330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:45.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.822+0000 7f1471d9b640 1 --2- 172.21.15.50:0/602889342 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f14740c2900 0x7f14741f0330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:45.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.822+0000 7f1471d9b640 1 -- 172.21.15.50:0/602889342 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14741f0870 con 0x7f1474151de0 2024-04-01T01:55:45.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.822+0000 7f1471d9b640 1 --2- 172.21.15.50:0/602889342 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1474151de0 0x7f1474156830 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f145c00c7a0 tx=0x7f145c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:45.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.822+0000 7f146affd640 1 -- 172.21.15.50:0/602889342 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f145c017070 con 0x7f1474151de0 2024-04-01T01:55:45.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.822+0000 7f146affd640 1 -- 172.21.15.50:0/602889342 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f145c00a640 con 0x7f1474151de0 2024-04-01T01:55:45.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.822+0000 7f1478c73640 1 -- 172.21.15.50:0/602889342 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1474157470 con 0x7f1474151de0 2024-04-01T01:55:45.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.822+0000 7f146affd640 1 -- 172.21.15.50:0/602889342 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f145c00a9f0 con 0x7f1474151de0 2024-04-01T01:55:45.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.822+0000 7f1478c73640 1 -- 172.21.15.50:0/602889342 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14741579f0 con 0x7f1474151de0 2024-04-01T01:55:45.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.826+0000 7f1478c73640 1 -- 172.21.15.50:0/602889342 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1474068230 con 0x7f1474151de0 2024-04-01T01:55:45.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.826+0000 7f146affd640 1 -- 172.21.15.50:0/602889342 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 87103+0+0 (secure 0 0 0) 0x7f145c01a070 con 0x7f1474151de0 2024-04-01T01:55:45.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.826+0000 7f146affd640 1 --2- 172.21.15.50:0/602889342 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f1454067420 0x7f14540698e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:45.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.826+0000 7f146affd640 1 -- 172.21.15.50:0/602889342 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f145c0847a0 con 0x7f1474151de0 2024-04-01T01:55:45.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.826+0000 7f147259c640 1 --2- 172.21.15.50:0/602889342 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f1454067420 0x7f14540698e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:45.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.826+0000 7f147259c640 1 --2- 172.21.15.50:0/602889342 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f1454067420 0x7f14540698e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f14640b2000 tx=0x7f1464008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:45.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.830+0000 7f146affd640 1 -- 172.21.15.50:0/602889342 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+176632 (secure 0 0 0) 0x7f145c0552d0 con 0x7f1474151de0 2024-04-01T01:55:45.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.990+0000 7f1478c73640 1 -- 172.21.15.50:0/602889342 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f14740c7280 con 0x7f1474151de0 2024-04-01T01:55:45.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.994+0000 7f146affd640 1 -- 172.21.15.50:0/602889342 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12800 (secure 0 0 0) 0x7f145c059370 con 0x7f1474151de0 2024-04-01T01:55:45.995 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-01T01:55:45.995 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":17,"fsid":"f67878a9-bc75-426b-962d-fa7bc2517f7d","created":"2024-04-01T01:55:31.562371+0000","modified":"2024-04-01T01:55:44.138382+0000","last_up_change":"2024-04-01T01:55:42.134502+0000","last_in_change":"2024-04-01T01:55:33.849789+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-01T01:55:42.134418+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"81e8ca4f-bde8-419a-875f-73a1f4a641ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":4170468134},{"type":"v1","addr":"172.21.15.50:6825","nonce":4170468134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":4170468134},{"type":"v1","addr":"172.21.15.50:6827","nonce":4170468134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":4170468134},{"type":"v1","addr":"172.21.15.50:6831","nonce":4170468134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":4170468134},{"type":"v1","addr":"172.21.15.50:6829","nonce":4170468134}]},"public_addr":"172.21.15.50:6825/4170468134","cluster_addr":"172.21.15.50:6827/4170468134","heartbeat_back_addr":"172.21.15.50:6831/4170468134","heartbeat_front_addr":"172.21.15.50:6829/4170468134","state":["exists","up"]},{"osd":1,"uuid":"bd060ca0-7559-4d30-987c-62e59818431d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1794491326},{"type":"v1","addr":"172.21.15.50:6809","nonce":1794491326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1794491326},{"type":"v1","addr":"172.21.15.50:6811","nonce":1794491326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1794491326},{"type":"v1","addr":"172.21.15.50:6815","nonce":1794491326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1794491326},{"type":"v1","addr":"172.21.15.50:6813","nonce":1794491326}]},"public_addr":"172.21.15.50:6809/1794491326","cluster_addr":"172.21.15.50:6811/1794491326","heartbeat_back_addr":"172.21.15.50:6815/1794491326","heartbeat_front_addr":"172.21.15.50:6813/1794491326","state":["exists","up"]},{"osd":2,"uuid":"eac5d816-a281-4acd-aa7d-b96a8e0aa962","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":710247177},{"type":"v1","addr":"172.21.15.50:6801","nonce":710247177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":710247177},{"type":"v1","addr":"172.21.15.50:6803","nonce":710247177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":710247177},{"type":"v1","addr":"172.21.15.50:6807","nonce":710247177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":710247177},{"type":"v1","addr":"172.21.15.50:6805","nonce":710247177}]},"public_addr":"172.21.15.50:6801/710247177","cluster_addr":"172.21.15.50:6803/710247177","heartbeat_back_addr":"172.21.15.50:6807/710247177","heartbeat_front_addr":"172.21.15.50:6805/710247177","state":["exists","up"]},{"osd":3,"uuid":"12b23968-04a7-40b8-98c4-02b16ae28265","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":871680805},{"type":"v1","addr":"172.21.15.50:6817","nonce":871680805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":871680805},{"type":"v1","addr":"172.21.15.50:6819","nonce":871680805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":871680805},{"type":"v1","addr":"172.21.15.50:6823","nonce":871680805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":871680805},{"type":"v1","addr":"172.21.15.50:6821","nonce":871680805}]},"public_addr":"172.21.15.50:6817/871680805","cluster_addr":"172.21.15.50:6819/871680805","heartbeat_back_addr":"172.21.15.50:6823/871680805","heartbeat_front_addr":"172.21.15.50:6821/871680805","state":["exists","up"]},{"osd":4,"uuid":"0e6b1639-23b0-47d9-8b08-40c8ab6df818","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":1095319381},{"type":"v1","addr":"172.21.15.97:6801","nonce":1095319381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":1095319381},{"type":"v1","addr":"172.21.15.97:6803","nonce":1095319381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":1095319381},{"type":"v1","addr":"172.21.15.97:6807","nonce":1095319381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":1095319381},{"type":"v1","addr":"172.21.15.97:6805","nonce":1095319381}]},"public_addr":"172.21.15.97:6801/1095319381","cluster_addr":"172.21.15.97:6803/1095319381","heartbeat_back_addr":"172.21.15.97:6807/1095319381","heartbeat_front_addr":"172.21.15.97:6805/1095319381","state":["exists","up"]},{"osd":5,"uuid":"f0f876ef-0823-46e9-8fe4-9b7a64a94cee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":899031308},{"type":"v1","addr":"172.21.15.97:6817","nonce":899031308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":899031308},{"type":"v1","addr":"172.21.15.97:6819","nonce":899031308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":899031308},{"type":"v1","addr":"172.21.15.97:6823","nonce":899031308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":899031308},{"type":"v1","addr":"172.21.15.97:6821","nonce":899031308}]},"public_addr":"172.21.15.97:6817/899031308","cluster_addr":"172.21.15.97:6819/899031308","heartbeat_back_addr":"172.21.15.97:6823/899031308","heartbeat_front_addr":"172.21.15.97:6821/899031308","state":["exists","up"]},{"osd":6,"uuid":"d29a625e-83bf-40ef-a57e-618220b96b9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2224814961},{"type":"v1","addr":"172.21.15.97:6825","nonce":2224814961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2224814961},{"type":"v1","addr":"172.21.15.97:6827","nonce":2224814961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2224814961},{"type":"v1","addr":"172.21.15.97:6831","nonce":2224814961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2224814961},{"type":"v1","addr":"172.21.15.97:6829","nonce":2224814961}]},"public_addr":"172.21.15.97:6825/2224814961","cluster_addr":"172.21.15.97:6827/2224814961","heartbeat_back_addr":"172.21.15.97:6831/2224814961","heartbeat_front_addr":"172.21.15.97:6829/2224814961","state":["exists","up"]},{"osd":7,"uuid":"7bcfd8f1-7dc0-4013-af17-16da5a8d931d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":284968823},{"type":"v1","addr":"172.21.15.97:6809","nonce":284968823}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":284968823},{"type":"v1","addr":"172.21.15.97:6811","nonce":284968823}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6814","nonce":284968823},{"type":"v1","addr":"172.21.15.97:6815","nonce":284968823}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":284968823},{"type":"v1","addr":"172.21.15.97:6813","nonce":284968823}]},"public_addr":"172.21.15.97:6809/284968823","cluster_addr":"172.21.15.97:6811/284968823","heartbeat_back_addr":"172.21.15.97:6815/284968823","heartbeat_front_addr":"172.21.15.97:6813/284968823","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T01:55:39.369550+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T01:55:39.367285+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T01:55:39.458393+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T01:55:39.456179+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T01:55:39.463649+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T01:55:38.728924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T01:55:39.522411+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T01:55:39.432081+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-01T01:55:45.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.994+0000 7f1478c73640 1 -- 172.21.15.50:0/602889342 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f1454067420 msgr2=0x7f14540698e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:45.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.994+0000 7f1478c73640 1 --2- 172.21.15.50:0/602889342 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f1454067420 0x7f14540698e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f14640b2000 tx=0x7f1464008040 comp rx=0 tx=0).stop 2024-04-01T01:55:45.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.994+0000 7f1478c73640 1 -- 172.21.15.50:0/602889342 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1474151de0 msgr2=0x7f1474156830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:45.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.994+0000 7f1478c73640 1 --2- 172.21.15.50:0/602889342 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1474151de0 0x7f1474156830 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f145c00c7a0 tx=0x7f145c00cc60 comp rx=0 tx=0).stop 2024-04-01T01:55:45.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.994+0000 7f1478c73640 1 -- 172.21.15.50:0/602889342 shutdown_connections 2024-04-01T01:55:45.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.994+0000 7f1478c73640 1 --2- 172.21.15.50:0/602889342 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f1454067420 0x7f14540698e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:45.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.994+0000 7f1478c73640 1 --2- 172.21.15.50:0/602889342 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1474158120 0x7f1474071bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:45.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.994+0000 7f1478c73640 1 --2- 172.21.15.50:0/602889342 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1474151de0 0x7f1474156830 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:45.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.994+0000 7f1478c73640 1 --2- 172.21.15.50:0/602889342 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f14740c2900 0x7f14741f0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:45.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.994+0000 7f1478c73640 1 -- 172.21.15.50:0/602889342 >> 172.21.15.50:0/602889342 conn(0x7f1474067560 msgr2=0x7f14740c8020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:55:45.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.994+0000 7f1478c73640 1 -- 172.21.15.50:0/602889342 shutdown_connections 2024-04-01T01:55:45.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:45.994+0000 7f1478c73640 1 -- 172.21.15.50:0/602889342 wait complete. 2024-04-01T01:55:46.015 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-01T01:55:42.134418+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-01T01:55:46.015 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-01T01:55:46.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.142+0000 7f8f9379a640 1 Processor -- start 2024-04-01T01:55:46.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.142+0000 7f8f9379a640 1 -- start start 2024-04-01T01:55:46.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.142+0000 7f8f9379a640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f8f8c0ccd60 0x7f8f8c14e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:46.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.142+0000 7f8f9379a640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f8c157e80 con 0x7f8f8c0c5d80 2024-04-01T01:55:46.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.142+0000 7f8f9379a640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f8c158120 con 0x7f8f8c0c6160 2024-04-01T01:55:46.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.142+0000 7f8f9379a640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f8f8c158400 con 0x7f8f8c0ccd60 2024-04-01T01:55:46.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.142+0000 7f8f91536640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f8f8c0c5d80 0x7f8f8c15b360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53820/0 (socket says 172.21.15.50:53820) 2024-04-01T01:55:46.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.142+0000 7f8f91536640 1 -- 172.21.15.50:0/3274073726 learned_addr learned my addr 172.21.15.50:0/3274073726 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-04-01T01:55:46.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.142+0000 7f8f91d37640 1 --2- 172.21.15.50:0/3274073726 >> v2:172.21.15.97:3300/0 conn(0x7f8f8c0ccd60 0x7f8f8c14e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:46.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.142+0000 7f8f7ffff640 1 -- 172.21.15.50:0/3274073726 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2123703774 0 0) 0x7f8f8c157e80 con 0x7f8f8c0c5d80 2024-04-01T01:55:46.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.142+0000 7f8f7ffff640 1 -- 172.21.15.50:0/3274073726 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8f78003530 con 0x7f8f8c0c5d80 2024-04-01T01:55:46.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.142+0000 7f8f7ffff640 1 -- 172.21.15.50:0/3274073726 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3345813020 0 0) 0x7f8f78003530 con 0x7f8f8c0c5d80 2024-04-01T01:55:46.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.142+0000 7f8f7ffff640 1 -- 172.21.15.50:0/3274073726 >> v2:172.21.15.97:3300/0 conn(0x7f8f8c0ccd60 msgr2=0x7f8f8c14e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:55:46.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.142+0000 7f8f7ffff640 1 --2- 172.21.15.50:0/3274073726 >> v2:172.21.15.97:3300/0 conn(0x7f8f8c0ccd60 0x7f8f8c14e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:46.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.142+0000 7f8f7ffff640 1 -- 172.21.15.50:0/3274073726 >> v1:172.21.15.97:6789/0 conn(0x7f8f8c0c6160 legacy=0x7f8f8c14e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:46.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.142+0000 7f8f7ffff640 1 -- 172.21.15.50:0/3274073726 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f8c1586e0 con 0x7f8f8c0c5d80 2024-04-01T01:55:46.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.142+0000 7f8f7ffff640 1 -- 172.21.15.50:0/3274073726 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2779672543 0 0) 0x7f8f880016a0 con 0x7f8f8c0c5d80 2024-04-01T01:55:46.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.142+0000 7f8f7ffff640 1 -- 172.21.15.50:0/3274073726 >> v1:172.21.15.50:6789/0 conn(0x7f8f8c0c5d80 legacy=0x7f8f8c15b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:46.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.142+0000 7f8f7ffff640 1 --2- 172.21.15.50:0/3274073726 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8f780039c0 0x7f8f78003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:46.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.142+0000 7f8f7ffff640 1 --2- 172.21.15.50:0/3274073726 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8f78004810 0x7f8f78004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:46.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.142+0000 7f8f7ffff640 1 --2- 172.21.15.50:0/3274073726 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f780051d0 0x7f8f7800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:46.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.142+0000 7f8f7ffff640 1 -- 172.21.15.50:0/3274073726 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8f8c158400 con 0x7f8f780051d0 2024-04-01T01:55:46.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.142+0000 7f8f7ffff640 1 -- 172.21.15.50:0/3274073726 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f8f7800c080 con 0x7f8f780039c0 2024-04-01T01:55:46.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.142+0000 7f8f7ffff640 1 -- 172.21.15.50:0/3274073726 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f8f7800c280 con 0x7f8f78004810 2024-04-01T01:55:46.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.142+0000 7f8f91d37640 1 --2- 172.21.15.50:0/3274073726 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f780051d0 0x7f8f7800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:46.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.142+0000 7f8f91536640 1 --2- 172.21.15.50:0/3274073726 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8f780039c0 0x7f8f78003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:46.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.142+0000 7f8f91d37640 1 -- 172.21.15.50:0/3274073726 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8f78004810 msgr2=0x7f8f78004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:55:46.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.142+0000 7f8f91d37640 1 --2- 172.21.15.50:0/3274073726 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8f78004810 0x7f8f78004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:46.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.142+0000 7f8f91d37640 1 -- 172.21.15.50:0/3274073726 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8f780039c0 msgr2=0x7f8f78003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:55:46.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.142+0000 7f8f91d37640 1 --2- 172.21.15.50:0/3274073726 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8f780039c0 0x7f8f78003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:46.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.142+0000 7f8f91d37640 1 -- 172.21.15.50:0/3274073726 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f78003530 con 0x7f8f780051d0 2024-04-01T01:55:46.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.146+0000 7f8f91d37640 1 -- 172.21.15.50:0/3274073726 reap_dead start 2024-04-01T01:55:46.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.146+0000 7f8f91d37640 1 --2- 172.21.15.50:0/3274073726 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f780051d0 0x7f8f7800b9d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8f80009ab0 tx=0x7f8f8001ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73458b10684562c1 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:46.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.146+0000 7f8f7ffff640 1 -- 172.21.15.50:0/3274073726 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f800096b0 con 0x7f8f780051d0 2024-04-01T01:55:46.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.146+0000 7f8f7ffff640 1 -- 172.21.15.50:0/3274073726 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f80004020 con 0x7f8f780051d0 2024-04-01T01:55:46.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.146+0000 7f8f7ffff640 1 -- 172.21.15.50:0/3274073726 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f80004410 con 0x7f8f780051d0 2024-04-01T01:55:46.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.146+0000 7f8f9379a640 1 -- 172.21.15.50:0/3274073726 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f780051d0 msgr2=0x7f8f7800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:46.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.146+0000 7f8f9379a640 1 --2- 172.21.15.50:0/3274073726 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f780051d0 0x7f8f7800b9d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8f80009ab0 tx=0x7f8f8001ca90 comp rx=0 tx=0).stop 2024-04-01T01:55:46.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.146+0000 7f8f9379a640 1 -- 172.21.15.50:0/3274073726 shutdown_connections 2024-04-01T01:55:46.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.146+0000 7f8f9379a640 1 --2- 172.21.15.50:0/3274073726 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f780051d0 0x7f8f7800b9d0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:46.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.146+0000 7f8f9379a640 1 -- 172.21.15.50:0/3274073726 >> 172.21.15.50:0/3274073726 conn(0x7f8f8c06c330 msgr2=0x7f8f8c06c740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:55:46.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.146+0000 7f8f9379a640 1 -- 172.21.15.50:0/3274073726 shutdown_connections 2024-04-01T01:55:46.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.146+0000 7f8f9379a640 1 -- 172.21.15.50:0/3274073726 wait complete. 2024-04-01T01:55:46.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.146+0000 7f8f9379a640 1 Processor -- start 2024-04-01T01:55:46.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.146+0000 7f8f9379a640 1 -- start start 2024-04-01T01:55:46.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.150+0000 7f8f9379a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8f780051d0 0x7f8f8c1f0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:46.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.150+0000 7f8f9379a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f8c147a30 0x7f8f8c1468f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:46.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.150+0000 7f8f9379a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8f8c0c8900 0x7f8f8c1e4830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:46.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.150+0000 7f8f9379a640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8f8c06ffa0 con 0x7f8f8c147a30 2024-04-01T01:55:46.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.150+0000 7f8f9379a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f8f8c06fe20 con 0x7f8f8c0c8900 2024-04-01T01:55:46.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.150+0000 7f8f9379a640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f8f8c070120 con 0x7f8f780051d0 2024-04-01T01:55:46.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.150+0000 7f8f90d35640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f8c147a30 0x7f8f8c1468f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:46.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.150+0000 7f8f90d35640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f8c147a30 0x7f8f8c1468f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39698/0 (socket says 172.21.15.50:39698) 2024-04-01T01:55:46.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.150+0000 7f8f90d35640 1 -- 172.21.15.50:0/2294521254 learned_addr learned my addr 172.21.15.50:0/2294521254 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T01:55:46.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.150+0000 7f8f91536640 1 --2- 172.21.15.50:0/2294521254 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8f780051d0 0x7f8f8c1f0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:46.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.150+0000 7f8f91d37640 1 --2- 172.21.15.50:0/2294521254 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8f8c0c8900 0x7f8f8c1e4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:46.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.150+0000 7f8f90d35640 1 -- 172.21.15.50:0/2294521254 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8f780051d0 msgr2=0x7f8f8c1f0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:46.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.150+0000 7f8f90d35640 1 --2- 172.21.15.50:0/2294521254 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8f780051d0 0x7f8f8c1f0eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:46.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.150+0000 7f8f90d35640 1 -- 172.21.15.50:0/2294521254 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8f8c0c8900 msgr2=0x7f8f8c1e4830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:46.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.150+0000 7f8f90d35640 1 --2- 172.21.15.50:0/2294521254 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8f8c0c8900 0x7f8f8c1e4830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:46.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.150+0000 7f8f90d35640 1 -- 172.21.15.50:0/2294521254 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f8c1f13f0 con 0x7f8f8c147a30 2024-04-01T01:55:46.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.150+0000 7f8f91536640 1 --2- 172.21.15.50:0/2294521254 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8f780051d0 0x7f8f8c1f0eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T01:55:46.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.150+0000 7f8f90d35640 1 --2- 172.21.15.50:0/2294521254 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f8c147a30 0x7f8f8c1468f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8f8400c790 tx=0x7f8f8400cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:46.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.150+0000 7f8f7dffb640 1 -- 172.21.15.50:0/2294521254 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f84003b80 con 0x7f8f8c147a30 2024-04-01T01:55:46.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.150+0000 7f8f7dffb640 1 -- 172.21.15.50:0/2294521254 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f84003d40 con 0x7f8f8c147a30 2024-04-01T01:55:46.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.150+0000 7f8f7dffb640 1 -- 172.21.15.50:0/2294521254 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f8400aa90 con 0x7f8f8c147a30 2024-04-01T01:55:46.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.150+0000 7f8f9379a640 1 -- 172.21.15.50:0/2294521254 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f8c0c7a00 con 0x7f8f8c147a30 2024-04-01T01:55:46.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.150+0000 7f8f9379a640 1 -- 172.21.15.50:0/2294521254 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f8c0c7e20 con 0x7f8f8c147a30 2024-04-01T01:55:46.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.150+0000 7f8f9379a640 1 -- 172.21.15.50:0/2294521254 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f8c068940 con 0x7f8f8c147a30 2024-04-01T01:55:46.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.154+0000 7f8f7dffb640 1 -- 172.21.15.50:0/2294521254 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 87103+0+0 (secure 0 0 0) 0x7f8f8400ac30 con 0x7f8f8c147a30 2024-04-01T01:55:46.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.154+0000 7f8f7dffb640 1 --2- 172.21.15.50:0/2294521254 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f8f70067450 0x7f8f70069910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:46.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.154+0000 7f8f7dffb640 1 -- 172.21.15.50:0/2294521254 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f8f84085d70 con 0x7f8f8c147a30 2024-04-01T01:55:46.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.154+0000 7f8f91536640 1 --2- 172.21.15.50:0/2294521254 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f8f70067450 0x7f8f70069910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:46.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.154+0000 7f8f91536640 1 --2- 172.21.15.50:0/2294521254 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f8f70067450 0x7f8f70069910 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c158050 tx=0x7f8f88009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:46.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.158+0000 7f8f7dffb640 1 -- 172.21.15.50:0/2294521254 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+176632 (secure 0 0 0) 0x7f8f8c0c7a00 con 0x7f8f8c147a30 2024-04-01T01:55:46.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.314+0000 7f8f9379a640 1 -- 172.21.15.50:0/2294521254 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f8f8c1559c0 con 0x7f8f8c147a30 2024-04-01T01:55:46.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.314+0000 7f8f7dffb640 1 -- 172.21.15.50:0/2294521254 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) ==== 93+0+10 (secure 0 0 0) 0x7f8f84056e40 con 0x7f8f8c147a30 2024-04-01T01:55:46.317 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2024-04-01T01:55:46.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.318+0000 7f8f9379a640 1 -- 172.21.15.50:0/2294521254 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f8f70067450 msgr2=0x7f8f70069910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:46.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.318+0000 7f8f9379a640 1 --2- 172.21.15.50:0/2294521254 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f8f70067450 0x7f8f70069910 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c158050 tx=0x7f8f88009040 comp rx=0 tx=0).stop 2024-04-01T01:55:46.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.318+0000 7f8f9379a640 1 -- 172.21.15.50:0/2294521254 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f8c147a30 msgr2=0x7f8f8c1468f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:46.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.318+0000 7f8f9379a640 1 --2- 172.21.15.50:0/2294521254 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f8c147a30 0x7f8f8c1468f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8f8400c790 tx=0x7f8f8400cc50 comp rx=0 tx=0).stop 2024-04-01T01:55:46.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.318+0000 7f8f9379a640 1 -- 172.21.15.50:0/2294521254 shutdown_connections 2024-04-01T01:55:46.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.318+0000 7f8f9379a640 1 --2- 172.21.15.50:0/2294521254 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f8f70067450 0x7f8f70069910 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:46.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.318+0000 7f8f9379a640 1 --2- 172.21.15.50:0/2294521254 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8f8c0c8900 0x7f8f8c1e4830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:46.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.318+0000 7f8f9379a640 1 --2- 172.21.15.50:0/2294521254 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f8c147a30 0x7f8f8c1468f0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:46.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.318+0000 7f8f9379a640 1 --2- 172.21.15.50:0/2294521254 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8f780051d0 0x7f8f8c1f0eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:46.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.318+0000 7f8f9379a640 1 -- 172.21.15.50:0/2294521254 >> 172.21.15.50:0/2294521254 conn(0x7f8f8c06c330 msgr2=0x7f8f8c1e1180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:55:46.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.318+0000 7f8f9379a640 1 -- 172.21.15.50:0/2294521254 shutdown_connections 2024-04-01T01:55:46.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.318+0000 7f8f9379a640 1 -- 172.21.15.50:0/2294521254 wait complete. 2024-04-01T01:55:46.334 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-01T01:55:46.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.454+0000 7f87047c5640 1 Processor -- start 2024-04-01T01:55:46.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.458+0000 7f87047c5640 1 -- start start 2024-04-01T01:55:46.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.458+0000 7f87047c5640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f86fc1584b0 0x7f86fc0c6270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:46.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.458+0000 7f87047c5640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f86fc0c67b0 0x7f86fc161870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:46.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.458+0000 7f87047c5640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86fc15e320 con 0x7f86fc161db0 2024-04-01T01:55:46.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.458+0000 7f87047c5640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f86fc0c8920 con 0x7f86fc0c67b0 2024-04-01T01:55:46.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.458+0000 7f87047c5640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f86fc15e600 con 0x7f86fc1584b0 2024-04-01T01:55:46.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.458+0000 7f8701d60640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f86fc0c67b0 0x7f86fc161870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:46.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.458+0000 7f8701d60640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f86fc0c67b0 0x7f86fc161870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39706/0 (socket says 172.21.15.50:39706) 2024-04-01T01:55:46.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.458+0000 7f8701d60640 1 -- 172.21.15.50:0/1304135633 learned_addr learned my addr 172.21.15.50:0/1304135633 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T01:55:46.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.458+0000 7f8702561640 1 --2- 172.21.15.50:0/1304135633 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f86fc1584b0 0x7f86fc0c6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:46.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.458+0000 7f8701d60640 1 -- 172.21.15.50:0/1304135633 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f86fc1584b0 msgr2=0x7f86fc0c6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:55:46.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.458+0000 7f8701d60640 1 --2- 172.21.15.50:0/1304135633 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f86fc1584b0 0x7f86fc0c6270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:46.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.458+0000 7f8701d60640 1 -- 172.21.15.50:0/1304135633 >> v1:172.21.15.97:6789/0 conn(0x7f86fc161db0 legacy=0x7f86fc06ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:46.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.458+0000 7f8701d60640 1 -- 172.21.15.50:0/1304135633 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86fc15e8e0 con 0x7f86fc0c67b0 2024-04-01T01:55:46.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.458+0000 7f8701d60640 1 --2- 172.21.15.50:0/1304135633 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86fc0c67b0 0x7f86fc161870 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f86ec009870 tx=0x7f86ec01ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=585fdbe5193d2071 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:46.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.462+0000 7f870155f640 1 -- 172.21.15.50:0/1304135633 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86ec0b5070 con 0x7f86fc0c67b0 2024-04-01T01:55:46.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.462+0000 7f870155f640 1 -- 172.21.15.50:0/1304135633 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86ec0a8a50 con 0x7f86fc0c67b0 2024-04-01T01:55:46.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.462+0000 7f870155f640 1 -- 172.21.15.50:0/1304135633 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86ec0a8e20 con 0x7f86fc0c67b0 2024-04-01T01:55:46.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.462+0000 7f87047c5640 1 -- 172.21.15.50:0/1304135633 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86fc0c67b0 msgr2=0x7f86fc161870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:46.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.462+0000 7f87047c5640 1 --2- 172.21.15.50:0/1304135633 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86fc0c67b0 0x7f86fc161870 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f86ec009870 tx=0x7f86ec01ed50 comp rx=0 tx=0).stop 2024-04-01T01:55:46.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.462+0000 7f87047c5640 1 -- 172.21.15.50:0/1304135633 shutdown_connections 2024-04-01T01:55:46.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.462+0000 7f87047c5640 1 --2- 172.21.15.50:0/1304135633 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86fc0c67b0 0x7f86fc161870 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:46.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.462+0000 7f87047c5640 1 --2- 172.21.15.50:0/1304135633 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f86fc1584b0 0x7f86fc0c6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:46.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.462+0000 7f87047c5640 1 -- 172.21.15.50:0/1304135633 >> 172.21.15.50:0/1304135633 conn(0x7f86fc067560 msgr2=0x7f86fc06b220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:55:46.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.462+0000 7f87047c5640 1 -- 172.21.15.50:0/1304135633 shutdown_connections 2024-04-01T01:55:46.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.462+0000 7f87047c5640 1 -- 172.21.15.50:0/1304135633 wait complete. 2024-04-01T01:55:46.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.462+0000 7f87047c5640 1 Processor -- start 2024-04-01T01:55:46.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.462+0000 7f87047c5640 1 -- start start 2024-04-01T01:55:46.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.462+0000 7f87047c5640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f86fc0c67b0 0x7f86fc14db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:46.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.462+0000 7f87047c5640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f86fc1584b0 0x7f86fc14ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:46.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.462+0000 7f87047c5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86fc161db0 0x7f86fc14a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:46.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.462+0000 7f87047c5640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f86fc1621c0 con 0x7f86fc161db0 2024-04-01T01:55:46.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.462+0000 7f87047c5640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f86fc15eea0 con 0x7f86fc0c67b0 2024-04-01T01:55:46.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.462+0000 7f87047c5640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f86fc158890 con 0x7f86fc1584b0 2024-04-01T01:55:46.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.466+0000 7f8702d62640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86fc161db0 0x7f86fc14a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:46.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.466+0000 7f8702d62640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86fc161db0 0x7f86fc14a3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39720/0 (socket says 172.21.15.50:39720) 2024-04-01T01:55:46.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.466+0000 7f8702d62640 1 -- 172.21.15.50:0/1342943232 learned_addr learned my addr 172.21.15.50:0/1342943232 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T01:55:46.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.466+0000 7f8701d60640 1 --2- 172.21.15.50:0/1342943232 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f86fc1584b0 0x7f86fc14ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:46.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.466+0000 7f8702561640 1 --2- 172.21.15.50:0/1342943232 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f86fc0c67b0 0x7f86fc14db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:46.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.466+0000 7f8702d62640 1 -- 172.21.15.50:0/1342943232 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f86fc1584b0 msgr2=0x7f86fc14ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:46.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.466+0000 7f8702d62640 1 --2- 172.21.15.50:0/1342943232 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f86fc1584b0 0x7f86fc14ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:46.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.466+0000 7f8702d62640 1 -- 172.21.15.50:0/1342943232 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f86fc0c67b0 msgr2=0x7f86fc14db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:46.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.466+0000 7f8702d62640 1 --2- 172.21.15.50:0/1342943232 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f86fc0c67b0 0x7f86fc14db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:46.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.466+0000 7f8702d62640 1 -- 172.21.15.50:0/1342943232 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86fc1f4330 con 0x7f86fc161db0 2024-04-01T01:55:46.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.466+0000 7f8702d62640 1 --2- 172.21.15.50:0/1342943232 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86fc161db0 0x7f86fc14a3b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f86f400c760 tx=0x7f86f400cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:46.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.466+0000 7f86f2ffd640 1 -- 172.21.15.50:0/1342943232 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86f4016020 con 0x7f86fc161db0 2024-04-01T01:55:46.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.466+0000 7f86f2ffd640 1 -- 172.21.15.50:0/1342943232 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86f4006d60 con 0x7f86fc161db0 2024-04-01T01:55:46.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.466+0000 7f87047c5640 1 -- 172.21.15.50:0/1342943232 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86fc1f4610 con 0x7f86fc161db0 2024-04-01T01:55:46.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.466+0000 7f86f2ffd640 1 -- 172.21.15.50:0/1342943232 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86f4003bc0 con 0x7f86fc161db0 2024-04-01T01:55:46.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.466+0000 7f87047c5640 1 -- 172.21.15.50:0/1342943232 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86fc1f4bd0 con 0x7f86fc161db0 2024-04-01T01:55:46.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.466+0000 7f87047c5640 1 -- 172.21.15.50:0/1342943232 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86fc068230 con 0x7f86fc161db0 2024-04-01T01:55:46.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.466+0000 7f86f2ffd640 1 -- 172.21.15.50:0/1342943232 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 87103+0+0 (secure 0 0 0) 0x7f86f40050d0 con 0x7f86fc161db0 2024-04-01T01:55:46.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.466+0000 7f86f2ffd640 1 --2- 172.21.15.50:0/1342943232 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f86e0067450 0x7f86e0069910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:46.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.466+0000 7f86f2ffd640 1 -- 172.21.15.50:0/1342943232 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f86f4084e20 con 0x7f86fc161db0 2024-04-01T01:55:46.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.466+0000 7f8702561640 1 --2- 172.21.15.50:0/1342943232 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f86e0067450 0x7f86e0069910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:46.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.466+0000 7f8702561640 1 --2- 172.21.15.50:0/1342943232 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f86e0067450 0x7f86e0069910 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f86f8007a60 tx=0x7f86f8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:46.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.470+0000 7f86f2ffd640 1 -- 172.21.15.50:0/1342943232 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+176632 (secure 0 0 0) 0x7f86f4020020 con 0x7f86fc161db0 2024-04-01T01:55:46.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.634+0000 7f87047c5640 1 -- 172.21.15.50:0/1342943232 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f86fc0c7600 con 0x7f86fc161db0 2024-04-01T01:55:46.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.634+0000 7f86f2ffd640 1 -- 172.21.15.50:0/1342943232 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) ==== 84+0+65 (secure 0 0 0) 0x7f86f40558c0 con 0x7f86fc161db0 2024-04-01T01:55:46.636 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-01T01:55:46.637 INFO:teuthology.orchestra.run.smithi050.stdout:[ 2024-04-01T01:55:46.637 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-04-01T01:55:46.637 INFO:teuthology.orchestra.run.smithi050.stdout: "poolnum": 1, 2024-04-01T01:55:46.637 INFO:teuthology.orchestra.run.smithi050.stdout: "poolname": ".mgr" 2024-04-01T01:55:46.637 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-04-01T01:55:46.637 INFO:teuthology.orchestra.run.smithi050.stdout:] 2024-04-01T01:55:46.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.638+0000 7f87047c5640 1 -- 172.21.15.50:0/1342943232 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f86e0067450 msgr2=0x7f86e0069910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:46.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.638+0000 7f87047c5640 1 --2- 172.21.15.50:0/1342943232 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f86e0067450 0x7f86e0069910 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f86f8007a60 tx=0x7f86f8008040 comp rx=0 tx=0).stop 2024-04-01T01:55:46.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.638+0000 7f87047c5640 1 -- 172.21.15.50:0/1342943232 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86fc161db0 msgr2=0x7f86fc14a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:46.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.638+0000 7f87047c5640 1 --2- 172.21.15.50:0/1342943232 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86fc161db0 0x7f86fc14a3b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f86f400c760 tx=0x7f86f400cb60 comp rx=0 tx=0).stop 2024-04-01T01:55:46.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.638+0000 7f87047c5640 1 -- 172.21.15.50:0/1342943232 shutdown_connections 2024-04-01T01:55:46.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.638+0000 7f87047c5640 1 --2- 172.21.15.50:0/1342943232 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f86e0067450 0x7f86e0069910 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:46.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.638+0000 7f87047c5640 1 --2- 172.21.15.50:0/1342943232 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86fc161db0 0x7f86fc14a3b0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:46.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.638+0000 7f87047c5640 1 --2- 172.21.15.50:0/1342943232 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f86fc1584b0 0x7f86fc14ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:46.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.638+0000 7f87047c5640 1 --2- 172.21.15.50:0/1342943232 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f86fc0c67b0 0x7f86fc14db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:46.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.638+0000 7f87047c5640 1 -- 172.21.15.50:0/1342943232 >> 172.21.15.50:0/1342943232 conn(0x7f86fc067560 msgr2=0x7f86fc0c8100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:55:46.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.638+0000 7f87047c5640 1 -- 172.21.15.50:0/1342943232 shutdown_connections 2024-04-01T01:55:46.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.638+0000 7f87047c5640 1 -- 172.21.15.50:0/1342943232 wait complete. 2024-04-01T01:55:46.656 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-01T01:55:46.656 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-01T01:55:46.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.786+0000 7efea31ca640 1 Processor -- start 2024-04-01T01:55:46.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.786+0000 7efea31ca640 1 -- start start 2024-04-01T01:55:46.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.786+0000 7efea31ca640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7efe9c0c7720 0x7efe9c15a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:46.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.786+0000 7efea31ca640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efe9c0c8210 0x7efe9c15a820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:46.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.786+0000 7efea31ca640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe9c15de10 con 0x7efe9c06faf0 2024-04-01T01:55:46.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.786+0000 7efea31ca640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7efe9c070630 con 0x7efe9c0c7720 2024-04-01T01:55:46.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.786+0000 7efea31ca640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7efe9c15e0f0 con 0x7efe9c0c8210 2024-04-01T01:55:46.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.786+0000 7efea1767640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efe9c0c8210 0x7efe9c15a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:46.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.786+0000 7efea0f66640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7efe9c0c7720 0x7efe9c15a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:46.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.786+0000 7efea0f66640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7efe9c0c7720 0x7efe9c15a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.50:39226/0 (socket says 172.21.15.50:39226) 2024-04-01T01:55:46.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.786+0000 7efea1767640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efe9c0c8210 0x7efe9c15a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.50:56392/0 (socket says 172.21.15.50:56392) 2024-04-01T01:55:46.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.786+0000 7efea0f66640 1 -- 172.21.15.50:0/1428287943 learned_addr learned my addr 172.21.15.50:0/1428287943 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T01:55:46.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.786+0000 7efe9bfff640 1 --1- 172.21.15.50:0/1428287943 >> v1:172.21.15.97:6789/0 conn(0x7efe9c06faf0 0x7efe9c0c7b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.50:44712/0 (socket says 172.21.15.50:44712) 2024-04-01T01:55:46.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.790+0000 7efea1767640 1 -- 172.21.15.50:0/1428287943 >> v2:172.21.15.97:3300/0 conn(0x7efe9c0c7720 msgr2=0x7efe9c15a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:55:46.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.790+0000 7efea1767640 1 --2- 172.21.15.50:0/1428287943 >> v2:172.21.15.97:3300/0 conn(0x7efe9c0c7720 0x7efe9c15a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:46.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.790+0000 7efea1767640 1 -- 172.21.15.50:0/1428287943 >> v1:172.21.15.97:6789/0 conn(0x7efe9c06faf0 legacy=0x7efe9c0c7b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:46.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.790+0000 7efea1767640 1 -- 172.21.15.50:0/1428287943 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe9c070880 con 0x7efe9c0c8210 2024-04-01T01:55:46.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.790+0000 7efea0f66640 1 --2- 172.21.15.50:0/1428287943 >> v2:172.21.15.97:3300/0 conn(0x7efe9c0c7720 0x7efe9c15a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T01:55:46.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.790+0000 7efea1767640 1 --2- 172.21.15.50:0/1428287943 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efe9c0c8210 0x7efe9c15a820 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7efe8c009d90 tx=0x7efe8c01c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cc8e3af069497d55 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:46.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.790+0000 7efe9b7fe640 1 -- 172.21.15.50:0/1428287943 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe8c0b2070 con 0x7efe9c0c8210 2024-04-01T01:55:46.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.790+0000 7efe9b7fe640 1 -- 172.21.15.50:0/1428287943 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe8c0a59d0 con 0x7efe9c0c8210 2024-04-01T01:55:46.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.790+0000 7efe9b7fe640 1 -- 172.21.15.50:0/1428287943 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe8c0a5da0 con 0x7efe9c0c8210 2024-04-01T01:55:46.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.790+0000 7efea31ca640 1 -- 172.21.15.50:0/1428287943 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efe9c0c8210 msgr2=0x7efe9c15a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:46.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.790+0000 7efea31ca640 1 --2- 172.21.15.50:0/1428287943 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efe9c0c8210 0x7efe9c15a820 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7efe8c009d90 tx=0x7efe8c01c970 comp rx=0 tx=0).stop 2024-04-01T01:55:46.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.790+0000 7efea31ca640 1 -- 172.21.15.50:0/1428287943 shutdown_connections 2024-04-01T01:55:46.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.790+0000 7efea31ca640 1 --2- 172.21.15.50:0/1428287943 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efe9c0c8210 0x7efe9c15a820 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:46.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.790+0000 7efea31ca640 1 --2- 172.21.15.50:0/1428287943 >> v2:172.21.15.97:3300/0 conn(0x7efe9c0c7720 0x7efe9c15a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:46.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.790+0000 7efea31ca640 1 -- 172.21.15.50:0/1428287943 >> 172.21.15.50:0/1428287943 conn(0x7efe9c0c8e10 msgr2=0x7efe9c0c9220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:55:46.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.790+0000 7efea31ca640 1 -- 172.21.15.50:0/1428287943 shutdown_connections 2024-04-01T01:55:46.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.790+0000 7efea31ca640 1 -- 172.21.15.50:0/1428287943 wait complete. 2024-04-01T01:55:46.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.794+0000 7efea31ca640 1 Processor -- start 2024-04-01T01:55:46.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.794+0000 7efea31ca640 1 -- start start 2024-04-01T01:55:46.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.794+0000 7efea31ca640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efe9c06faf0 0x7efe9c148e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:46.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.794+0000 7efea31ca640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe9c0c7720 0x7efe9c1548a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:46.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.794+0000 7efea31ca640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efe9c0c8210 0x7efe9c154de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:46.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.794+0000 7efea31ca640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7efe9c073630 con 0x7efe9c0c7720 2024-04-01T01:55:46.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.794+0000 7efea31ca640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7efe9c0734b0 con 0x7efe9c06faf0 2024-04-01T01:55:46.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.794+0000 7efea31ca640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7efe9c1542b0 con 0x7efe9c0c8210 2024-04-01T01:55:46.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.794+0000 7efe9bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe9c0c7720 0x7efe9c1548a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:46.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.794+0000 7efe9bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe9c0c7720 0x7efe9c1548a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39722/0 (socket says 172.21.15.50:39722) 2024-04-01T01:55:46.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.794+0000 7efe9bfff640 1 -- 172.21.15.50:0/2246563638 learned_addr learned my addr 172.21.15.50:0/2246563638 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T01:55:46.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.794+0000 7efea0f66640 1 --2- 172.21.15.50:0/2246563638 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efe9c06faf0 0x7efe9c148e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:46.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.794+0000 7efea1767640 1 --2- 172.21.15.50:0/2246563638 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efe9c0c8210 0x7efe9c154de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:46.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.794+0000 7efe9bfff640 1 -- 172.21.15.50:0/2246563638 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efe9c0c8210 msgr2=0x7efe9c154de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:46.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.794+0000 7efe9bfff640 1 --2- 172.21.15.50:0/2246563638 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efe9c0c8210 0x7efe9c154de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:46.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.794+0000 7efe9bfff640 1 -- 172.21.15.50:0/2246563638 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efe9c06faf0 msgr2=0x7efe9c148e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:46.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.794+0000 7efe9bfff640 1 --2- 172.21.15.50:0/2246563638 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efe9c06faf0 0x7efe9c148e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:46.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.794+0000 7efe9bfff640 1 -- 172.21.15.50:0/2246563638 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe9c15c650 con 0x7efe9c0c7720 2024-04-01T01:55:46.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.794+0000 7efea1767640 1 --2- 172.21.15.50:0/2246563638 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efe9c0c8210 0x7efe9c154de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T01:55:46.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.794+0000 7efea0f66640 1 --2- 172.21.15.50:0/2246563638 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efe9c06faf0 0x7efe9c148e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T01:55:46.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.794+0000 7efe9bfff640 1 --2- 172.21.15.50:0/2246563638 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe9c0c7720 0x7efe9c1548a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7efe8800c4c0 tx=0x7efe8800c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:46.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.794+0000 7efe997fa640 1 -- 172.21.15.50:0/2246563638 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe88018070 con 0x7efe9c0c7720 2024-04-01T01:55:46.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.794+0000 7efe997fa640 1 -- 172.21.15.50:0/2246563638 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe88007480 con 0x7efe9c0c7720 2024-04-01T01:55:46.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.794+0000 7efea31ca640 1 -- 172.21.15.50:0/2246563638 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe9c1f6ba0 con 0x7efe9c0c7720 2024-04-01T01:55:46.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.794+0000 7efe997fa640 1 -- 172.21.15.50:0/2246563638 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe880047f0 con 0x7efe9c0c7720 2024-04-01T01:55:46.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.794+0000 7efea31ca640 1 -- 172.21.15.50:0/2246563638 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe9c15c370 con 0x7efe9c0c7720 2024-04-01T01:55:46.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.794+0000 7efea31ca640 1 -- 172.21.15.50:0/2246563638 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe9c068230 con 0x7efe9c0c7720 2024-04-01T01:55:46.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.794+0000 7efe997fa640 1 -- 172.21.15.50:0/2246563638 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 87103+0+0 (secure 0 0 0) 0x7efe8801b070 con 0x7efe9c0c7720 2024-04-01T01:55:46.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.794+0000 7efe997fa640 1 --2- 172.21.15.50:0/2246563638 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7efe84067450 0x7efe84069910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:46.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.798+0000 7efe997fa640 1 -- 172.21.15.50:0/2246563638 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7efe88084550 con 0x7efe9c0c7720 2024-04-01T01:55:46.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.798+0000 7efea0f66640 1 --2- 172.21.15.50:0/2246563638 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7efe84067450 0x7efe84069910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:46.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.798+0000 7efea0f66640 1 --2- 172.21.15.50:0/2246563638 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7efe84067450 0x7efe84069910 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7efe94009630 tx=0x7efe94008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:46.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.802+0000 7efe997fa640 1 -- 172.21.15.50:0/2246563638 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+176632 (secure 0 0 0) 0x7efe88055640 con 0x7efe9c0c7720 2024-04-01T01:55:46.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:46.966+0000 7efea31ca640 1 -- 172.21.15.50:0/2246563638 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7efe9c06f8d0 con 0x7efe9c0c7720 2024-04-01T01:55:47.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:47.170+0000 7efe997fa640 1 -- 172.21.15.50:0/2246563638 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) ==== 138+0+0 (secure 0 0 0) 0x7efe88054f40 con 0x7efe9c0c7720 2024-04-01T01:55:47.171 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' created 2024-04-01T01:55:47.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:47.170+0000 7efea31ca640 1 -- 172.21.15.50:0/2246563638 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7efe84067450 msgr2=0x7efe84069910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:47.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:47.170+0000 7efea31ca640 1 --2- 172.21.15.50:0/2246563638 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7efe84067450 0x7efe84069910 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7efe94009630 tx=0x7efe94008040 comp rx=0 tx=0).stop 2024-04-01T01:55:47.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:47.170+0000 7efea31ca640 1 -- 172.21.15.50:0/2246563638 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe9c0c7720 msgr2=0x7efe9c1548a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:47.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:47.170+0000 7efea31ca640 1 --2- 172.21.15.50:0/2246563638 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe9c0c7720 0x7efe9c1548a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7efe8800c4c0 tx=0x7efe8800c980 comp rx=0 tx=0).stop 2024-04-01T01:55:47.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:47.170+0000 7efea31ca640 1 -- 172.21.15.50:0/2246563638 shutdown_connections 2024-04-01T01:55:47.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:47.170+0000 7efea31ca640 1 --2- 172.21.15.50:0/2246563638 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7efe84067450 0x7efe84069910 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:47.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:47.170+0000 7efea31ca640 1 --2- 172.21.15.50:0/2246563638 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efe9c0c8210 0x7efe9c154de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:47.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:47.170+0000 7efea31ca640 1 --2- 172.21.15.50:0/2246563638 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe9c0c7720 0x7efe9c1548a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:47.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:47.170+0000 7efea31ca640 1 --2- 172.21.15.50:0/2246563638 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efe9c06faf0 0x7efe9c148e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:47.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:47.170+0000 7efea31ca640 1 -- 172.21.15.50:0/2246563638 >> 172.21.15.50:0/2246563638 conn(0x7efe9c0c8e10 msgr2=0x7efe9c157ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:55:47.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:47.174+0000 7efea31ca640 1 -- 172.21.15.50:0/2246563638 shutdown_connections 2024-04-01T01:55:47.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:47.174+0000 7efea31ca640 1 -- 172.21.15.50:0/2246563638 wait complete. 2024-04-01T01:55:47.199 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-01T01:55:47.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:47.326+0000 7fb9aae3e640 1 Processor -- start 2024-04-01T01:55:47.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:47.326+0000 7fb9aae3e640 1 -- start start 2024-04-01T01:55:47.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:47.330+0000 7fb9aae3e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb9a4153fd0 0x7fb9a40ca670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:47.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:47.330+0000 7fb9aae3e640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fb9a41543b0 0x7fb9a40cb240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:47.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:47.330+0000 7fb9aae3e640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb9a40cabb0 0x7fb9a40cb780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:47.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:47.330+0000 7fb9aae3e640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fb9a40cbff0 con 0x7fb9a4153fd0 2024-04-01T01:55:47.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:47.330+0000 7fb9aae3e640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fb9a4159fe0 con 0x7fb9a41543b0 2024-04-01T01:55:47.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:47.330+0000 7fb9aae3e640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fb9a415a2c0 con 0x7fb9a40cabb0 2024-04-01T01:55:47.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:47.330+0000 7fb9a8bda640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb9a4153fd0 0x7fb9a40ca670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:47.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:47.330+0000 7fb9a8bda640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb9a4153fd0 0x7fb9a40ca670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39736/0 (socket says 172.21.15.50:39736) 2024-04-01T01:55:47.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:47.330+0000 7fb9a8bda640 1 -- 172.21.15.50:0/2618755108 learned_addr learned my addr 172.21.15.50:0/2618755108 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T01:55:47.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:47.330+0000 7fb9a3fff640 1 --2- 172.21.15.50:0/2618755108 >> v2:172.21.15.97:3300/0 conn(0x7fb9a41543b0 0x7fb9a40cb240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:47.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:47.330+0000 7fb9a93db640 1 --2- 172.21.15.50:0/2618755108 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb9a40cabb0 0x7fb9a40cb780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:47.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:47.330+0000 7fb9a8bda640 1 -- 172.21.15.50:0/2618755108 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb9a40cabb0 msgr2=0x7fb9a40cb780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:55:47.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:47.330+0000 7fb9a8bda640 1 --2- 172.21.15.50:0/2618755108 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb9a40cabb0 0x7fb9a40cb780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:47.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:47.330+0000 7fb9a8bda640 1 -- 172.21.15.50:0/2618755108 >> v2:172.21.15.97:3300/0 conn(0x7fb9a41543b0 msgr2=0x7fb9a40cb240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:55:47.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:47.330+0000 7fb9a8bda640 1 --2- 172.21.15.50:0/2618755108 >> v2:172.21.15.97:3300/0 conn(0x7fb9a41543b0 0x7fb9a40cb240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:47.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:47.330+0000 7fb9a8bda640 1 -- 172.21.15.50:0/2618755108 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9a415a5a0 con 0x7fb9a4153fd0 2024-04-01T01:55:47.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:47.330+0000 7fb9a8bda640 1 --2- 172.21.15.50:0/2618755108 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9a4153fd0 0x7fb9a40ca670 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb9a406b580 tx=0x7fb99801ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf1a334945d4d4ac server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:47.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:47.334+0000 7fb9a37fe640 1 -- 172.21.15.50:0/2618755108 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9980b5070 con 0x7fb9a4153fd0 2024-04-01T01:55:47.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:47.334+0000 7fb9a37fe640 1 -- 172.21.15.50:0/2618755108 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9980a89d0 con 0x7fb9a4153fd0 2024-04-01T01:55:47.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:47.334+0000 7fb9a37fe640 1 -- 172.21.15.50:0/2618755108 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9980a8da0 con 0x7fb9a4153fd0 2024-04-01T01:55:47.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:47.334+0000 7fb9aae3e640 1 -- 172.21.15.50:0/2618755108 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9a4153fd0 msgr2=0x7fb9a40ca670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:47.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:47.334+0000 7fb9aae3e640 1 --2- 172.21.15.50:0/2618755108 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9a4153fd0 0x7fb9a40ca670 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb9a406b580 tx=0x7fb99801ed10 comp rx=0 tx=0).stop 2024-04-01T01:55:47.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:47.334+0000 7fb9aae3e640 1 -- 172.21.15.50:0/2618755108 shutdown_connections 2024-04-01T01:55:47.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:47.334+0000 7fb9aae3e640 1 --2- 172.21.15.50:0/2618755108 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb9a40cabb0 0x7fb9a40cb780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:47.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:47.334+0000 7fb9aae3e640 1 --2- 172.21.15.50:0/2618755108 >> v2:172.21.15.97:3300/0 conn(0x7fb9a41543b0 0x7fb9a40cb240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:47.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:47.334+0000 7fb9aae3e640 1 --2- 172.21.15.50:0/2618755108 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9a4153fd0 0x7fb9a40ca670 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:47.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:47.334+0000 7fb9aae3e640 1 -- 172.21.15.50:0/2618755108 >> 172.21.15.50:0/2618755108 conn(0x7fb9a4067130 msgr2=0x7fb9a4067540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:55:47.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:47.334+0000 7fb9aae3e640 1 -- 172.21.15.50:0/2618755108 shutdown_connections 2024-04-01T01:55:47.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:47.334+0000 7fb9aae3e640 1 -- 172.21.15.50:0/2618755108 wait complete. 2024-04-01T01:55:47.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:47.334+0000 7fb9aae3e640 1 Processor -- start 2024-04-01T01:55:47.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:47.334+0000 7fb9aae3e640 1 -- start start 2024-04-01T01:55:47.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:47.334+0000 7fb9aae3e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9a40cabb0 0x7fb9a41548c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:47.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:47.334+0000 7fb9aae3e640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb9a4153fd0 0x7fb9a4159180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:47.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:47.334+0000 7fb9aae3e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb9a41543b0 0x7fb9a41596c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:47.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:47.334+0000 7fb9aae3e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb9a40c4a30 con 0x7fb9a40cabb0 2024-04-01T01:55:47.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:47.334+0000 7fb9aae3e640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fb9a415ab60 con 0x7fb9a41543b0 2024-04-01T01:55:47.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:47.334+0000 7fb9aae3e640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fb9a40c4bb0 con 0x7fb9a4153fd0 2024-04-01T01:55:47.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:47.334+0000 7fb9a8bda640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9a40cabb0 0x7fb9a41548c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:47.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:47.334+0000 7fb9a8bda640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9a40cabb0 0x7fb9a41548c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39746/0 (socket says 172.21.15.50:39746) 2024-04-01T01:55:47.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:47.334+0000 7fb9a8bda640 1 -- 172.21.15.50:0/3476815531 learned_addr learned my addr 172.21.15.50:0/3476815531 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T01:55:47.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:47.334+0000 7fb9a3fff640 1 --2- 172.21.15.50:0/3476815531 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb9a4153fd0 0x7fb9a4159180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:47.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:47.334+0000 7fb9a93db640 1 --2- 172.21.15.50:0/3476815531 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb9a41543b0 0x7fb9a41596c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:47.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:47.334+0000 7fb9a8bda640 1 -- 172.21.15.50:0/3476815531 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb9a4153fd0 msgr2=0x7fb9a4159180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:47.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:47.334+0000 7fb9a8bda640 1 --2- 172.21.15.50:0/3476815531 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb9a4153fd0 0x7fb9a4159180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:47.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:47.334+0000 7fb9a8bda640 1 -- 172.21.15.50:0/3476815531 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb9a41543b0 msgr2=0x7fb9a41596c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:47.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:47.334+0000 7fb9a8bda640 1 --2- 172.21.15.50:0/3476815531 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb9a41543b0 0x7fb9a41596c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:47.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:47.338+0000 7fb9a8bda640 1 -- 172.21.15.50:0/3476815531 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9a41ef960 con 0x7fb9a40cabb0 2024-04-01T01:55:47.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:47.338+0000 7fb9a93db640 1 --2- 172.21.15.50:0/3476815531 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb9a41543b0 0x7fb9a41596c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T01:55:47.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:47.338+0000 7fb9a3fff640 1 --2- 172.21.15.50:0/3476815531 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb9a4153fd0 0x7fb9a4159180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T01:55:47.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:47.338+0000 7fb9a8bda640 1 --2- 172.21.15.50:0/3476815531 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9a40cabb0 0x7fb9a41548c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb99801d3c0 tx=0x7fb99801bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:47.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:47.338+0000 7fb9a17fa640 1 -- 172.21.15.50:0/3476815531 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9980b5070 con 0x7fb9a40cabb0 2024-04-01T01:55:47.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:47.338+0000 7fb9a17fa640 1 -- 172.21.15.50:0/3476815531 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9980b0a70 con 0x7fb9a40cabb0 2024-04-01T01:55:47.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:47.338+0000 7fb9a17fa640 1 -- 172.21.15.50:0/3476815531 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9980b0e60 con 0x7fb9a40cabb0 2024-04-01T01:55:47.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:47.338+0000 7fb9aae3e640 1 -- 172.21.15.50:0/3476815531 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9a41efc00 con 0x7fb9a40cabb0 2024-04-01T01:55:47.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:47.338+0000 7fb9aae3e640 1 -- 172.21.15.50:0/3476815531 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9a41efec0 con 0x7fb9a40cabb0 2024-04-01T01:55:47.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:47.338+0000 7fb9aae3e640 1 -- 172.21.15.50:0/3476815531 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9a4068230 con 0x7fb9a40cabb0 2024-04-01T01:55:47.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:47.338+0000 7fb9a17fa640 1 -- 172.21.15.50:0/3476815531 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 87103+0+0 (secure 0 0 0) 0x7fb9980c2060 con 0x7fb9a40cabb0 2024-04-01T01:55:47.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:47.338+0000 7fb9a17fa640 1 --2- 172.21.15.50:0/3476815531 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fb988067420 0x7fb9880698e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:47.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:47.338+0000 7fb9a17fa640 1 -- 172.21.15.50:0/3476815531 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5227+0+0 (secure 0 0 0) 0x7fb998122570 con 0x7fb9a40cabb0 2024-04-01T01:55:47.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:47.338+0000 7fb9a3fff640 1 --2- 172.21.15.50:0/3476815531 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fb988067420 0x7fb9880698e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:47.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:47.342+0000 7fb9a3fff640 1 --2- 172.21.15.50:0/3476815531 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fb988067420 0x7fb9880698e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb9a40b39a0 tx=0x7fb990008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:47.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:47.342+0000 7fb9a17fa640 1 -- 172.21.15.50:0/3476815531 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+176632 (secure 0 0 0) 0x7fb998018870 con 0x7fb9a40cabb0 2024-04-01T01:55:47.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:47.506+0000 7fb9aae3e640 1 -- 172.21.15.50:0/3476815531 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fb9a40cb020 con 0x7fb9a40cabb0 2024-04-01T01:55:48.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:48.174+0000 7fb9a17fa640 1 -- 172.21.15.50:0/3476815531 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v19) ==== 170+0+0 (secure 0 0 0) 0x7fb9980f3580 con 0x7fb9a40cabb0 2024-04-01T01:55:48.175 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' created 2024-04-01T01:55:48.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:48.178+0000 7fb9aae3e640 1 -- 172.21.15.50:0/3476815531 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fb988067420 msgr2=0x7fb9880698e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:48.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:48.178+0000 7fb9aae3e640 1 --2- 172.21.15.50:0/3476815531 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fb988067420 0x7fb9880698e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb9a40b39a0 tx=0x7fb990008040 comp rx=0 tx=0).stop 2024-04-01T01:55:48.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:48.178+0000 7fb9aae3e640 1 -- 172.21.15.50:0/3476815531 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9a40cabb0 msgr2=0x7fb9a41548c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:48.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:48.178+0000 7fb9aae3e640 1 --2- 172.21.15.50:0/3476815531 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9a40cabb0 0x7fb9a41548c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb99801d3c0 tx=0x7fb99801bab0 comp rx=0 tx=0).stop 2024-04-01T01:55:48.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:48.178+0000 7fb9aae3e640 1 -- 172.21.15.50:0/3476815531 shutdown_connections 2024-04-01T01:55:48.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:48.178+0000 7fb9aae3e640 1 --2- 172.21.15.50:0/3476815531 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fb988067420 0x7fb9880698e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:48.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:48.178+0000 7fb9aae3e640 1 --2- 172.21.15.50:0/3476815531 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb9a41543b0 0x7fb9a41596c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:48.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:48.178+0000 7fb9aae3e640 1 --2- 172.21.15.50:0/3476815531 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb9a4153fd0 0x7fb9a4159180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:48.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:48.178+0000 7fb9aae3e640 1 --2- 172.21.15.50:0/3476815531 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9a40cabb0 0x7fb9a41548c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:48.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:48.178+0000 7fb9aae3e640 1 -- 172.21.15.50:0/3476815531 >> 172.21.15.50:0/3476815531 conn(0x7fb9a4067130 msgr2=0x7fb9a40cb240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:55:48.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:48.178+0000 7fb9aae3e640 1 -- 172.21.15.50:0/3476815531 shutdown_connections 2024-04-01T01:55:48.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:48.178+0000 7fb9aae3e640 1 -- 172.21.15.50:0/3476815531 wait complete. 2024-04-01T01:55:48.221 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-01T01:55:48.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:48.346+0000 7efcb080d640 1 Processor -- start 2024-04-01T01:55:48.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:48.346+0000 7efcb080d640 1 -- start start 2024-04-01T01:55:48.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:48.346+0000 7efcb080d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efcac0ca260 0x7efcac0cad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:48.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:48.346+0000 7efcb080d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7efcac0cb2b0 0x7efcac15d970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:48.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:48.346+0000 7efcb080d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efcac159ea0 con 0x7efcac154060 2024-04-01T01:55:48.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:48.346+0000 7efcb080d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7efcac0ca680 con 0x7efcac0cb2b0 2024-04-01T01:55:48.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:48.346+0000 7efcb080d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7efcac15a140 con 0x7efcac0ca260 2024-04-01T01:55:48.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:48.346+0000 7efca9d9b640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efcac0ca260 0x7efcac0cad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:48.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:48.346+0000 7efcaad9d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7efcac0cb2b0 0x7efcac15d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:48.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:48.346+0000 7efcaad9d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7efcac0cb2b0 0x7efcac15d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.50:48408/0 (socket says 172.21.15.50:48408) 2024-04-01T01:55:48.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:48.346+0000 7efcaad9d640 1 -- 172.21.15.50:0/1795057900 learned_addr learned my addr 172.21.15.50:0/1795057900 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T01:55:48.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:48.346+0000 7efcaad9d640 1 -- 172.21.15.50:0/1795057900 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efcac0ca260 msgr2=0x7efcac0cad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:55:48.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:48.346+0000 7efcaad9d640 1 --2- 172.21.15.50:0/1795057900 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efcac0ca260 0x7efcac0cad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:48.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:48.346+0000 7efcaad9d640 1 -- 172.21.15.50:0/1795057900 >> v1:172.21.15.97:6789/0 conn(0x7efcac154060 legacy=0x7efcac0cb8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:48.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:48.346+0000 7efcaad9d640 1 -- 172.21.15.50:0/1795057900 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcac15a420 con 0x7efcac0cb2b0 2024-04-01T01:55:48.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:48.350+0000 7efcaad9d640 1 --2- 172.21.15.50:0/1795057900 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efcac0cb2b0 0x7efcac15d970 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7efca4009870 tx=0x7efca401ed50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb8f7e4025195452 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:48.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:48.350+0000 7efca959a640 1 -- 172.21.15.50:0/1795057900 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efca40b5070 con 0x7efcac0cb2b0 2024-04-01T01:55:48.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:48.350+0000 7efca959a640 1 -- 172.21.15.50:0/1795057900 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efca40a8a50 con 0x7efcac0cb2b0 2024-04-01T01:55:48.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:48.350+0000 7efca959a640 1 -- 172.21.15.50:0/1795057900 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efca40a8e20 con 0x7efcac0cb2b0 2024-04-01T01:55:48.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:48.350+0000 7efcb080d640 1 -- 172.21.15.50:0/1795057900 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efcac0cb2b0 msgr2=0x7efcac15d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:48.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:48.350+0000 7efcb080d640 1 --2- 172.21.15.50:0/1795057900 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efcac0cb2b0 0x7efcac15d970 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7efca4009870 tx=0x7efca401ed50 comp rx=0 tx=0).stop 2024-04-01T01:55:48.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:48.350+0000 7efcb080d640 1 -- 172.21.15.50:0/1795057900 shutdown_connections 2024-04-01T01:55:48.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:48.350+0000 7efcb080d640 1 --2- 172.21.15.50:0/1795057900 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efcac0cb2b0 0x7efcac15d970 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:48.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:48.350+0000 7efcb080d640 1 --2- 172.21.15.50:0/1795057900 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efcac0ca260 0x7efcac0cad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:48.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:48.350+0000 7efcb080d640 1 -- 172.21.15.50:0/1795057900 >> 172.21.15.50:0/1795057900 conn(0x7efcac06c930 msgr2=0x7efcac06ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:55:48.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:48.350+0000 7efcb080d640 1 -- 172.21.15.50:0/1795057900 shutdown_connections 2024-04-01T01:55:48.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:48.350+0000 7efcb080d640 1 -- 172.21.15.50:0/1795057900 wait complete. 2024-04-01T01:55:48.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:48.350+0000 7efcb080d640 1 Processor -- start 2024-04-01T01:55:48.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:48.350+0000 7efcb080d640 1 -- start start 2024-04-01T01:55:48.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:48.354+0000 7efcb080d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efcac0ca260 0x7efcac0b4230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:48.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:48.354+0000 7efcb080d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efcac0cb2b0 0x7efcac0cd560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:48.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:48.354+0000 7efcb080d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efcac154060 0x7efcac0cdaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:48.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:48.354+0000 7efcb080d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7efcac15acc0 con 0x7efcac0cb2b0 2024-04-01T01:55:48.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:48.354+0000 7efcb080d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7efcac15a9e0 con 0x7efcac0ca260 2024-04-01T01:55:48.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:48.354+0000 7efcb080d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7efcac15d450 con 0x7efcac154060 2024-04-01T01:55:48.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:48.354+0000 7efca9d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efcac0cb2b0 0x7efcac0cd560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:48.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:48.354+0000 7efca9d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efcac0cb2b0 0x7efcac0cd560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55304/0 (socket says 172.21.15.50:55304) 2024-04-01T01:55:48.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:48.354+0000 7efca9d9b640 1 -- 172.21.15.50:0/761514470 learned_addr learned my addr 172.21.15.50:0/761514470 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T01:55:48.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:48.354+0000 7efcaad9d640 1 --2- 172.21.15.50:0/761514470 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efcac154060 0x7efcac0cdaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:48.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:48.354+0000 7efcaa59c640 1 --2- 172.21.15.50:0/761514470 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efcac0ca260 0x7efcac0b4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:48.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:48.354+0000 7efca9d9b640 1 -- 172.21.15.50:0/761514470 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efcac154060 msgr2=0x7efcac0cdaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:48.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:48.354+0000 7efca9d9b640 1 --2- 172.21.15.50:0/761514470 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efcac154060 0x7efcac0cdaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:48.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:48.354+0000 7efca9d9b640 1 -- 172.21.15.50:0/761514470 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efcac0ca260 msgr2=0x7efcac0b4230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:48.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:48.354+0000 7efca9d9b640 1 --2- 172.21.15.50:0/761514470 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efcac0ca260 0x7efcac0b4230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:48.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:48.354+0000 7efca9d9b640 1 -- 172.21.15.50:0/761514470 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcac153840 con 0x7efcac0cb2b0 2024-04-01T01:55:48.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:48.354+0000 7efcaad9d640 1 --2- 172.21.15.50:0/761514470 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efcac154060 0x7efcac0cdaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T01:55:48.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:48.354+0000 7efca9d9b640 1 --2- 172.21.15.50:0/761514470 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efcac0cb2b0 0x7efcac0cd560 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7efca000e930 tx=0x7efca000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:48.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:48.354+0000 7efc9affd640 1 -- 172.21.15.50:0/761514470 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efca0017070 con 0x7efcac0cb2b0 2024-04-01T01:55:48.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:48.354+0000 7efc9affd640 1 -- 172.21.15.50:0/761514470 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efca000ca00 con 0x7efcac0cb2b0 2024-04-01T01:55:48.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:48.354+0000 7efc9affd640 1 -- 172.21.15.50:0/761514470 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efca000cdb0 con 0x7efcac0cb2b0 2024-04-01T01:55:48.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:48.354+0000 7efcb080d640 1 -- 172.21.15.50:0/761514470 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcac0b3d80 con 0x7efcac0cb2b0 2024-04-01T01:55:48.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:48.354+0000 7efcb080d640 1 -- 172.21.15.50:0/761514470 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcac0b3aa0 con 0x7efcac0cb2b0 2024-04-01T01:55:48.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:48.354+0000 7efcb080d640 1 -- 172.21.15.50:0/761514470 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcac068230 con 0x7efcac0cb2b0 2024-04-01T01:55:48.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:48.354+0000 7efc9affd640 1 -- 172.21.15.50:0/761514470 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 87103+0+0 (secure 0 0 0) 0x7efca001a070 con 0x7efcac0cb2b0 2024-04-01T01:55:48.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:48.354+0000 7efc9affd640 1 --2- 172.21.15.50:0/761514470 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7efc8c067420 0x7efc8c0698e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:48.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:48.354+0000 7efc9affd640 1 -- 172.21.15.50:0/761514470 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5609+0+0 (secure 0 0 0) 0x7efca0085570 con 0x7efcac0cb2b0 2024-04-01T01:55:48.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:48.358+0000 7efcaa59c640 1 --2- 172.21.15.50:0/761514470 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7efc8c067420 0x7efc8c0698e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:48.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:48.358+0000 7efcaa59c640 1 --2- 172.21.15.50:0/761514470 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7efc8c067420 0x7efc8c0698e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7efc9c001e00 tx=0x7efc9c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:48.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:48.362+0000 7efc9affd640 1 -- 172.21.15.50:0/761514470 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+176632 (secure 0 0 0) 0x7efca0055e70 con 0x7efcac0cb2b0 2024-04-01T01:55:48.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:48.558+0000 7efcb080d640 1 -- 172.21.15.50:0/761514470 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7efcac0747b0 con 0x7efcac0cb2b0 2024-04-01T01:55:49.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.214+0000 7efc9affd640 1 -- 172.21.15.50:0/761514470 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7efca0059f10 con 0x7efcac0cb2b0 2024-04-01T01:55:49.215 INFO:teuthology.orchestra.run.smithi050.stderr:new fs with metadata pool 2 and data pool 3 2024-04-01T01:55:49.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.214+0000 7efcb080d640 1 -- 172.21.15.50:0/761514470 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7efc8c067420 msgr2=0x7efc8c0698e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:49.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.214+0000 7efcb080d640 1 --2- 172.21.15.50:0/761514470 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7efc8c067420 0x7efc8c0698e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7efc9c001e00 tx=0x7efc9c009040 comp rx=0 tx=0).stop 2024-04-01T01:55:49.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.214+0000 7efcb080d640 1 -- 172.21.15.50:0/761514470 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efcac0cb2b0 msgr2=0x7efcac0cd560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:49.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.214+0000 7efcb080d640 1 --2- 172.21.15.50:0/761514470 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efcac0cb2b0 0x7efcac0cd560 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7efca000e930 tx=0x7efca000edf0 comp rx=0 tx=0).stop 2024-04-01T01:55:49.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.218+0000 7efcb080d640 1 -- 172.21.15.50:0/761514470 shutdown_connections 2024-04-01T01:55:49.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.218+0000 7efcb080d640 1 --2- 172.21.15.50:0/761514470 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7efc8c067420 0x7efc8c0698e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:49.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.218+0000 7efcb080d640 1 --2- 172.21.15.50:0/761514470 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efcac154060 0x7efcac0cdaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:49.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.218+0000 7efcb080d640 1 --2- 172.21.15.50:0/761514470 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efcac0cb2b0 0x7efcac0cd560 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:49.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.218+0000 7efcb080d640 1 --2- 172.21.15.50:0/761514470 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efcac0ca260 0x7efcac0b4230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:49.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.218+0000 7efcb080d640 1 -- 172.21.15.50:0/761514470 >> 172.21.15.50:0/761514470 conn(0x7efcac06c930 msgr2=0x7efcac157d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:55:49.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.218+0000 7efcb080d640 1 -- 172.21.15.50:0/761514470 shutdown_connections 2024-04-01T01:55:49.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.218+0000 7efcb080d640 1 -- 172.21.15.50:0/761514470 wait complete. 2024-04-01T01:55:49.258 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-01T01:55:49.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.378+0000 7fe2a33c2640 1 Processor -- start 2024-04-01T01:55:49.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.378+0000 7fe2a33c2640 1 -- start start 2024-04-01T01:55:49.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.378+0000 7fe2a33c2640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe29c153f70 0x7fe29c071250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:49.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.378+0000 7fe2a33c2640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe29c071790 0x7fe29c06ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:49.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.378+0000 7fe2a33c2640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe29c15e1b0 con 0x7fe29c0c6270 2024-04-01T01:55:49.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.378+0000 7fe2a33c2640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fe29c0c6ca0 con 0x7fe29c153f70 2024-04-01T01:55:49.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.378+0000 7fe2a33c2640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fe29c15a960 con 0x7fe29c071790 2024-04-01T01:55:49.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.378+0000 7fe2a115e640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe29c153f70 0x7fe29c071250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:49.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.378+0000 7fe2a095d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe29c071790 0x7fe29c06ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:49.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.378+0000 7fe2a195f640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fe29c0c6270 0x7fe29c06f180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.50:33658/0 (socket says 172.21.15.50:33658) 2024-04-01T01:55:49.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.378+0000 7fe2a115e640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe29c153f70 0x7fe29c071250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.50:48412/0 (socket says 172.21.15.50:48412) 2024-04-01T01:55:49.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.378+0000 7fe2a195f640 1 -- 172.21.15.50:0/1023258742 learned_addr learned my addr 172.21.15.50:0/1023258742 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-04-01T01:55:49.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.378+0000 7fe2a095d640 1 -- 172.21.15.50:0/1023258742 >> v2:172.21.15.97:3300/0 conn(0x7fe29c153f70 msgr2=0x7fe29c071250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:55:49.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.378+0000 7fe2a095d640 1 --2- 172.21.15.50:0/1023258742 >> v2:172.21.15.97:3300/0 conn(0x7fe29c153f70 0x7fe29c071250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:49.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.378+0000 7fe2a095d640 1 -- 172.21.15.50:0/1023258742 >> v1:172.21.15.97:6789/0 conn(0x7fe29c0c6270 legacy=0x7fe29c06f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:49.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.378+0000 7fe2a095d640 1 -- 172.21.15.50:0/1023258742 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe29c15d3f0 con 0x7fe29c071790 2024-04-01T01:55:49.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.382+0000 7fe2a095d640 1 --2- 172.21.15.50:0/1023258742 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe29c071790 0x7fe29c06ec40 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fe28c0097c0 tx=0x7fe28c01c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b9dca0759fe58ff3 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:49.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.382+0000 7fe293fff640 1 -- 172.21.15.50:0/1023258742 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe28c0b0070 con 0x7fe29c071790 2024-04-01T01:55:49.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.382+0000 7fe293fff640 1 -- 172.21.15.50:0/1023258742 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe28c0ab600 con 0x7fe29c071790 2024-04-01T01:55:49.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.382+0000 7fe293fff640 1 -- 172.21.15.50:0/1023258742 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe28c0ab9d0 con 0x7fe29c071790 2024-04-01T01:55:49.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.382+0000 7fe2a33c2640 1 -- 172.21.15.50:0/1023258742 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe29c071790 msgr2=0x7fe29c06ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:49.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.382+0000 7fe2a33c2640 1 --2- 172.21.15.50:0/1023258742 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe29c071790 0x7fe29c06ec40 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fe28c0097c0 tx=0x7fe28c01c4a0 comp rx=0 tx=0).stop 2024-04-01T01:55:49.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.382+0000 7fe2a33c2640 1 -- 172.21.15.50:0/1023258742 shutdown_connections 2024-04-01T01:55:49.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.382+0000 7fe2a33c2640 1 --2- 172.21.15.50:0/1023258742 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe29c071790 0x7fe29c06ec40 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:49.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.382+0000 7fe2a33c2640 1 --2- 172.21.15.50:0/1023258742 >> v2:172.21.15.97:3300/0 conn(0x7fe29c153f70 0x7fe29c071250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:49.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.382+0000 7fe2a33c2640 1 -- 172.21.15.50:0/1023258742 >> 172.21.15.50:0/1023258742 conn(0x7fe29c067560 msgr2=0x7fe29c06b220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:55:49.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.382+0000 7fe2a33c2640 1 -- 172.21.15.50:0/1023258742 shutdown_connections 2024-04-01T01:55:49.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.382+0000 7fe2a33c2640 1 -- 172.21.15.50:0/1023258742 wait complete. 2024-04-01T01:55:49.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.382+0000 7fe2a33c2640 1 Processor -- start 2024-04-01T01:55:49.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.382+0000 7fe2a33c2640 1 -- start start 2024-04-01T01:55:49.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.382+0000 7fe2a33c2640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe29c071790 0x7fe29c15c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:49.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.382+0000 7fe2a33c2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe29c0c6270 0x7fe29c148700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:49.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.382+0000 7fe2a33c2640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe29c153f70 0x7fe29c1f6500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:49.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.382+0000 7fe2a33c2640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe29c1544d0 con 0x7fe29c0c6270 2024-04-01T01:55:49.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.382+0000 7fe2a33c2640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fe29c154350 con 0x7fe29c071790 2024-04-01T01:55:49.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.382+0000 7fe2a33c2640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fe29c0c8960 con 0x7fe29c153f70 2024-04-01T01:55:49.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.386+0000 7fe2a095d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe29c0c6270 0x7fe29c148700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:49.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.386+0000 7fe2a095d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe29c0c6270 0x7fe29c148700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55308/0 (socket says 172.21.15.50:55308) 2024-04-01T01:55:49.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.386+0000 7fe2a095d640 1 -- 172.21.15.50:0/1464989845 learned_addr learned my addr 172.21.15.50:0/1464989845 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T01:55:49.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.386+0000 7fe2a115e640 1 --2- 172.21.15.50:0/1464989845 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe29c071790 0x7fe29c15c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:49.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.386+0000 7fe2a195f640 1 --2- 172.21.15.50:0/1464989845 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe29c153f70 0x7fe29c1f6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:49.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.386+0000 7fe2a095d640 1 -- 172.21.15.50:0/1464989845 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe29c153f70 msgr2=0x7fe29c1f6500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:49.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.386+0000 7fe2a095d640 1 --2- 172.21.15.50:0/1464989845 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe29c153f70 0x7fe29c1f6500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:49.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.386+0000 7fe2a095d640 1 -- 172.21.15.50:0/1464989845 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe29c071790 msgr2=0x7fe29c15c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:49.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.386+0000 7fe2a095d640 1 --2- 172.21.15.50:0/1464989845 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe29c071790 0x7fe29c15c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:49.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.386+0000 7fe2a095d640 1 -- 172.21.15.50:0/1464989845 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe29c15cc50 con 0x7fe29c0c6270 2024-04-01T01:55:49.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.386+0000 7fe2a195f640 1 --2- 172.21.15.50:0/1464989845 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe29c153f70 0x7fe29c1f6500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T01:55:49.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.386+0000 7fe2a115e640 1 --2- 172.21.15.50:0/1464989845 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe29c071790 0x7fe29c15c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T01:55:49.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.386+0000 7fe2a095d640 1 --2- 172.21.15.50:0/1464989845 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe29c0c6270 0x7fe29c148700 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe28c0ae040 tx=0x7fe28c019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:49.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.386+0000 7fe291ffb640 1 -- 172.21.15.50:0/1464989845 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe28c0b0040 con 0x7fe29c0c6270 2024-04-01T01:55:49.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.386+0000 7fe291ffb640 1 -- 172.21.15.50:0/1464989845 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe28c0b43f0 con 0x7fe29c0c6270 2024-04-01T01:55:49.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.386+0000 7fe2a33c2640 1 -- 172.21.15.50:0/1464989845 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe29c15cf30 con 0x7fe29c0c6270 2024-04-01T01:55:49.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.386+0000 7fe291ffb640 1 -- 172.21.15.50:0/1464989845 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe28c0b4800 con 0x7fe29c0c6270 2024-04-01T01:55:49.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.386+0000 7fe2a33c2640 1 -- 172.21.15.50:0/1464989845 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe29c0c3ae0 con 0x7fe29c0c6270 2024-04-01T01:55:49.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.386+0000 7fe2a33c2640 1 -- 172.21.15.50:0/1464989845 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe29c0c3e10 con 0x7fe29c0c6270 2024-04-01T01:55:49.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.386+0000 7fe291ffb640 1 -- 172.21.15.50:0/1464989845 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 87103+0+0 (secure 0 0 0) 0x7fe28c0b49a0 con 0x7fe29c0c6270 2024-04-01T01:55:49.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.386+0000 7fe291ffb640 1 --2- 172.21.15.50:0/1464989845 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fe280067420 0x7fe2800698e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:49.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.386+0000 7fe291ffb640 1 -- 172.21.15.50:0/1464989845 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe28c11f0d0 con 0x7fe29c0c6270 2024-04-01T01:55:49.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.386+0000 7fe2a115e640 1 --2- 172.21.15.50:0/1464989845 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fe280067420 0x7fe2800698e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:49.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.386+0000 7fe2a115e640 1 --2- 172.21.15.50:0/1464989845 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fe280067420 0x7fe2800698e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe2980074c0 tx=0x7fe29800b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:49.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.390+0000 7fe291ffb640 1 -- 172.21.15.50:0/1464989845 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+176632 (secure 0 0 0) 0x7fe28c016090 con 0x7fe29c0c6270 2024-04-01T01:55:49.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.554+0000 7fe2a33c2640 1 -- 172.21.15.50:0/1464989845 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe29c068230 con 0x7fe29c0c6270 2024-04-01T01:55:49.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.558+0000 7fe291ffb640 1 -- 172.21.15.50:0/1464989845 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16538 (secure 0 0 0) 0x7fe28c0eff00 con 0x7fe29c0c6270 2024-04-01T01:55:49.559 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-01T01:55:49.559 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":20,"fsid":"f67878a9-bc75-426b-962d-fa7bc2517f7d","created":"2024-04-01T01:55:31.562371+0000","modified":"2024-04-01T01:55:48.563510+0000","last_up_change":"2024-04-01T01:55:42.134502+0000","last_in_change":"2024-04-01T01:55:33.849789+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-01T01:55:42.134418+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-01T01:55:47.009880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-01T01:55:47.551516+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"81e8ca4f-bde8-419a-875f-73a1f4a641ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":4170468134},{"type":"v1","addr":"172.21.15.50:6825","nonce":4170468134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":4170468134},{"type":"v1","addr":"172.21.15.50:6827","nonce":4170468134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":4170468134},{"type":"v1","addr":"172.21.15.50:6831","nonce":4170468134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":4170468134},{"type":"v1","addr":"172.21.15.50:6829","nonce":4170468134}]},"public_addr":"172.21.15.50:6825/4170468134","cluster_addr":"172.21.15.50:6827/4170468134","heartbeat_back_addr":"172.21.15.50:6831/4170468134","heartbeat_front_addr":"172.21.15.50:6829/4170468134","state":["exists","up"]},{"osd":1,"uuid":"bd060ca0-7559-4d30-987c-62e59818431d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1794491326},{"type":"v1","addr":"172.21.15.50:6809","nonce":1794491326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1794491326},{"type":"v1","addr":"172.21.15.50:6811","nonce":1794491326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1794491326},{"type":"v1","addr":"172.21.15.50:6815","nonce":1794491326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1794491326},{"type":"v1","addr":"172.21.15.50:6813","nonce":1794491326}]},"public_addr":"172.21.15.50:6809/1794491326","cluster_addr":"172.21.15.50:6811/1794491326","heartbeat_back_addr":"172.21.15.50:6815/1794491326","heartbeat_front_addr":"172.21.15.50:6813/1794491326","state":["exists","up"]},{"osd":2,"uuid":"eac5d816-a281-4acd-aa7d-b96a8e0aa962","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":710247177},{"type":"v1","addr":"172.21.15.50:6801","nonce":710247177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":710247177},{"type":"v1","addr":"172.21.15.50:6803","nonce":710247177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":710247177},{"type":"v1","addr":"172.21.15.50:6807","nonce":710247177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":710247177},{"type":"v1","addr":"172.21.15.50:6805","nonce":710247177}]},"public_addr":"172.21.15.50:6801/710247177","cluster_addr":"172.21.15.50:6803/710247177","heartbeat_back_addr":"172.21.15.50:6807/710247177","heartbeat_front_addr":"172.21.15.50:6805/710247177","state":["exists","up"]},{"osd":3,"uuid":"12b23968-04a7-40b8-98c4-02b16ae28265","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":871680805},{"type":"v1","addr":"172.21.15.50:6817","nonce":871680805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":871680805},{"type":"v1","addr":"172.21.15.50:6819","nonce":871680805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":871680805},{"type":"v1","addr":"172.21.15.50:6823","nonce":871680805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":871680805},{"type":"v1","addr":"172.21.15.50:6821","nonce":871680805}]},"public_addr":"172.21.15.50:6817/871680805","cluster_addr":"172.21.15.50:6819/871680805","heartbeat_back_addr":"172.21.15.50:6823/871680805","heartbeat_front_addr":"172.21.15.50:6821/871680805","state":["exists","up"]},{"osd":4,"uuid":"0e6b1639-23b0-47d9-8b08-40c8ab6df818","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":1095319381},{"type":"v1","addr":"172.21.15.97:6801","nonce":1095319381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":1095319381},{"type":"v1","addr":"172.21.15.97:6803","nonce":1095319381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":1095319381},{"type":"v1","addr":"172.21.15.97:6807","nonce":1095319381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":1095319381},{"type":"v1","addr":"172.21.15.97:6805","nonce":1095319381}]},"public_addr":"172.21.15.97:6801/1095319381","cluster_addr":"172.21.15.97:6803/1095319381","heartbeat_back_addr":"172.21.15.97:6807/1095319381","heartbeat_front_addr":"172.21.15.97:6805/1095319381","state":["exists","up"]},{"osd":5,"uuid":"f0f876ef-0823-46e9-8fe4-9b7a64a94cee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":899031308},{"type":"v1","addr":"172.21.15.97:6817","nonce":899031308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":899031308},{"type":"v1","addr":"172.21.15.97:6819","nonce":899031308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":899031308},{"type":"v1","addr":"172.21.15.97:6823","nonce":899031308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":899031308},{"type":"v1","addr":"172.21.15.97:6821","nonce":899031308}]},"public_addr":"172.21.15.97:6817/899031308","cluster_addr":"172.21.15.97:6819/899031308","heartbeat_back_addr":"172.21.15.97:6823/899031308","heartbeat_front_addr":"172.21.15.97:6821/899031308","state":["exists","up"]},{"osd":6,"uuid":"d29a625e-83bf-40ef-a57e-618220b96b9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2224814961},{"type":"v1","addr":"172.21.15.97:6825","nonce":2224814961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2224814961},{"type":"v1","addr":"172.21.15.97:6827","nonce":2224814961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2224814961},{"type":"v1","addr":"172.21.15.97:6831","nonce":2224814961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2224814961},{"type":"v1","addr":"172.21.15.97:6829","nonce":2224814961}]},"public_addr":"172.21.15.97:6825/2224814961","cluster_addr":"172.21.15.97:6827/2224814961","heartbeat_back_addr":"172.21.15.97:6831/2224814961","heartbeat_front_addr":"172.21.15.97:6829/2224814961","state":["exists","up"]},{"osd":7,"uuid":"7bcfd8f1-7dc0-4013-af17-16da5a8d931d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":284968823},{"type":"v1","addr":"172.21.15.97:6809","nonce":284968823}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":284968823},{"type":"v1","addr":"172.21.15.97:6811","nonce":284968823}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6814","nonce":284968823},{"type":"v1","addr":"172.21.15.97:6815","nonce":284968823}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":284968823},{"type":"v1","addr":"172.21.15.97:6813","nonce":284968823}]},"public_addr":"172.21.15.97:6809/284968823","cluster_addr":"172.21.15.97:6811/284968823","heartbeat_back_addr":"172.21.15.97:6815/284968823","heartbeat_front_addr":"172.21.15.97:6813/284968823","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T01:55:39.369550+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T01:55:39.367285+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T01:55:39.458393+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T01:55:39.456179+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T01:55:39.463649+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T01:55:38.728924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T01:55:39.522411+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T01:55:39.432081+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-01T01:55:49.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.558+0000 7fe2a33c2640 1 -- 172.21.15.50:0/1464989845 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fe280067420 msgr2=0x7fe2800698e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:49.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.558+0000 7fe2a33c2640 1 --2- 172.21.15.50:0/1464989845 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fe280067420 0x7fe2800698e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe2980074c0 tx=0x7fe29800b040 comp rx=0 tx=0).stop 2024-04-01T01:55:49.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.558+0000 7fe2a33c2640 1 -- 172.21.15.50:0/1464989845 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe29c0c6270 msgr2=0x7fe29c148700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:49.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.558+0000 7fe2a33c2640 1 --2- 172.21.15.50:0/1464989845 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe29c0c6270 0x7fe29c148700 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe28c0ae040 tx=0x7fe28c019240 comp rx=0 tx=0).stop 2024-04-01T01:55:49.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.558+0000 7fe2a33c2640 1 -- 172.21.15.50:0/1464989845 shutdown_connections 2024-04-01T01:55:49.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.558+0000 7fe2a33c2640 1 --2- 172.21.15.50:0/1464989845 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fe280067420 0x7fe2800698e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:49.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.558+0000 7fe2a33c2640 1 --2- 172.21.15.50:0/1464989845 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe29c153f70 0x7fe29c1f6500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:49.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.558+0000 7fe2a33c2640 1 --2- 172.21.15.50:0/1464989845 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe29c0c6270 0x7fe29c148700 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:49.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.558+0000 7fe2a33c2640 1 --2- 172.21.15.50:0/1464989845 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe29c071790 0x7fe29c15c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:49.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.558+0000 7fe2a33c2640 1 -- 172.21.15.50:0/1464989845 >> 172.21.15.50:0/1464989845 conn(0x7fe29c067560 msgr2=0x7fe29c06b220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:55:49.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.558+0000 7fe2a33c2640 1 -- 172.21.15.50:0/1464989845 shutdown_connections 2024-04-01T01:55:49.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.558+0000 7fe2a33c2640 1 -- 172.21.15.50:0/1464989845 wait complete. 2024-04-01T01:55:49.579 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-01T01:55:49.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.706+0000 7f512fbae640 1 Processor -- start 2024-04-01T01:55:49.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.706+0000 7f512fbae640 1 -- start start 2024-04-01T01:55:49.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.706+0000 7f512fbae640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5128151f50 0x7f512806fec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:49.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.706+0000 7f512fbae640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f51280706d0 0x7f512815b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:49.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.706+0000 7f512fbae640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51280c31f0 con 0x7f512815b7f0 2024-04-01T01:55:49.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.706+0000 7f512fbae640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f51280c2750 con 0x7f51280706d0 2024-04-01T01:55:49.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.706+0000 7f512fbae640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f5128070400 con 0x7f5128151f50 2024-04-01T01:55:49.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.706+0000 7f512d94a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5128151f50 0x7f512806fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:49.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.706+0000 7f512d149640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f51280706d0 0x7f512815b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:49.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.706+0000 7f512d149640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f51280706d0 0x7f512815b2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.50:48422/0 (socket says 172.21.15.50:48422) 2024-04-01T01:55:49.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.706+0000 7f512e14b640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f512815b7f0 0x7f51280cd620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.50:33670/0 (socket says 172.21.15.50:33670) 2024-04-01T01:55:49.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.706+0000 7f512d94a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5128151f50 0x7f512806fec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.50:60814/0 (socket says 172.21.15.50:60814) 2024-04-01T01:55:49.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.706+0000 7f512d149640 1 -- 172.21.15.50:0/2650274746 learned_addr learned my addr 172.21.15.50:0/2650274746 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T01:55:49.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.706+0000 7f512d94a640 1 -- 172.21.15.50:0/2650274746 >> v2:172.21.15.97:3300/0 conn(0x7f51280706d0 msgr2=0x7f512815b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:55:49.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.706+0000 7f512d94a640 1 --2- 172.21.15.50:0/2650274746 >> v2:172.21.15.97:3300/0 conn(0x7f51280706d0 0x7f512815b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:49.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.706+0000 7f512d94a640 1 -- 172.21.15.50:0/2650274746 >> v1:172.21.15.97:6789/0 conn(0x7f512815b7f0 legacy=0x7f51280cd620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:49.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.706+0000 7f512d94a640 1 -- 172.21.15.50:0/2650274746 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51280c8db0 con 0x7f5128151f50 2024-04-01T01:55:49.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.710+0000 7f512d94a640 1 --2- 172.21.15.50:0/2650274746 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5128151f50 0x7f512806fec0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5124009d90 tx=0x7f512401f150 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d3829520f6136ea server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:49.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.710+0000 7f512c948640 1 -- 172.21.15.50:0/2650274746 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51240b4070 con 0x7f5128151f50 2024-04-01T01:55:49.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.710+0000 7f512c948640 1 -- 172.21.15.50:0/2650274746 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51240af600 con 0x7f5128151f50 2024-04-01T01:55:49.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.710+0000 7f512c948640 1 -- 172.21.15.50:0/2650274746 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51240af9d0 con 0x7f5128151f50 2024-04-01T01:55:49.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.710+0000 7f512fbae640 1 -- 172.21.15.50:0/2650274746 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5128151f50 msgr2=0x7f512806fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:49.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.710+0000 7f512fbae640 1 --2- 172.21.15.50:0/2650274746 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5128151f50 0x7f512806fec0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5124009d90 tx=0x7f512401f150 comp rx=0 tx=0).stop 2024-04-01T01:55:49.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.710+0000 7f512fbae640 1 -- 172.21.15.50:0/2650274746 shutdown_connections 2024-04-01T01:55:49.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.710+0000 7f512fbae640 1 --2- 172.21.15.50:0/2650274746 >> v2:172.21.15.97:3300/0 conn(0x7f51280706d0 0x7f512815b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:49.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.710+0000 7f512fbae640 1 --2- 172.21.15.50:0/2650274746 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5128151f50 0x7f512806fec0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:49.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.710+0000 7f512fbae640 1 -- 172.21.15.50:0/2650274746 >> 172.21.15.50:0/2650274746 conn(0x7f512806b220 msgr2=0x7f512806b630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:55:49.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.710+0000 7f512fbae640 1 -- 172.21.15.50:0/2650274746 shutdown_connections 2024-04-01T01:55:49.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.710+0000 7f512fbae640 1 -- 172.21.15.50:0/2650274746 wait complete. 2024-04-01T01:55:49.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.710+0000 7f512fbae640 1 Processor -- start 2024-04-01T01:55:49.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.710+0000 7f512fbae640 1 -- start start 2024-04-01T01:55:49.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.710+0000 7f512fbae640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51280706d0 0x7f512814e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:49.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.710+0000 7f512fbae640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5128151f50 0x7f512814e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:49.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.710+0000 7f512fbae640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f512815b7f0 0x7f512814a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:49.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.710+0000 7f512fbae640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f51280c29f0 con 0x7f51280706d0 2024-04-01T01:55:49.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.710+0000 7f512fbae640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f51280c8510 con 0x7f512815b7f0 2024-04-01T01:55:49.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.710+0000 7f512fbae640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f51280c2cd0 con 0x7f5128151f50 2024-04-01T01:55:49.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.710+0000 7f512d94a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51280706d0 0x7f512814e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:49.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.710+0000 7f512d94a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51280706d0 0x7f512814e270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55322/0 (socket says 172.21.15.50:55322) 2024-04-01T01:55:49.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.710+0000 7f512d94a640 1 -- 172.21.15.50:0/13415339 learned_addr learned my addr 172.21.15.50:0/13415339 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T01:55:49.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.710+0000 7f512e14b640 1 --2- 172.21.15.50:0/13415339 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f512815b7f0 0x7f512814a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:49.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.714+0000 7f512d149640 1 --2- 172.21.15.50:0/13415339 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5128151f50 0x7f512814e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:49.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.714+0000 7f512d94a640 1 -- 172.21.15.50:0/13415339 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5128151f50 msgr2=0x7f512814e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:49.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.714+0000 7f512d94a640 1 --2- 172.21.15.50:0/13415339 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5128151f50 0x7f512814e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:49.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.714+0000 7f512d94a640 1 -- 172.21.15.50:0/13415339 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f512815b7f0 msgr2=0x7f512814a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:49.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.714+0000 7f512d94a640 1 --2- 172.21.15.50:0/13415339 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f512815b7f0 0x7f512814a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:49.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.714+0000 7f512d94a640 1 -- 172.21.15.50:0/13415339 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f512814fc10 con 0x7f51280706d0 2024-04-01T01:55:49.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.714+0000 7f512d94a640 1 --2- 172.21.15.50:0/13415339 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51280706d0 0x7f512814e270 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f512401cd80 tx=0x7f512401bef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:49.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.714+0000 7f511e7fc640 1 -- 172.21.15.50:0/13415339 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51240b4040 con 0x7f51280706d0 2024-04-01T01:55:49.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.714+0000 7f511e7fc640 1 -- 172.21.15.50:0/13415339 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51240c1070 con 0x7f51280706d0 2024-04-01T01:55:49.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.714+0000 7f512fbae640 1 -- 172.21.15.50:0/13415339 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f512806d4b0 con 0x7f51280706d0 2024-04-01T01:55:49.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.714+0000 7f511e7fc640 1 -- 172.21.15.50:0/13415339 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5124009450 con 0x7f51280706d0 2024-04-01T01:55:49.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.714+0000 7f512fbae640 1 -- 172.21.15.50:0/13415339 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f512806da30 con 0x7f51280706d0 2024-04-01T01:55:49.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.714+0000 7f512fbae640 1 -- 172.21.15.50:0/13415339 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5128068940 con 0x7f51280706d0 2024-04-01T01:55:49.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.714+0000 7f511e7fc640 1 -- 172.21.15.50:0/13415339 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 87103+0+0 (secure 0 0 0) 0x7f51240ba6b0 con 0x7f51280706d0 2024-04-01T01:55:49.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.714+0000 7f511e7fc640 1 --2- 172.21.15.50:0/13415339 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f510c067420 0x7f510c0698e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:49.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.714+0000 7f511e7fc640 1 -- 172.21.15.50:0/13415339 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f5124124250 con 0x7f51280706d0 2024-04-01T01:55:49.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.714+0000 7f512d149640 1 --2- 172.21.15.50:0/13415339 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f510c067420 0x7f510c0698e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:49.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.714+0000 7f512d149640 1 --2- 172.21.15.50:0/13415339 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f510c067420 0x7f510c0698e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f512814d6a0 tx=0x7f5118008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:49.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.718+0000 7f511e7fc640 1 -- 172.21.15.50:0/13415339 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+176632 (secure 0 0 0) 0x7f5124018cb0 con 0x7f51280706d0 2024-04-01T01:55:49.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.882+0000 7f512fbae640 1 -- 172.21.15.50:0/13415339 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5128074400 con 0x7f51280706d0 2024-04-01T01:55:49.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.886+0000 7f511e7fc640 1 -- 172.21.15.50:0/13415339 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16538 (secure 0 0 0) 0x7f51240f5080 con 0x7f51280706d0 2024-04-01T01:55:49.887 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-01T01:55:49.887 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":20,"fsid":"f67878a9-bc75-426b-962d-fa7bc2517f7d","created":"2024-04-01T01:55:31.562371+0000","modified":"2024-04-01T01:55:48.563510+0000","last_up_change":"2024-04-01T01:55:42.134502+0000","last_in_change":"2024-04-01T01:55:33.849789+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-01T01:55:42.134418+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-01T01:55:47.009880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-01T01:55:47.551516+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"81e8ca4f-bde8-419a-875f-73a1f4a641ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":4170468134},{"type":"v1","addr":"172.21.15.50:6825","nonce":4170468134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":4170468134},{"type":"v1","addr":"172.21.15.50:6827","nonce":4170468134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":4170468134},{"type":"v1","addr":"172.21.15.50:6831","nonce":4170468134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":4170468134},{"type":"v1","addr":"172.21.15.50:6829","nonce":4170468134}]},"public_addr":"172.21.15.50:6825/4170468134","cluster_addr":"172.21.15.50:6827/4170468134","heartbeat_back_addr":"172.21.15.50:6831/4170468134","heartbeat_front_addr":"172.21.15.50:6829/4170468134","state":["exists","up"]},{"osd":1,"uuid":"bd060ca0-7559-4d30-987c-62e59818431d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1794491326},{"type":"v1","addr":"172.21.15.50:6809","nonce":1794491326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1794491326},{"type":"v1","addr":"172.21.15.50:6811","nonce":1794491326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1794491326},{"type":"v1","addr":"172.21.15.50:6815","nonce":1794491326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1794491326},{"type":"v1","addr":"172.21.15.50:6813","nonce":1794491326}]},"public_addr":"172.21.15.50:6809/1794491326","cluster_addr":"172.21.15.50:6811/1794491326","heartbeat_back_addr":"172.21.15.50:6815/1794491326","heartbeat_front_addr":"172.21.15.50:6813/1794491326","state":["exists","up"]},{"osd":2,"uuid":"eac5d816-a281-4acd-aa7d-b96a8e0aa962","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":710247177},{"type":"v1","addr":"172.21.15.50:6801","nonce":710247177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":710247177},{"type":"v1","addr":"172.21.15.50:6803","nonce":710247177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":710247177},{"type":"v1","addr":"172.21.15.50:6807","nonce":710247177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":710247177},{"type":"v1","addr":"172.21.15.50:6805","nonce":710247177}]},"public_addr":"172.21.15.50:6801/710247177","cluster_addr":"172.21.15.50:6803/710247177","heartbeat_back_addr":"172.21.15.50:6807/710247177","heartbeat_front_addr":"172.21.15.50:6805/710247177","state":["exists","up"]},{"osd":3,"uuid":"12b23968-04a7-40b8-98c4-02b16ae28265","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":871680805},{"type":"v1","addr":"172.21.15.50:6817","nonce":871680805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":871680805},{"type":"v1","addr":"172.21.15.50:6819","nonce":871680805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":871680805},{"type":"v1","addr":"172.21.15.50:6823","nonce":871680805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":871680805},{"type":"v1","addr":"172.21.15.50:6821","nonce":871680805}]},"public_addr":"172.21.15.50:6817/871680805","cluster_addr":"172.21.15.50:6819/871680805","heartbeat_back_addr":"172.21.15.50:6823/871680805","heartbeat_front_addr":"172.21.15.50:6821/871680805","state":["exists","up"]},{"osd":4,"uuid":"0e6b1639-23b0-47d9-8b08-40c8ab6df818","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":1095319381},{"type":"v1","addr":"172.21.15.97:6801","nonce":1095319381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":1095319381},{"type":"v1","addr":"172.21.15.97:6803","nonce":1095319381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":1095319381},{"type":"v1","addr":"172.21.15.97:6807","nonce":1095319381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":1095319381},{"type":"v1","addr":"172.21.15.97:6805","nonce":1095319381}]},"public_addr":"172.21.15.97:6801/1095319381","cluster_addr":"172.21.15.97:6803/1095319381","heartbeat_back_addr":"172.21.15.97:6807/1095319381","heartbeat_front_addr":"172.21.15.97:6805/1095319381","state":["exists","up"]},{"osd":5,"uuid":"f0f876ef-0823-46e9-8fe4-9b7a64a94cee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":899031308},{"type":"v1","addr":"172.21.15.97:6817","nonce":899031308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":899031308},{"type":"v1","addr":"172.21.15.97:6819","nonce":899031308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":899031308},{"type":"v1","addr":"172.21.15.97:6823","nonce":899031308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":899031308},{"type":"v1","addr":"172.21.15.97:6821","nonce":899031308}]},"public_addr":"172.21.15.97:6817/899031308","cluster_addr":"172.21.15.97:6819/899031308","heartbeat_back_addr":"172.21.15.97:6823/899031308","heartbeat_front_addr":"172.21.15.97:6821/899031308","state":["exists","up"]},{"osd":6,"uuid":"d29a625e-83bf-40ef-a57e-618220b96b9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2224814961},{"type":"v1","addr":"172.21.15.97:6825","nonce":2224814961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2224814961},{"type":"v1","addr":"172.21.15.97:6827","nonce":2224814961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2224814961},{"type":"v1","addr":"172.21.15.97:6831","nonce":2224814961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2224814961},{"type":"v1","addr":"172.21.15.97:6829","nonce":2224814961}]},"public_addr":"172.21.15.97:6825/2224814961","cluster_addr":"172.21.15.97:6827/2224814961","heartbeat_back_addr":"172.21.15.97:6831/2224814961","heartbeat_front_addr":"172.21.15.97:6829/2224814961","state":["exists","up"]},{"osd":7,"uuid":"7bcfd8f1-7dc0-4013-af17-16da5a8d931d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":284968823},{"type":"v1","addr":"172.21.15.97:6809","nonce":284968823}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":284968823},{"type":"v1","addr":"172.21.15.97:6811","nonce":284968823}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6814","nonce":284968823},{"type":"v1","addr":"172.21.15.97:6815","nonce":284968823}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":284968823},{"type":"v1","addr":"172.21.15.97:6813","nonce":284968823}]},"public_addr":"172.21.15.97:6809/284968823","cluster_addr":"172.21.15.97:6811/284968823","heartbeat_back_addr":"172.21.15.97:6815/284968823","heartbeat_front_addr":"172.21.15.97:6813/284968823","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T01:55:39.369550+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T01:55:39.367285+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T01:55:39.458393+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T01:55:39.456179+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T01:55:39.463649+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T01:55:38.728924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T01:55:39.522411+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T01:55:39.432081+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-01T01:55:49.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.886+0000 7f512fbae640 1 -- 172.21.15.50:0/13415339 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f510c067420 msgr2=0x7f510c0698e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:49.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.886+0000 7f512fbae640 1 --2- 172.21.15.50:0/13415339 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f510c067420 0x7f510c0698e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f512814d6a0 tx=0x7f5118008040 comp rx=0 tx=0).stop 2024-04-01T01:55:49.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.886+0000 7f512fbae640 1 -- 172.21.15.50:0/13415339 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51280706d0 msgr2=0x7f512814e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:49.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.886+0000 7f512fbae640 1 --2- 172.21.15.50:0/13415339 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51280706d0 0x7f512814e270 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f512401cd80 tx=0x7f512401bef0 comp rx=0 tx=0).stop 2024-04-01T01:55:49.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.886+0000 7f512fbae640 1 -- 172.21.15.50:0/13415339 shutdown_connections 2024-04-01T01:55:49.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.886+0000 7f512fbae640 1 --2- 172.21.15.50:0/13415339 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f510c067420 0x7f510c0698e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:49.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.886+0000 7f512fbae640 1 --2- 172.21.15.50:0/13415339 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f512815b7f0 0x7f512814a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:49.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.886+0000 7f512fbae640 1 --2- 172.21.15.50:0/13415339 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5128151f50 0x7f512814e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:49.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.886+0000 7f512fbae640 1 --2- 172.21.15.50:0/13415339 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51280706d0 0x7f512814e270 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:49.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.886+0000 7f512fbae640 1 -- 172.21.15.50:0/13415339 >> 172.21.15.50:0/13415339 conn(0x7f512806b220 msgr2=0x7f5128159090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:55:49.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.886+0000 7f512fbae640 1 -- 172.21.15.50:0/13415339 shutdown_connections 2024-04-01T01:55:49.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:49.886+0000 7f512fbae640 1 -- 172.21.15.50:0/13415339 wait complete. 2024-04-01T01:55:49.906 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-01T01:55:50.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.026+0000 7f1d422f0640 1 Processor -- start 2024-04-01T01:55:50.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.026+0000 7f1d422f0640 1 -- start start 2024-04-01T01:55:50.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.026+0000 7f1d422f0640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1d3c0c1f10 0x7f1d3c0c79f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:50.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.026+0000 7f1d422f0640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f1d3c158150 0x7f1d3c1585a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:50.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.026+0000 7f1d422f0640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d3c158ae0 con 0x7f1d3c151e50 2024-04-01T01:55:50.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.026+0000 7f1d422f0640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f1d3c15b240 con 0x7f1d3c0c1f10 2024-04-01T01:55:50.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.026+0000 7f1d422f0640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f1d3c157c50 con 0x7f1d3c158150 2024-04-01T01:55:50.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.026+0000 7f1d3b7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1d3c0c1f10 0x7f1d3c0c79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:50.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.026+0000 7f1d3b7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1d3c0c1f10 0x7f1d3c0c79f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55332/0 (socket says 172.21.15.50:55332) 2024-04-01T01:55:50.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.026+0000 7f1d3b7fe640 1 -- 172.21.15.50:0/189668272 learned_addr learned my addr 172.21.15.50:0/189668272 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T01:55:50.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.026+0000 7f1d4088d640 1 --2- 172.21.15.50:0/189668272 >> v2:172.21.15.97:3300/0 conn(0x7f1d3c158150 0x7f1d3c1585a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:50.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.026+0000 7f1d3b7fe640 1 -- 172.21.15.50:0/189668272 >> v2:172.21.15.97:3300/0 conn(0x7f1d3c158150 msgr2=0x7f1d3c1585a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:55:50.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.026+0000 7f1d3b7fe640 1 --2- 172.21.15.50:0/189668272 >> v2:172.21.15.97:3300/0 conn(0x7f1d3c158150 0x7f1d3c1585a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:50.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.026+0000 7f1d3b7fe640 1 -- 172.21.15.50:0/189668272 >> v1:172.21.15.97:6789/0 conn(0x7f1d3c151e50 legacy=0x7f1d3c06ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:55:50.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.026+0000 7f1d3b7fe640 1 -- 172.21.15.50:0/189668272 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d3c15b490 con 0x7f1d3c0c1f10 2024-04-01T01:55:50.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.030+0000 7f1d3b7fe640 1 --2- 172.21.15.50:0/189668272 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d3c0c1f10 0x7f1d3c0c79f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c0c5ba0 tx=0x7f1d2401f1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2fdc6ef1a2a92e0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:50.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.030+0000 7f1d3affd640 1 -- 172.21.15.50:0/189668272 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d240b4070 con 0x7f1d3c0c1f10 2024-04-01T01:55:50.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.030+0000 7f1d3affd640 1 -- 172.21.15.50:0/189668272 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d240af400 con 0x7f1d3c0c1f10 2024-04-01T01:55:50.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.030+0000 7f1d3affd640 1 -- 172.21.15.50:0/189668272 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d240af7d0 con 0x7f1d3c0c1f10 2024-04-01T01:55:50.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.030+0000 7f1d422f0640 1 -- 172.21.15.50:0/189668272 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d3c0c1f10 msgr2=0x7f1d3c0c79f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:50.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.030+0000 7f1d422f0640 1 --2- 172.21.15.50:0/189668272 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d3c0c1f10 0x7f1d3c0c79f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c0c5ba0 tx=0x7f1d2401f1a0 comp rx=0 tx=0).stop 2024-04-01T01:55:50.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.030+0000 7f1d422f0640 1 -- 172.21.15.50:0/189668272 shutdown_connections 2024-04-01T01:55:50.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.030+0000 7f1d422f0640 1 --2- 172.21.15.50:0/189668272 >> v2:172.21.15.97:3300/0 conn(0x7f1d3c158150 0x7f1d3c1585a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:50.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.030+0000 7f1d422f0640 1 --2- 172.21.15.50:0/189668272 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d3c0c1f10 0x7f1d3c0c79f0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:50.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.030+0000 7f1d422f0640 1 -- 172.21.15.50:0/189668272 >> 172.21.15.50:0/189668272 conn(0x7f1d3c0676f0 msgr2=0x7f1d3c0c8010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:55:50.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.030+0000 7f1d422f0640 1 -- 172.21.15.50:0/189668272 shutdown_connections 2024-04-01T01:55:50.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.030+0000 7f1d422f0640 1 -- 172.21.15.50:0/189668272 wait complete. 2024-04-01T01:55:50.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.030+0000 7f1d422f0640 1 Processor -- start 2024-04-01T01:55:50.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.030+0000 7f1d422f0640 1 -- start start 2024-04-01T01:55:50.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.030+0000 7f1d422f0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d3c0c1f10 0x7f1d3c14a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:50.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.030+0000 7f1d422f0640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1d3c151e50 0x7f1d3c1f3950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:50.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.030+0000 7f1d422f0640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1d3c158150 0x7f1d3c1e6a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:50.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.030+0000 7f1d422f0640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f1d3c15bd30 con 0x7f1d3c0c1f10 2024-04-01T01:55:50.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.030+0000 7f1d422f0640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f1d3c15ba50 con 0x7f1d3c151e50 2024-04-01T01:55:50.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.030+0000 7f1d422f0640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f1d3c15c010 con 0x7f1d3c158150 2024-04-01T01:55:50.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.030+0000 7f1d3bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d3c0c1f10 0x7f1d3c14a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:50.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.030+0000 7f1d3bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d3c0c1f10 0x7f1d3c14a200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55348/0 (socket says 172.21.15.50:55348) 2024-04-01T01:55:50.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.030+0000 7f1d3bfff640 1 -- 172.21.15.50:0/469615976 learned_addr learned my addr 172.21.15.50:0/469615976 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T01:55:50.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.030+0000 7f1d3bfff640 1 -- 172.21.15.50:0/469615976 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1d3c158150 msgr2=0x7f1d3c1e6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:50.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.030+0000 7f1d3bfff640 1 --2- 172.21.15.50:0/469615976 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1d3c158150 0x7f1d3c1e6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:50.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.030+0000 7f1d3bfff640 1 -- 172.21.15.50:0/469615976 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1d3c151e50 msgr2=0x7f1d3c1f3950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:50.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.030+0000 7f1d3bfff640 1 --2- 172.21.15.50:0/469615976 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1d3c151e50 0x7f1d3c1f3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:50.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.030+0000 7f1d3bfff640 1 -- 172.21.15.50:0/469615976 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d3c0725c0 con 0x7f1d3c0c1f10 2024-04-01T01:55:50.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.034+0000 7f1d3bfff640 1 --2- 172.21.15.50:0/469615976 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d3c0c1f10 0x7f1d3c14a200 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c00c480 tx=0x7f1d2c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:50.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.034+0000 7f1d38ff9640 1 -- 172.21.15.50:0/469615976 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d2c012830 con 0x7f1d3c0c1f10 2024-04-01T01:55:50.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.034+0000 7f1d38ff9640 1 -- 172.21.15.50:0/469615976 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d2c017070 con 0x7f1d3c0c1f10 2024-04-01T01:55:50.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.034+0000 7f1d422f0640 1 -- 172.21.15.50:0/469615976 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d3c14a740 con 0x7f1d3c0c1f10 2024-04-01T01:55:50.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.034+0000 7f1d38ff9640 1 -- 172.21.15.50:0/469615976 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d2c012c30 con 0x7f1d3c0c1f10 2024-04-01T01:55:50.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.034+0000 7f1d422f0640 1 -- 172.21.15.50:0/469615976 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d3c072840 con 0x7f1d3c0c1f10 2024-04-01T01:55:50.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.034+0000 7f1d422f0640 1 -- 172.21.15.50:0/469615976 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d3c068230 con 0x7f1d3c0c1f10 2024-04-01T01:55:50.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.034+0000 7f1d38ff9640 1 -- 172.21.15.50:0/469615976 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 87103+0+0 (secure 0 0 0) 0x7f1d2c01c460 con 0x7f1d3c0c1f10 2024-04-01T01:55:50.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.034+0000 7f1d38ff9640 1 --2- 172.21.15.50:0/469615976 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f1d1c067420 0x7f1d1c0698e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:50.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.034+0000 7f1d38ff9640 1 -- 172.21.15.50:0/469615976 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f1d2c0855d0 con 0x7f1d3c0c1f10 2024-04-01T01:55:50.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.034+0000 7f1d3b7fe640 1 --2- 172.21.15.50:0/469615976 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f1d1c067420 0x7f1d1c0698e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:50.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.034+0000 7f1d3b7fe640 1 --2- 172.21.15.50:0/469615976 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f1d1c067420 0x7f1d1c0698e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1d240b1000 tx=0x7f1d24004ac0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:50.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.038+0000 7f1d38ff9640 1 -- 172.21.15.50:0/469615976 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+176632 (secure 0 0 0) 0x7f1d3c0725c0 con 0x7f1d3c0c1f10 2024-04-01T01:55:50.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.234+0000 7f1d422f0640 1 -- 172.21.15.50:0/469615976 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f1d3c1577f0 con 0x7f1d3c0c1f10 2024-04-01T01:55:50.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.250+0000 7f1d38ff9640 1 -- 172.21.15.50:0/469615976 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v5) ==== 118+0+0 (secure 0 0 0) 0x7f1d2c0562d0 con 0x7f1d3c0c1f10 2024-04-01T01:55:50.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.254+0000 7f1d422f0640 1 -- 172.21.15.50:0/469615976 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f1d1c067420 msgr2=0x7f1d1c0698e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:50.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.254+0000 7f1d422f0640 1 --2- 172.21.15.50:0/469615976 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f1d1c067420 0x7f1d1c0698e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1d240b1000 tx=0x7f1d24004ac0 comp rx=0 tx=0).stop 2024-04-01T01:55:50.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.254+0000 7f1d422f0640 1 -- 172.21.15.50:0/469615976 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d3c0c1f10 msgr2=0x7f1d3c14a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:50.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.254+0000 7f1d422f0640 1 --2- 172.21.15.50:0/469615976 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d3c0c1f10 0x7f1d3c14a200 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c00c480 tx=0x7f1d2c00c940 comp rx=0 tx=0).stop 2024-04-01T01:55:50.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.254+0000 7f1d422f0640 1 -- 172.21.15.50:0/469615976 shutdown_connections 2024-04-01T01:55:50.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.254+0000 7f1d422f0640 1 --2- 172.21.15.50:0/469615976 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f1d1c067420 0x7f1d1c0698e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:50.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.254+0000 7f1d422f0640 1 --2- 172.21.15.50:0/469615976 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1d3c158150 0x7f1d3c1e6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:50.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.254+0000 7f1d422f0640 1 --2- 172.21.15.50:0/469615976 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1d3c151e50 0x7f1d3c1f3950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:50.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.254+0000 7f1d422f0640 1 --2- 172.21.15.50:0/469615976 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d3c0c1f10 0x7f1d3c14a200 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:50.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.254+0000 7f1d422f0640 1 -- 172.21.15.50:0/469615976 >> 172.21.15.50:0/469615976 conn(0x7f1d3c0676f0 msgr2=0x7f1d3c06ee20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:55:50.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.254+0000 7f1d422f0640 1 -- 172.21.15.50:0/469615976 shutdown_connections 2024-04-01T01:55:50.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.254+0000 7f1d422f0640 1 -- 172.21.15.50:0/469615976 wait complete. 2024-04-01T01:55:50.271 DEBUG:tasks.cephfs.filesystem:fs_config: {'session_timeout': 300} 2024-04-01T01:55:50.271 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-01T01:55:50.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.390+0000 7f72acf09640 1 Processor -- start 2024-04-01T01:55:50.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.390+0000 7f72acf09640 1 -- start start 2024-04-01T01:55:50.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.390+0000 7f72acf09640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f72a81587a0 0x7f72a80c6d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:50.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.390+0000 7f72acf09640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72a8158bc0 con 0x7f72a8152050 2024-04-01T01:55:50.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.390+0000 7f72acf09640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72a8152430 con 0x7f72a80c72c0 2024-04-01T01:55:50.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.390+0000 7f72acf09640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f72a815b440 con 0x7f72a81587a0 2024-04-01T01:55:50.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.390+0000 7f72a659c640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f72a8152050 0x7f72a806f9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:47484/0 (socket says 172.21.15.50:47484) 2024-04-01T01:55:50.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.390+0000 7f72a659c640 1 -- 172.21.15.50:0/605548457 learned_addr learned my addr 172.21.15.50:0/605548457 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-04-01T01:55:50.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.390+0000 7f72a5d9b640 1 --2- 172.21.15.50:0/605548457 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f72a81587a0 0x7f72a80c6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:50.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.390+0000 7f72a559a640 1 -- 172.21.15.50:0/605548457 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 588017710 0 0) 0x7f72a8158bc0 con 0x7f72a8152050 2024-04-01T01:55:50.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.394+0000 7f72a559a640 1 -- 172.21.15.50:0/605548457 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7290003530 con 0x7f72a8152050 2024-04-01T01:55:50.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.394+0000 7f72a559a640 1 -- 172.21.15.50:0/605548457 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 821608382 0 0) 0x7f7290003530 con 0x7f72a8152050 2024-04-01T01:55:50.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.394+0000 7f72a559a640 1 -- 172.21.15.50:0/605548457 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f72a81587a0 msgr2=0x7f72a80c6d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:55:50.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.394+0000 7f72a559a640 1 --2- 172.21.15.50:0/605548457 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f72a81587a0 0x7f72a80c6d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:50.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.394+0000 7f72a559a640 1 -- 172.21.15.50:0/605548457 >> v1:172.21.15.97:6789/0 conn(0x7f72a80c72c0 legacy=0x7f72a815b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:50.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.394+0000 7f72a559a640 1 -- 172.21.15.50:0/605548457 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72a80c6710 con 0x7f72a8152050 2024-04-01T01:55:50.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.394+0000 7f72a559a640 1 -- 172.21.15.50:0/605548457 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2779672543 0 0) 0x7f7298001680 con 0x7f72a8152050 2024-04-01T01:55:50.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.394+0000 7f72a559a640 1 -- 172.21.15.50:0/605548457 >> v1:172.21.15.50:6789/0 conn(0x7f72a8152050 legacy=0x7f72a806f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:50.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.394+0000 7f72a559a640 1 --2- 172.21.15.50:0/605548457 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f72a81587a0 0x7f72900039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:50.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.394+0000 7f72a559a640 1 --2- 172.21.15.50:0/605548457 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7290003f30 0x7f7290004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:50.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.394+0000 7f72a559a640 1 --2- 172.21.15.50:0/605548457 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7290004d50 0x7f72900051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:50.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.394+0000 7f72a559a640 1 -- 172.21.15.50:0/605548457 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f72a815b440 con 0x7f7290004d50 2024-04-01T01:55:50.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.394+0000 7f72a559a640 1 -- 172.21.15.50:0/605548457 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f729000ba30 con 0x7f7290003f30 2024-04-01T01:55:50.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.394+0000 7f72a559a640 1 -- 172.21.15.50:0/605548457 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f729000bc30 con 0x7f72a81587a0 2024-04-01T01:55:50.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.394+0000 7f72a6d9d640 1 --2- 172.21.15.50:0/605548457 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7290004d50 0x7f72900051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:50.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.394+0000 7f72a659c640 1 --2- 172.21.15.50:0/605548457 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f72a81587a0 0x7f72900039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:50.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.394+0000 7f72a5d9b640 1 --2- 172.21.15.50:0/605548457 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7290003f30 0x7f7290004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:50.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.394+0000 7f72a6d9d640 1 -- 172.21.15.50:0/605548457 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f72a81587a0 msgr2=0x7f72900039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:55:50.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.394+0000 7f72a6d9d640 1 --2- 172.21.15.50:0/605548457 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f72a81587a0 0x7f72900039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:50.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.394+0000 7f72a6d9d640 1 -- 172.21.15.50:0/605548457 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7290003f30 msgr2=0x7f7290004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:55:50.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.394+0000 7f72a6d9d640 1 --2- 172.21.15.50:0/605548457 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7290003f30 0x7f7290004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:50.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.394+0000 7f72a6d9d640 1 -- 172.21.15.50:0/605548457 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7290003530 con 0x7f7290004d50 2024-04-01T01:55:50.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.394+0000 7f72a6d9d640 1 --2- 172.21.15.50:0/605548457 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7290004d50 0x7f72900051d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f72a0001f60 tx=0x7f72a001c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4f686e6d64da887 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:50.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.394+0000 7f72a559a640 1 -- 172.21.15.50:0/605548457 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72a00ac070 con 0x7f7290004d50 2024-04-01T01:55:50.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.394+0000 7f72a559a640 1 -- 172.21.15.50:0/605548457 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72a00a6670 con 0x7f7290004d50 2024-04-01T01:55:50.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.394+0000 7f72a559a640 1 -- 172.21.15.50:0/605548457 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72a0001b60 con 0x7f7290004d50 2024-04-01T01:55:50.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.394+0000 7f72acf09640 1 -- 172.21.15.50:0/605548457 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7290004d50 msgr2=0x7f72900051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:50.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.394+0000 7f72acf09640 1 --2- 172.21.15.50:0/605548457 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7290004d50 0x7f72900051d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f72a0001f60 tx=0x7f72a001c880 comp rx=0 tx=0).stop 2024-04-01T01:55:50.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.394+0000 7f72a6d9d640 1 -- 172.21.15.50:0/605548457 reap_dead start 2024-04-01T01:55:50.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.394+0000 7f72acf09640 1 -- 172.21.15.50:0/605548457 shutdown_connections 2024-04-01T01:55:50.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.394+0000 7f72acf09640 1 -- 172.21.15.50:0/605548457 >> 172.21.15.50:0/605548457 conn(0x7f72a80cc480 msgr2=0x7f72a80cc890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:55:50.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.394+0000 7f72acf09640 1 -- 172.21.15.50:0/605548457 shutdown_connections 2024-04-01T01:55:50.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.394+0000 7f72acf09640 1 -- 172.21.15.50:0/605548457 wait complete. 2024-04-01T01:55:50.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.398+0000 7f72acf09640 1 Processor -- start 2024-04-01T01:55:50.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.398+0000 7f72acf09640 1 -- start start 2024-04-01T01:55:50.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.398+0000 7f72acf09640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7290004d50 0x7f72a8157cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:50.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.398+0000 7f72acf09640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f72a80cb730 0x7f72a81ede70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:50.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.398+0000 7f72acf09640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72a81ee3b0 0x7f72a8140b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:50.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.398+0000 7f72acf09640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f72a80c5e70 con 0x7f72a81ee3b0 2024-04-01T01:55:50.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.398+0000 7f72acf09640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f72a80700e0 con 0x7f72a80cb730 2024-04-01T01:55:50.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.398+0000 7f72acf09640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f72a80c6150 con 0x7f7290004d50 2024-04-01T01:55:50.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.398+0000 7f72a6d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72a81ee3b0 0x7f72a8140b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:50.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.398+0000 7f72a6d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72a81ee3b0 0x7f72a8140b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55364/0 (socket says 172.21.15.50:55364) 2024-04-01T01:55:50.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.398+0000 7f72a6d9d640 1 -- 172.21.15.50:0/2578236451 learned_addr learned my addr 172.21.15.50:0/2578236451 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T01:55:50.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.398+0000 7f72a659c640 1 --2- 172.21.15.50:0/2578236451 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7290004d50 0x7f72a8157cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:50.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.398+0000 7f72a5d9b640 1 --2- 172.21.15.50:0/2578236451 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f72a80cb730 0x7f72a81ede70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:50.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.398+0000 7f72a6d9d640 1 -- 172.21.15.50:0/2578236451 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7290004d50 msgr2=0x7f72a8157cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:50.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.398+0000 7f72a6d9d640 1 --2- 172.21.15.50:0/2578236451 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7290004d50 0x7f72a8157cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:50.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.398+0000 7f72a6d9d640 1 -- 172.21.15.50:0/2578236451 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f72a80cb730 msgr2=0x7f72a81ede70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:50.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.398+0000 7f72a6d9d640 1 --2- 172.21.15.50:0/2578236451 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f72a80cb730 0x7f72a81ede70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:50.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.398+0000 7f72a6d9d640 1 -- 172.21.15.50:0/2578236451 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72a81e3080 con 0x7f72a81ee3b0 2024-04-01T01:55:50.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.398+0000 7f72a5d9b640 1 --2- 172.21.15.50:0/2578236451 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f72a80cb730 0x7f72a81ede70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T01:55:50.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.398+0000 7f72a6d9d640 1 --2- 172.21.15.50:0/2578236451 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72a81ee3b0 0x7f72a8140b90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f72a001cd60 tx=0x7f7290005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:50.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.398+0000 7f7296ffd640 1 -- 172.21.15.50:0/2578236451 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72a00ac070 con 0x7f72a81ee3b0 2024-04-01T01:55:50.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.398+0000 7f7296ffd640 1 -- 172.21.15.50:0/2578236451 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72a0001b40 con 0x7f72a81ee3b0 2024-04-01T01:55:50.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.398+0000 7f72acf09640 1 -- 172.21.15.50:0/2578236451 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72a8158230 con 0x7f72a81ee3b0 2024-04-01T01:55:50.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.398+0000 7f7296ffd640 1 -- 172.21.15.50:0/2578236451 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72a0005070 con 0x7f72a81ee3b0 2024-04-01T01:55:50.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.398+0000 7f72acf09640 1 -- 172.21.15.50:0/2578236451 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72a814e720 con 0x7f72a81ee3b0 2024-04-01T01:55:50.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.398+0000 7f72acf09640 1 -- 172.21.15.50:0/2578236451 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72a8068230 con 0x7f72a81ee3b0 2024-04-01T01:55:50.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.398+0000 7f7296ffd640 1 -- 172.21.15.50:0/2578236451 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 87103+0+0 (secure 0 0 0) 0x7f72a00af070 con 0x7f72a81ee3b0 2024-04-01T01:55:50.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.402+0000 7f7296ffd640 1 --2- 172.21.15.50:0/2578236451 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f7288067450 0x7f7288069910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:50.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.402+0000 7f7296ffd640 1 -- 172.21.15.50:0/2578236451 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f72a011f660 con 0x7f72a81ee3b0 2024-04-01T01:55:50.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.402+0000 7f72a659c640 1 --2- 172.21.15.50:0/2578236451 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f7288067450 0x7f7288069910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:50.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.402+0000 7f72a659c640 1 --2- 172.21.15.50:0/2578236451 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f7288067450 0x7f7288069910 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7298000c10 tx=0x7f7298009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:50.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.406+0000 7f7296ffd640 1 -- 172.21.15.50:0/2578236451 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+176632 (secure 0 0 0) 0x7f72a0016590 con 0x7f72a81ee3b0 2024-04-01T01:55:50.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:50.602+0000 7f72acf09640 1 -- 172.21.15.50:0/2578236451 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f72a8070290 con 0x7f72a81ee3b0 2024-04-01T01:55:51.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:51.266+0000 7f7296ffd640 1 -- 172.21.15.50:0/2578236451 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v6) ==== 122+0+0 (secure 0 0 0) 0x7f72a00f0360 con 0x7f72a81ee3b0 2024-04-01T01:55:51.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:51.270+0000 7f72acf09640 1 -- 172.21.15.50:0/2578236451 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f7288067450 msgr2=0x7f7288069910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:51.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:51.270+0000 7f72acf09640 1 --2- 172.21.15.50:0/2578236451 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f7288067450 0x7f7288069910 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7298000c10 tx=0x7f7298009040 comp rx=0 tx=0).stop 2024-04-01T01:55:51.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:51.270+0000 7f72acf09640 1 -- 172.21.15.50:0/2578236451 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72a81ee3b0 msgr2=0x7f72a8140b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:51.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:51.270+0000 7f72acf09640 1 --2- 172.21.15.50:0/2578236451 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72a81ee3b0 0x7f72a8140b90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f72a001cd60 tx=0x7f7290005840 comp rx=0 tx=0).stop 2024-04-01T01:55:51.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:51.270+0000 7f72acf09640 1 -- 172.21.15.50:0/2578236451 shutdown_connections 2024-04-01T01:55:51.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:51.270+0000 7f72acf09640 1 --2- 172.21.15.50:0/2578236451 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f7288067450 0x7f7288069910 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:51.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:51.270+0000 7f72acf09640 1 --2- 172.21.15.50:0/2578236451 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72a81ee3b0 0x7f72a8140b90 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:51.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:51.270+0000 7f72acf09640 1 --2- 172.21.15.50:0/2578236451 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f72a80cb730 0x7f72a81ede70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:51.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:51.270+0000 7f72acf09640 1 --2- 172.21.15.50:0/2578236451 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7290004d50 0x7f72a8157cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:51.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:51.270+0000 7f72acf09640 1 -- 172.21.15.50:0/2578236451 >> 172.21.15.50:0/2578236451 conn(0x7f72a80cc480 msgr2=0x7f72a8147220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:55:51.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:51.270+0000 7f72acf09640 1 -- 172.21.15.50:0/2578236451 shutdown_connections 2024-04-01T01:55:51.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:51.270+0000 7f72acf09640 1 -- 172.21.15.50:0/2578236451 wait complete. 2024-04-01T01:55:51.295 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2024-04-01T01:55:51.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:51.422+0000 7fe9664d9640 1 Processor -- start 2024-04-01T01:55:51.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:51.422+0000 7fe9664d9640 1 -- start start 2024-04-01T01:55:51.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:51.422+0000 7fe9664d9640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe9600c1f10 0x7fe9600c79f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:51.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:51.422+0000 7fe9664d9640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe960158150 0x7fe9601585c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:51.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:51.422+0000 7fe9664d9640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe960158b00 con 0x7fe960151e50 2024-04-01T01:55:51.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:51.422+0000 7fe9664d9640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fe96015b240 con 0x7fe960158150 2024-04-01T01:55:51.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:51.422+0000 7fe9664d9640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fe960157c50 con 0x7fe9600c1f10 2024-04-01T01:55:51.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:51.422+0000 7fe95ffff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fe960151e50 0x7fe96006ee40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:47490/0 (socket says 172.21.15.50:47490) 2024-04-01T01:55:51.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:51.422+0000 7fe95ffff640 1 -- 172.21.15.50:0/889516548 learned_addr learned my addr 172.21.15.50:0/889516548 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-04-01T01:55:51.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:51.422+0000 7fe964a76640 1 --2- 172.21.15.50:0/889516548 >> v2:172.21.15.97:3300/0 conn(0x7fe960158150 0x7fe9601585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:51.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:51.422+0000 7fe95f7fe640 1 --2- 172.21.15.50:0/889516548 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe9600c1f10 0x7fe9600c79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:51.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:51.422+0000 7fe95effd640 1 -- 172.21.15.50:0/889516548 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2726750544 0 0) 0x7fe960158b00 con 0x7fe960151e50 2024-04-01T01:55:51.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:51.422+0000 7fe95effd640 1 -- 172.21.15.50:0/889516548 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe948003530 con 0x7fe960151e50 2024-04-01T01:55:51.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:51.422+0000 7fe95effd640 1 -- 172.21.15.50:0/889516548 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2049405139 0 0) 0x7fe948003530 con 0x7fe960151e50 2024-04-01T01:55:51.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:51.422+0000 7fe95effd640 1 -- 172.21.15.50:0/889516548 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe9600c1f10 msgr2=0x7fe9600c79f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:55:51.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:51.422+0000 7fe95effd640 1 --2- 172.21.15.50:0/889516548 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe9600c1f10 0x7fe9600c79f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:51.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:51.422+0000 7fe95effd640 1 -- 172.21.15.50:0/889516548 >> v2:172.21.15.97:3300/0 conn(0x7fe960158150 msgr2=0x7fe9601585c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:55:51.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:51.422+0000 7fe95effd640 1 --2- 172.21.15.50:0/889516548 >> v2:172.21.15.97:3300/0 conn(0x7fe960158150 0x7fe9601585c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:51.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:51.422+0000 7fe95effd640 1 -- 172.21.15.50:0/889516548 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe96015b490 con 0x7fe960151e50 2024-04-01T01:55:51.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:51.422+0000 7fe95effd640 1 -- 172.21.15.50:0/889516548 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2779672543 0 0) 0x7fe954001680 con 0x7fe960151e50 2024-04-01T01:55:51.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:51.422+0000 7fe95effd640 1 -- 172.21.15.50:0/889516548 >> v1:172.21.15.50:6789/0 conn(0x7fe960151e50 legacy=0x7fe96006ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:51.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:51.422+0000 7fe95effd640 1 --2- 172.21.15.50:0/889516548 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe9480039c0 0x7fe948003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:51.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:51.422+0000 7fe95effd640 1 --2- 172.21.15.50:0/889516548 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe948004810 0x7fe948004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:51.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:51.422+0000 7fe95effd640 1 --2- 172.21.15.50:0/889516548 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe9600c1f10 0x7fe9480051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:51.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:51.422+0000 7fe95effd640 1 -- 172.21.15.50:0/889516548 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe96015b240 con 0x7fe948004810 2024-04-01T01:55:51.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:51.422+0000 7fe95effd640 1 -- 172.21.15.50:0/889516548 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fe960157c50 con 0x7fe9480039c0 2024-04-01T01:55:51.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:51.422+0000 7fe95effd640 1 -- 172.21.15.50:0/889516548 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fe94800b9d0 con 0x7fe9600c1f10 2024-04-01T01:55:51.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:51.422+0000 7fe95f7fe640 1 --2- 172.21.15.50:0/889516548 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe948004810 0x7fe948004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:51.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:51.422+0000 7fe964a76640 1 --2- 172.21.15.50:0/889516548 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe9600c1f10 0x7fe9480051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:51.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:51.422+0000 7fe95ffff640 1 --2- 172.21.15.50:0/889516548 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe9480039c0 0x7fe948003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:51.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:51.422+0000 7fe95f7fe640 1 -- 172.21.15.50:0/889516548 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe9600c1f10 msgr2=0x7fe9480051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:55:51.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:51.422+0000 7fe95f7fe640 1 --2- 172.21.15.50:0/889516548 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe9600c1f10 0x7fe9480051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:51.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:51.422+0000 7fe95f7fe640 1 -- 172.21.15.50:0/889516548 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe9480039c0 msgr2=0x7fe948003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:55:51.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:51.422+0000 7fe95f7fe640 1 --2- 172.21.15.50:0/889516548 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe9480039c0 0x7fe948003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:51.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:51.422+0000 7fe95f7fe640 1 -- 172.21.15.50:0/889516548 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe948003530 con 0x7fe948004810 2024-04-01T01:55:51.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:51.426+0000 7fe95f7fe640 1 --2- 172.21.15.50:0/889516548 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe948004810 0x7fe948004c90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe950009ae0 tx=0x7fe95001ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55f3f991313cf753 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:51.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:51.426+0000 7fe95effd640 1 -- 172.21.15.50:0/889516548 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9500b2070 con 0x7fe948004810 2024-04-01T01:55:51.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:51.426+0000 7fe95effd640 1 -- 172.21.15.50:0/889516548 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9500a5580 con 0x7fe948004810 2024-04-01T01:55:51.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:51.426+0000 7fe95effd640 1 -- 172.21.15.50:0/889516548 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9500096b0 con 0x7fe948004810 2024-04-01T01:55:51.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:51.426+0000 7fe9664d9640 1 -- 172.21.15.50:0/889516548 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe948004810 msgr2=0x7fe948004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:51.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:51.426+0000 7fe9664d9640 1 --2- 172.21.15.50:0/889516548 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe948004810 0x7fe948004c90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe950009ae0 tx=0x7fe95001ca70 comp rx=0 tx=0).stop 2024-04-01T01:55:51.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:51.426+0000 7fe964a76640 1 -- 172.21.15.50:0/889516548 reap_dead start 2024-04-01T01:55:51.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:51.426+0000 7fe9664d9640 1 -- 172.21.15.50:0/889516548 shutdown_connections 2024-04-01T01:55:51.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:51.426+0000 7fe9664d9640 1 -- 172.21.15.50:0/889516548 >> 172.21.15.50:0/889516548 conn(0x7fe9600676f0 msgr2=0x7fe9600c8010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:55:51.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:51.426+0000 7fe9664d9640 1 -- 172.21.15.50:0/889516548 shutdown_connections 2024-04-01T01:55:51.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:51.426+0000 7fe9664d9640 1 -- 172.21.15.50:0/889516548 wait complete. 2024-04-01T01:55:51.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:51.426+0000 7fe9664d9640 1 Processor -- start 2024-04-01T01:55:51.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:51.426+0000 7fe9664d9640 1 -- start start 2024-04-01T01:55:51.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:51.430+0000 7fe9664d9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe948004810 0x7fe96014b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:51.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:51.430+0000 7fe9664d9640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe96014c0f0 0x7fe960147550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:51.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:51.430+0000 7fe9664d9640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe960156ea0 0x7fe9601edb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:51.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:51.430+0000 7fe9664d9640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe96015bd30 con 0x7fe948004810 2024-04-01T01:55:51.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:51.430+0000 7fe9664d9640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fe96015ba50 con 0x7fe960156ea0 2024-04-01T01:55:51.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:51.430+0000 7fe9664d9640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fe96015c010 con 0x7fe96014c0f0 2024-04-01T01:55:51.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:51.430+0000 7fe95ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe948004810 0x7fe96014b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:51.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:51.430+0000 7fe95ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe948004810 0x7fe96014b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55392/0 (socket says 172.21.15.50:55392) 2024-04-01T01:55:51.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:51.430+0000 7fe95ffff640 1 -- 172.21.15.50:0/201323198 learned_addr learned my addr 172.21.15.50:0/201323198 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T01:55:51.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:51.430+0000 7fe95f7fe640 1 --2- 172.21.15.50:0/201323198 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe96014c0f0 0x7fe960147550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:51.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:51.430+0000 7fe964a76640 1 --2- 172.21.15.50:0/201323198 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe960156ea0 0x7fe9601edb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:51.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:51.430+0000 7fe95ffff640 1 -- 172.21.15.50:0/201323198 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe96014c0f0 msgr2=0x7fe960147550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:51.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:51.430+0000 7fe95ffff640 1 --2- 172.21.15.50:0/201323198 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe96014c0f0 0x7fe960147550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:51.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:51.430+0000 7fe95ffff640 1 -- 172.21.15.50:0/201323198 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe960156ea0 msgr2=0x7fe9601edb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:51.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:51.430+0000 7fe95ffff640 1 --2- 172.21.15.50:0/201323198 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe960156ea0 0x7fe9601edb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:51.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:51.430+0000 7fe95ffff640 1 -- 172.21.15.50:0/201323198 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9601ee620 con 0x7fe948004810 2024-04-01T01:55:51.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:51.430+0000 7fe95ffff640 1 --2- 172.21.15.50:0/201323198 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe948004810 0x7fe96014b420 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe95400e7d0 tx=0x7fe95400ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:51.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:51.430+0000 7fe95cff9640 1 -- 172.21.15.50:0/201323198 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe95400c870 con 0x7fe948004810 2024-04-01T01:55:51.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:51.430+0000 7fe95cff9640 1 -- 172.21.15.50:0/201323198 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe954018070 con 0x7fe948004810 2024-04-01T01:55:51.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:51.430+0000 7fe9664d9640 1 -- 172.21.15.50:0/201323198 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9601ee900 con 0x7fe948004810 2024-04-01T01:55:51.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:51.430+0000 7fe95cff9640 1 -- 172.21.15.50:0/201323198 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe95400cc30 con 0x7fe948004810 2024-04-01T01:55:51.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:51.430+0000 7fe9664d9640 1 -- 172.21.15.50:0/201323198 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe96014ac20 con 0x7fe948004810 2024-04-01T01:55:51.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:51.430+0000 7fe9664d9640 1 -- 172.21.15.50:0/201323198 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe960068230 con 0x7fe948004810 2024-04-01T01:55:51.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:51.430+0000 7fe95cff9640 1 -- 172.21.15.50:0/201323198 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 87103+0+0 (secure 0 0 0) 0x7fe95401d460 con 0x7fe948004810 2024-04-01T01:55:51.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:51.430+0000 7fe95cff9640 1 --2- 172.21.15.50:0/201323198 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fe94c067420 0x7fe94c0698e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:51.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:51.430+0000 7fe95cff9640 1 -- 172.21.15.50:0/201323198 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fe954085580 con 0x7fe948004810 2024-04-01T01:55:51.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:51.434+0000 7fe95f7fe640 1 --2- 172.21.15.50:0/201323198 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fe94c067420 0x7fe94c0698e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:51.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:51.434+0000 7fe95f7fe640 1 --2- 172.21.15.50:0/201323198 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fe94c067420 0x7fe94c0698e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe9500af000 tx=0x7fe9500046d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:51.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:51.438+0000 7fe95cff9640 1 -- 172.21.15.50:0/201323198 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+176632 (secure 0 0 0) 0x7fe954056290 con 0x7fe948004810 2024-04-01T01:55:51.606 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T01:55:51.609 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T01:55:51.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:51.626+0000 7fe9664d9640 1 -- 172.21.15.50:0/201323198 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7fe96015a370 con 0x7fe948004810 2024-04-01T01:55:52.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.270+0000 7fe95cff9640 1 -- 172.21.15.50:0/201323198 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v7) ==== 115+0+0 (secure 0 0 0) 0x7fe954055b90 con 0x7fe948004810 2024-04-01T01:55:52.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.274+0000 7fe9664d9640 1 -- 172.21.15.50:0/201323198 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fe94c067420 msgr2=0x7fe94c0698e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:52.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.274+0000 7fe9664d9640 1 --2- 172.21.15.50:0/201323198 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fe94c067420 0x7fe94c0698e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe9500af000 tx=0x7fe9500046d0 comp rx=0 tx=0).stop 2024-04-01T01:55:52.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.274+0000 7fe9664d9640 1 -- 172.21.15.50:0/201323198 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe948004810 msgr2=0x7fe96014b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:52.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.274+0000 7fe9664d9640 1 --2- 172.21.15.50:0/201323198 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe948004810 0x7fe96014b420 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe95400e7d0 tx=0x7fe95400ec90 comp rx=0 tx=0).stop 2024-04-01T01:55:52.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.274+0000 7fe9664d9640 1 -- 172.21.15.50:0/201323198 shutdown_connections 2024-04-01T01:55:52.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.274+0000 7fe9664d9640 1 --2- 172.21.15.50:0/201323198 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fe94c067420 0x7fe94c0698e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:52.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.274+0000 7fe9664d9640 1 --2- 172.21.15.50:0/201323198 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe960156ea0 0x7fe9601edb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:52.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.274+0000 7fe9664d9640 1 --2- 172.21.15.50:0/201323198 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe96014c0f0 0x7fe960147550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:52.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.274+0000 7fe9664d9640 1 --2- 172.21.15.50:0/201323198 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe948004810 0x7fe96014b420 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:52.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.274+0000 7fe9664d9640 1 -- 172.21.15.50:0/201323198 >> 172.21.15.50:0/201323198 conn(0x7fe9600676f0 msgr2=0x7fe9600c6380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:55:52.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.274+0000 7fe9664d9640 1 -- 172.21.15.50:0/201323198 shutdown_connections 2024-04-01T01:55:52.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.274+0000 7fe9664d9640 1 -- 172.21.15.50:0/201323198 wait complete. 2024-04-01T01:55:52.294 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-01T01:55:52.295 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-01T01:55:52.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.418+0000 7fbcb1526640 1 Processor -- start 2024-04-01T01:55:52.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.418+0000 7fbcb1526640 1 -- start start 2024-04-01T01:55:52.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.422+0000 7fbcb1526640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbcac072380 0x7fbcac158670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:52.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.422+0000 7fbcb1526640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fbcac0c6ca0 0x7fbcac0c7150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:52.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.422+0000 7fbcb1526640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcac0c9d80 con 0x7fbcac151f40 2024-04-01T01:55:52.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.422+0000 7fbcb1526640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fbcac15b3d0 con 0x7fbcac0c6ca0 2024-04-01T01:55:52.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.422+0000 7fbcb1526640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fbcac0c5b50 con 0x7fbcac072380 2024-04-01T01:55:52.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.422+0000 7fbcaa7fc640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbcac072380 0x7fbcac158670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:52.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.422+0000 7fbcaa7fc640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbcac072380 0x7fbcac158670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.50:60882/0 (socket says 172.21.15.50:60882) 2024-04-01T01:55:52.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.422+0000 7fbcaa7fc640 1 -- 172.21.15.50:0/3641082259 learned_addr learned my addr 172.21.15.50:0/3641082259 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T01:55:52.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.422+0000 7fbcab7fe640 1 --2- 172.21.15.50:0/3641082259 >> v2:172.21.15.97:3300/0 conn(0x7fbcac0c6ca0 0x7fbcac0c7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:52.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.422+0000 7fbcaa7fc640 1 -- 172.21.15.50:0/3641082259 >> v2:172.21.15.97:3300/0 conn(0x7fbcac0c6ca0 msgr2=0x7fbcac0c7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:55:52.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.422+0000 7fbcaa7fc640 1 --2- 172.21.15.50:0/3641082259 >> v2:172.21.15.97:3300/0 conn(0x7fbcac0c6ca0 0x7fbcac0c7150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:52.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.422+0000 7fbcaa7fc640 1 -- 172.21.15.50:0/3641082259 >> v1:172.21.15.97:6789/0 conn(0x7fbcac151f40 legacy=0x7fbcac15b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:52.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.422+0000 7fbcaa7fc640 1 -- 172.21.15.50:0/3641082259 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcac0c5e30 con 0x7fbcac072380 2024-04-01T01:55:52.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.422+0000 7fbcaa7fc640 1 --2- 172.21.15.50:0/3641082259 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbcac072380 0x7fbcac158670 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fbca0009870 tx=0x7fbca001ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=123270831227e32f server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:52.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.426+0000 7fbca9ffb640 1 -- 172.21.15.50:0/3641082259 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbca00b5070 con 0x7fbcac072380 2024-04-01T01:55:52.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.426+0000 7fbca9ffb640 1 -- 172.21.15.50:0/3641082259 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbca00a8a50 con 0x7fbcac072380 2024-04-01T01:55:52.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.426+0000 7fbca9ffb640 1 -- 172.21.15.50:0/3641082259 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbca00a8e20 con 0x7fbcac072380 2024-04-01T01:55:52.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.426+0000 7fbcb1526640 1 -- 172.21.15.50:0/3641082259 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbcac072380 msgr2=0x7fbcac158670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:52.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.426+0000 7fbcb1526640 1 --2- 172.21.15.50:0/3641082259 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbcac072380 0x7fbcac158670 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fbca0009870 tx=0x7fbca001ed50 comp rx=0 tx=0).stop 2024-04-01T01:55:52.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.426+0000 7fbcb1526640 1 -- 172.21.15.50:0/3641082259 shutdown_connections 2024-04-01T01:55:52.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.426+0000 7fbcb1526640 1 --2- 172.21.15.50:0/3641082259 >> v2:172.21.15.97:3300/0 conn(0x7fbcac0c6ca0 0x7fbcac0c7150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:52.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.426+0000 7fbcb1526640 1 --2- 172.21.15.50:0/3641082259 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbcac072380 0x7fbcac158670 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:52.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.426+0000 7fbcb1526640 1 -- 172.21.15.50:0/3641082259 >> 172.21.15.50:0/3641082259 conn(0x7fbcac0c8ea0 msgr2=0x7fbcac0c92b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:55:52.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.426+0000 7fbcb1526640 1 -- 172.21.15.50:0/3641082259 shutdown_connections 2024-04-01T01:55:52.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.426+0000 7fbcb1526640 1 -- 172.21.15.50:0/3641082259 wait complete. 2024-04-01T01:55:52.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.426+0000 7fbcb1526640 1 Processor -- start 2024-04-01T01:55:52.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.426+0000 7fbcb1526640 1 -- start start 2024-04-01T01:55:52.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.426+0000 7fbcb1526640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbcac072380 0x7fbcac154e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:52.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.426+0000 7fbcb1526640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbcac0c6ca0 0x7fbcac147930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:52.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.426+0000 7fbcb1526640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbcac151f40 0x7fbcac0cb240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:52.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.426+0000 7fbcb1526640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbcac152320 con 0x7fbcac0c6ca0 2024-04-01T01:55:52.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.426+0000 7fbcb1526640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fbcac0c63f0 con 0x7fbcac072380 2024-04-01T01:55:52.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.426+0000 7fbcb1526640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fbcac15bf70 con 0x7fbcac151f40 2024-04-01T01:55:52.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.426+0000 7fbcaa7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbcac0c6ca0 0x7fbcac147930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:52.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.426+0000 7fbcaa7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbcac0c6ca0 0x7fbcac147930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55396/0 (socket says 172.21.15.50:55396) 2024-04-01T01:55:52.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.426+0000 7fbcaa7fc640 1 -- 172.21.15.50:0/249611883 learned_addr learned my addr 172.21.15.50:0/249611883 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T01:55:52.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.430+0000 7fbcaaffd640 1 --2- 172.21.15.50:0/249611883 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbcac072380 0x7fbcac154e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:52.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.430+0000 7fbcab7fe640 1 --2- 172.21.15.50:0/249611883 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbcac151f40 0x7fbcac0cb240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:52.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.430+0000 7fbcaa7fc640 1 -- 172.21.15.50:0/249611883 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbcac151f40 msgr2=0x7fbcac0cb240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:52.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.430+0000 7fbcaa7fc640 1 --2- 172.21.15.50:0/249611883 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbcac151f40 0x7fbcac0cb240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:52.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.430+0000 7fbcaa7fc640 1 -- 172.21.15.50:0/249611883 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbcac072380 msgr2=0x7fbcac154e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:52.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.430+0000 7fbcaa7fc640 1 --2- 172.21.15.50:0/249611883 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbcac072380 0x7fbcac154e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:52.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.430+0000 7fbcaa7fc640 1 -- 172.21.15.50:0/249611883 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcac070ce0 con 0x7fbcac0c6ca0 2024-04-01T01:55:52.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.430+0000 7fbcaa7fc640 1 --2- 172.21.15.50:0/249611883 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbcac0c6ca0 0x7fbcac147930 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbca00b3040 tx=0x7fbca001baf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:52.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.430+0000 7fbc937fe640 1 -- 172.21.15.50:0/249611883 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbca00b5070 con 0x7fbcac0c6ca0 2024-04-01T01:55:52.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.430+0000 7fbc937fe640 1 -- 172.21.15.50:0/249611883 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbca00b0de0 con 0x7fbcac0c6ca0 2024-04-01T01:55:52.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.430+0000 7fbcb1526640 1 -- 172.21.15.50:0/249611883 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcac15afb0 con 0x7fbcac0c6ca0 2024-04-01T01:55:52.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.430+0000 7fbc937fe640 1 -- 172.21.15.50:0/249611883 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbca00bb670 con 0x7fbcac0c6ca0 2024-04-01T01:55:52.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.430+0000 7fbcb1526640 1 -- 172.21.15.50:0/249611883 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcac15acd0 con 0x7fbcac0c6ca0 2024-04-01T01:55:52.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.430+0000 7fbcb1526640 1 -- 172.21.15.50:0/249611883 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcac068940 con 0x7fbcac0c6ca0 2024-04-01T01:55:52.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.430+0000 7fbc937fe640 1 -- 172.21.15.50:0/249611883 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 87103+0+0 (secure 0 0 0) 0x7fbca00c2060 con 0x7fbcac0c6ca0 2024-04-01T01:55:52.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.430+0000 7fbc937fe640 1 --2- 172.21.15.50:0/249611883 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fbc98067420 0x7fbc980698e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:52.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.430+0000 7fbc937fe640 1 -- 172.21.15.50:0/249611883 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fbca0122ef0 con 0x7fbcac0c6ca0 2024-04-01T01:55:52.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.430+0000 7fbcaaffd640 1 --2- 172.21.15.50:0/249611883 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fbc98067420 0x7fbc980698e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:52.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.434+0000 7fbcaaffd640 1 --2- 172.21.15.50:0/249611883 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fbc98067420 0x7fbc980698e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fbcac073620 tx=0x7fbc9c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:52.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.434+0000 7fbc937fe640 1 -- 172.21.15.50:0/249611883 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+176632 (secure 0 0 0) 0x7fbca00188b0 con 0x7fbcac0c6ca0 2024-04-01T01:55:52.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.622+0000 7fbcb1526640 1 -- 172.21.15.50:0/249611883 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbcac155f60 con 0x7fbcac0c6ca0 2024-04-01T01:55:52.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.626+0000 7fbc937fe640 1 -- 172.21.15.50:0/249611883 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+6815 (secure 0 0 0) 0x7fbca00f3e00 con 0x7fbcac0c6ca0 2024-04-01T01:55:52.627 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-01T01:55:52.627 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6839/3495253895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6837","nonce":3495253895},{"type":"v1","addr":"172.21.15.97:6839","nonce":3495253895}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6838/1055159165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":1055159165},{"type":"v1","addr":"172.21.15.97:6838","nonce":1055159165}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4251,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/716162893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":716162893},{"type":"v1","addr":"172.21.15.50:6833","nonce":716162893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6836/194873808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":194873808},{"type":"v1","addr":"172.21.15.50:6836","nonce":194873808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4264,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/2250920298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6835","nonce":2250920298},{"type":"v1","addr":"172.21.15.50:6837","nonce":2250920298}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-01T01:55:48.563827+0000","modified":"2024-04-01T01:55:51.631137+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.97:6835/974386562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":974386562},{"type":"v1","addr":"172.21.15.97:6835","nonce":974386562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4279]},"id":1}]} 2024-04-01T01:55:52.627 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 7 2024-04-01T01:55:52.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.626+0000 7fbcb1526640 1 -- 172.21.15.50:0/249611883 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fbc98067420 msgr2=0x7fbc980698e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:52.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.626+0000 7fbcb1526640 1 --2- 172.21.15.50:0/249611883 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fbc98067420 0x7fbc980698e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fbcac073620 tx=0x7fbc9c009040 comp rx=0 tx=0).stop 2024-04-01T01:55:52.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.626+0000 7fbcb1526640 1 -- 172.21.15.50:0/249611883 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbcac0c6ca0 msgr2=0x7fbcac147930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:52.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.626+0000 7fbcb1526640 1 --2- 172.21.15.50:0/249611883 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbcac0c6ca0 0x7fbcac147930 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbca00b3040 tx=0x7fbca001baf0 comp rx=0 tx=0).stop 2024-04-01T01:55:52.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.626+0000 7fbcb1526640 1 -- 172.21.15.50:0/249611883 shutdown_connections 2024-04-01T01:55:52.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.626+0000 7fbcb1526640 1 --2- 172.21.15.50:0/249611883 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fbc98067420 0x7fbc980698e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:52.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.626+0000 7fbcb1526640 1 --2- 172.21.15.50:0/249611883 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbcac151f40 0x7fbcac0cb240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:52.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.626+0000 7fbcb1526640 1 --2- 172.21.15.50:0/249611883 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbcac0c6ca0 0x7fbcac147930 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:52.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.626+0000 7fbcb1526640 1 --2- 172.21.15.50:0/249611883 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbcac072380 0x7fbcac154e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:52.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.626+0000 7fbcb1526640 1 -- 172.21.15.50:0/249611883 >> 172.21.15.50:0/249611883 conn(0x7fbcac0c8ea0 msgr2=0x7fbcac14f770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:55:52.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.626+0000 7fbcb1526640 1 -- 172.21.15.50:0/249611883 shutdown_connections 2024-04-01T01:55:52.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.626+0000 7fbcb1526640 1 -- 172.21.15.50:0/249611883 wait complete. 2024-04-01T01:55:52.645 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-01T01:55:52.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.766+0000 7fb9558bc640 1 Processor -- start 2024-04-01T01:55:52.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.766+0000 7fb9558bc640 1 -- start start 2024-04-01T01:55:52.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.770+0000 7fb9558bc640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fb950150e60 0x7fb950072f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:52.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.770+0000 7fb9558bc640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb950073470 con 0x7fb9500c77c0 2024-04-01T01:55:52.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.770+0000 7fb9558bc640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb950156a20 con 0x7fb9500c73a0 2024-04-01T01:55:52.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.770+0000 7fb9558bc640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fb9501578f0 con 0x7fb950150e60 2024-04-01T01:55:52.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.770+0000 7fb94f7fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fb9500c77c0 0x7fb95015a2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:47498/0 (socket says 172.21.15.50:47498) 2024-04-01T01:55:52.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.770+0000 7fb94f7fe640 1 -- 172.21.15.50:0/427685524 learned_addr learned my addr 172.21.15.50:0/427685524 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-04-01T01:55:52.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.770+0000 7fb94effd640 1 --2- 172.21.15.50:0/427685524 >> v2:172.21.15.97:3300/0 conn(0x7fb950150e60 0x7fb950072f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:52.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.770+0000 7fb94dffb640 1 -- 172.21.15.50:0/427685524 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3678665866 0 0) 0x7fb950073470 con 0x7fb9500c77c0 2024-04-01T01:55:52.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.770+0000 7fb94dffb640 1 -- 172.21.15.50:0/427685524 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb938003530 con 0x7fb9500c77c0 2024-04-01T01:55:52.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.770+0000 7fb94dffb640 1 -- 172.21.15.50:0/427685524 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1114851871 0 0) 0x7fb938003530 con 0x7fb9500c77c0 2024-04-01T01:55:52.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.770+0000 7fb94dffb640 1 -- 172.21.15.50:0/427685524 >> v2:172.21.15.97:3300/0 conn(0x7fb950150e60 msgr2=0x7fb950072f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:55:52.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.770+0000 7fb94dffb640 1 --2- 172.21.15.50:0/427685524 >> v2:172.21.15.97:3300/0 conn(0x7fb950150e60 0x7fb950072f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:52.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.770+0000 7fb94dffb640 1 -- 172.21.15.50:0/427685524 >> v1:172.21.15.97:6789/0 conn(0x7fb9500c73a0 legacy=0x7fb9500c2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:52.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.770+0000 7fb94dffb640 1 -- 172.21.15.50:0/427685524 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb950156ce0 con 0x7fb9500c77c0 2024-04-01T01:55:52.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.770+0000 7fb94dffb640 1 -- 172.21.15.50:0/427685524 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2779672543 0 0) 0x7fb948001a00 con 0x7fb9500c77c0 2024-04-01T01:55:52.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.770+0000 7fb94dffb640 1 -- 172.21.15.50:0/427685524 >> v1:172.21.15.50:6789/0 conn(0x7fb9500c77c0 legacy=0x7fb95015a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:52.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.770+0000 7fb94dffb640 1 --2- 172.21.15.50:0/427685524 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb9380039c0 0x7fb938003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:52.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.770+0000 7fb94dffb640 1 --2- 172.21.15.50:0/427685524 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb938004810 0x7fb938004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:52.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.770+0000 7fb94dffb640 1 --2- 172.21.15.50:0/427685524 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb9380051d0 0x7fb93800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:52.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.770+0000 7fb94dffb640 1 -- 172.21.15.50:0/427685524 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb9501578f0 con 0x7fb938004810 2024-04-01T01:55:52.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.770+0000 7fb94dffb640 1 -- 172.21.15.50:0/427685524 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fb93800c080 con 0x7fb9380051d0 2024-04-01T01:55:52.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.770+0000 7fb94dffb640 1 -- 172.21.15.50:0/427685524 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fb93800c280 con 0x7fb9380039c0 2024-04-01T01:55:52.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.770+0000 7fb94e7fc640 1 --2- 172.21.15.50:0/427685524 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb938004810 0x7fb938004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:52.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.770+0000 7fb94effd640 1 --2- 172.21.15.50:0/427685524 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb9380039c0 0x7fb938003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:52.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.770+0000 7fb94f7fe640 1 --2- 172.21.15.50:0/427685524 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb9380051d0 0x7fb93800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:52.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.770+0000 7fb94e7fc640 1 -- 172.21.15.50:0/427685524 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb9380039c0 msgr2=0x7fb938003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:55:52.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.770+0000 7fb94e7fc640 1 --2- 172.21.15.50:0/427685524 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb9380039c0 0x7fb938003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:52.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.770+0000 7fb94e7fc640 1 -- 172.21.15.50:0/427685524 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb9380051d0 msgr2=0x7fb93800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:55:52.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.770+0000 7fb94e7fc640 1 --2- 172.21.15.50:0/427685524 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb9380051d0 0x7fb93800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:52.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.770+0000 7fb94e7fc640 1 -- 172.21.15.50:0/427685524 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb938003530 con 0x7fb938004810 2024-04-01T01:55:52.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.770+0000 7fb94f7fe640 1 -- 172.21.15.50:0/427685524 reap_dead start 2024-04-01T01:55:52.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.774+0000 7fb94e7fc640 1 --2- 172.21.15.50:0/427685524 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb938004810 0x7fb938004c90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb944001780 tx=0x7fb94401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2e57f60a688feae server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:52.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.774+0000 7fb94dffb640 1 -- 172.21.15.50:0/427685524 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9440013a0 con 0x7fb938004810 2024-04-01T01:55:52.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.774+0000 7fb94dffb640 1 -- 172.21.15.50:0/427685524 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9440052f0 con 0x7fb938004810 2024-04-01T01:55:52.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.774+0000 7fb94dffb640 1 -- 172.21.15.50:0/427685524 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb944003840 con 0x7fb938004810 2024-04-01T01:55:52.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.774+0000 7fb9558bc640 1 -- 172.21.15.50:0/427685524 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb938004810 msgr2=0x7fb938004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:52.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.774+0000 7fb9558bc640 1 --2- 172.21.15.50:0/427685524 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb938004810 0x7fb938004c90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb944001780 tx=0x7fb94401c400 comp rx=0 tx=0).stop 2024-04-01T01:55:52.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.774+0000 7fb9558bc640 1 -- 172.21.15.50:0/427685524 shutdown_connections 2024-04-01T01:55:52.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.774+0000 7fb9558bc640 1 --2- 172.21.15.50:0/427685524 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb938004810 0x7fb938004c90 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:52.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.774+0000 7fb9558bc640 1 -- 172.21.15.50:0/427685524 >> 172.21.15.50:0/427685524 conn(0x7fb950067560 msgr2=0x7fb95006b220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:55:52.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.774+0000 7fb9558bc640 1 -- 172.21.15.50:0/427685524 shutdown_connections 2024-04-01T01:55:52.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.774+0000 7fb9558bc640 1 -- 172.21.15.50:0/427685524 wait complete. 2024-04-01T01:55:52.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.774+0000 7fb9558bc640 1 Processor -- start 2024-04-01T01:55:52.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.774+0000 7fb9558bc640 1 -- start start 2024-04-01T01:55:52.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.774+0000 7fb9558bc640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb938004810 0x7fb950071730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:52.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.774+0000 7fb9558bc640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb95014cfb0 0x7fb9501ed960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:52.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.774+0000 7fb9558bc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9501edea0 0x7fb950144ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:52.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.774+0000 7fb9558bc640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb950157580 con 0x7fb9501edea0 2024-04-01T01:55:52.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.774+0000 7fb9558bc640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fb9501572a0 con 0x7fb938004810 2024-04-01T01:55:52.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.774+0000 7fb9558bc640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fb950072f30 con 0x7fb95014cfb0 2024-04-01T01:55:52.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.774+0000 7fb94f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9501edea0 0x7fb950144ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:52.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.774+0000 7fb94f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9501edea0 0x7fb950144ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55412/0 (socket says 172.21.15.50:55412) 2024-04-01T01:55:52.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.774+0000 7fb94f7fe640 1 -- 172.21.15.50:0/3016283158 learned_addr learned my addr 172.21.15.50:0/3016283158 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T01:55:52.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.774+0000 7fb94e7fc640 1 --2- 172.21.15.50:0/3016283158 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb95014cfb0 0x7fb9501ed960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:52.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.774+0000 7fb94effd640 1 --2- 172.21.15.50:0/3016283158 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb938004810 0x7fb950071730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:52.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.774+0000 7fb94f7fe640 1 -- 172.21.15.50:0/3016283158 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb95014cfb0 msgr2=0x7fb9501ed960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:52.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.774+0000 7fb94f7fe640 1 --2- 172.21.15.50:0/3016283158 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb95014cfb0 0x7fb9501ed960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:52.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.774+0000 7fb94f7fe640 1 -- 172.21.15.50:0/3016283158 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb938004810 msgr2=0x7fb950071730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:52.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.774+0000 7fb94f7fe640 1 --2- 172.21.15.50:0/3016283158 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb938004810 0x7fb950071730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:52.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.774+0000 7fb94f7fe640 1 -- 172.21.15.50:0/3016283158 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb950151310 con 0x7fb9501edea0 2024-04-01T01:55:52.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.774+0000 7fb94f7fe640 1 --2- 172.21.15.50:0/3016283158 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9501edea0 0x7fb950144ad0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb95015b0a0 tx=0x7fb948007bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:52.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.774+0000 7fb937fff640 1 -- 172.21.15.50:0/3016283158 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb94800e9c0 con 0x7fb9501edea0 2024-04-01T01:55:52.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.778+0000 7fb937fff640 1 -- 172.21.15.50:0/3016283158 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb948018070 con 0x7fb9501edea0 2024-04-01T01:55:52.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.778+0000 7fb9558bc640 1 -- 172.21.15.50:0/3016283158 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9501f1dc0 con 0x7fb9501edea0 2024-04-01T01:55:52.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.778+0000 7fb937fff640 1 -- 172.21.15.50:0/3016283158 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb94800edc0 con 0x7fb9501edea0 2024-04-01T01:55:52.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.778+0000 7fb9558bc640 1 -- 172.21.15.50:0/3016283158 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9501f1000 con 0x7fb9501edea0 2024-04-01T01:55:52.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.778+0000 7fb9558bc640 1 -- 172.21.15.50:0/3016283158 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb950068230 con 0x7fb9501edea0 2024-04-01T01:55:52.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.778+0000 7fb937fff640 1 -- 172.21.15.50:0/3016283158 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 87103+0+0 (secure 0 0 0) 0x7fb94801d460 con 0x7fb9501edea0 2024-04-01T01:55:52.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.778+0000 7fb937fff640 1 --2- 172.21.15.50:0/3016283158 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fb93c067450 0x7fb93c069910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:52.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.778+0000 7fb937fff640 1 -- 172.21.15.50:0/3016283158 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fb9480858a0 con 0x7fb9501edea0 2024-04-01T01:55:52.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.778+0000 7fb94effd640 1 --2- 172.21.15.50:0/3016283158 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fb93c067450 0x7fb93c069910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:52.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.778+0000 7fb94effd640 1 --2- 172.21.15.50:0/3016283158 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fb93c067450 0x7fb93c069910 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb940009ab0 tx=0x7fb940008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:52.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.782+0000 7fb937fff640 1 -- 172.21.15.50:0/3016283158 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+176632 (secure 0 0 0) 0x7fb948056640 con 0x7fb9501edea0 2024-04-01T01:55:52.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.946+0000 7fb9558bc640 1 -- 172.21.15.50:0/3016283158 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb9500712b0 con 0x7fb9501edea0 2024-04-01T01:55:52.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.946+0000 7fb937fff640 1 -- 172.21.15.50:0/3016283158 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16525 (secure 0 0 0) 0x7fb948055f40 con 0x7fb9501edea0 2024-04-01T01:55:52.950 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-01T01:55:52.950 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":21,"fsid":"f67878a9-bc75-426b-962d-fa7bc2517f7d","created":"2024-04-01T01:55:31.562371+0000","modified":"2024-04-01T01:55:50.217570+0000","last_up_change":"2024-04-01T01:55:42.134502+0000","last_in_change":"2024-04-01T01:55:33.849789+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-01T01:55:42.134418+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-01T01:55:47.009880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-01T01:55:47.551516+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"81e8ca4f-bde8-419a-875f-73a1f4a641ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":4170468134},{"type":"v1","addr":"172.21.15.50:6825","nonce":4170468134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":4170468134},{"type":"v1","addr":"172.21.15.50:6827","nonce":4170468134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":4170468134},{"type":"v1","addr":"172.21.15.50:6831","nonce":4170468134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":4170468134},{"type":"v1","addr":"172.21.15.50:6829","nonce":4170468134}]},"public_addr":"172.21.15.50:6825/4170468134","cluster_addr":"172.21.15.50:6827/4170468134","heartbeat_back_addr":"172.21.15.50:6831/4170468134","heartbeat_front_addr":"172.21.15.50:6829/4170468134","state":["exists","up"]},{"osd":1,"uuid":"bd060ca0-7559-4d30-987c-62e59818431d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1794491326},{"type":"v1","addr":"172.21.15.50:6809","nonce":1794491326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1794491326},{"type":"v1","addr":"172.21.15.50:6811","nonce":1794491326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1794491326},{"type":"v1","addr":"172.21.15.50:6815","nonce":1794491326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1794491326},{"type":"v1","addr":"172.21.15.50:6813","nonce":1794491326}]},"public_addr":"172.21.15.50:6809/1794491326","cluster_addr":"172.21.15.50:6811/1794491326","heartbeat_back_addr":"172.21.15.50:6815/1794491326","heartbeat_front_addr":"172.21.15.50:6813/1794491326","state":["exists","up"]},{"osd":2,"uuid":"eac5d816-a281-4acd-aa7d-b96a8e0aa962","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":710247177},{"type":"v1","addr":"172.21.15.50:6801","nonce":710247177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":710247177},{"type":"v1","addr":"172.21.15.50:6803","nonce":710247177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":710247177},{"type":"v1","addr":"172.21.15.50:6807","nonce":710247177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":710247177},{"type":"v1","addr":"172.21.15.50:6805","nonce":710247177}]},"public_addr":"172.21.15.50:6801/710247177","cluster_addr":"172.21.15.50:6803/710247177","heartbeat_back_addr":"172.21.15.50:6807/710247177","heartbeat_front_addr":"172.21.15.50:6805/710247177","state":["exists","up"]},{"osd":3,"uuid":"12b23968-04a7-40b8-98c4-02b16ae28265","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":871680805},{"type":"v1","addr":"172.21.15.50:6817","nonce":871680805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":871680805},{"type":"v1","addr":"172.21.15.50:6819","nonce":871680805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":871680805},{"type":"v1","addr":"172.21.15.50:6823","nonce":871680805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":871680805},{"type":"v1","addr":"172.21.15.50:6821","nonce":871680805}]},"public_addr":"172.21.15.50:6817/871680805","cluster_addr":"172.21.15.50:6819/871680805","heartbeat_back_addr":"172.21.15.50:6823/871680805","heartbeat_front_addr":"172.21.15.50:6821/871680805","state":["exists","up"]},{"osd":4,"uuid":"0e6b1639-23b0-47d9-8b08-40c8ab6df818","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":1095319381},{"type":"v1","addr":"172.21.15.97:6801","nonce":1095319381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":1095319381},{"type":"v1","addr":"172.21.15.97:6803","nonce":1095319381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":1095319381},{"type":"v1","addr":"172.21.15.97:6807","nonce":1095319381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":1095319381},{"type":"v1","addr":"172.21.15.97:6805","nonce":1095319381}]},"public_addr":"172.21.15.97:6801/1095319381","cluster_addr":"172.21.15.97:6803/1095319381","heartbeat_back_addr":"172.21.15.97:6807/1095319381","heartbeat_front_addr":"172.21.15.97:6805/1095319381","state":["exists","up"]},{"osd":5,"uuid":"f0f876ef-0823-46e9-8fe4-9b7a64a94cee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":899031308},{"type":"v1","addr":"172.21.15.97:6817","nonce":899031308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":899031308},{"type":"v1","addr":"172.21.15.97:6819","nonce":899031308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":899031308},{"type":"v1","addr":"172.21.15.97:6823","nonce":899031308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":899031308},{"type":"v1","addr":"172.21.15.97:6821","nonce":899031308}]},"public_addr":"172.21.15.97:6817/899031308","cluster_addr":"172.21.15.97:6819/899031308","heartbeat_back_addr":"172.21.15.97:6823/899031308","heartbeat_front_addr":"172.21.15.97:6821/899031308","state":["exists","up"]},{"osd":6,"uuid":"d29a625e-83bf-40ef-a57e-618220b96b9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2224814961},{"type":"v1","addr":"172.21.15.97:6825","nonce":2224814961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2224814961},{"type":"v1","addr":"172.21.15.97:6827","nonce":2224814961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2224814961},{"type":"v1","addr":"172.21.15.97:6831","nonce":2224814961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2224814961},{"type":"v1","addr":"172.21.15.97:6829","nonce":2224814961}]},"public_addr":"172.21.15.97:6825/2224814961","cluster_addr":"172.21.15.97:6827/2224814961","heartbeat_back_addr":"172.21.15.97:6831/2224814961","heartbeat_front_addr":"172.21.15.97:6829/2224814961","state":["exists","up"]},{"osd":7,"uuid":"7bcfd8f1-7dc0-4013-af17-16da5a8d931d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":284968823},{"type":"v1","addr":"172.21.15.97:6809","nonce":284968823}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":284968823},{"type":"v1","addr":"172.21.15.97:6811","nonce":284968823}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6814","nonce":284968823},{"type":"v1","addr":"172.21.15.97:6815","nonce":284968823}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":284968823},{"type":"v1","addr":"172.21.15.97:6813","nonce":284968823}]},"public_addr":"172.21.15.97:6809/284968823","cluster_addr":"172.21.15.97:6811/284968823","heartbeat_back_addr":"172.21.15.97:6815/284968823","heartbeat_front_addr":"172.21.15.97:6813/284968823","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T01:55:39.369550+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T01:55:39.367285+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T01:55:39.458393+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T01:55:39.456179+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T01:55:39.463649+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T01:55:38.728924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T01:55:39.522411+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T01:55:39.432081+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-01T01:55:52.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.950+0000 7fb9558bc640 1 -- 172.21.15.50:0/3016283158 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fb93c067450 msgr2=0x7fb93c069910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:52.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.950+0000 7fb9558bc640 1 --2- 172.21.15.50:0/3016283158 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fb93c067450 0x7fb93c069910 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb940009ab0 tx=0x7fb940008040 comp rx=0 tx=0).stop 2024-04-01T01:55:52.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.950+0000 7fb9558bc640 1 -- 172.21.15.50:0/3016283158 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9501edea0 msgr2=0x7fb950144ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:52.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.950+0000 7fb9558bc640 1 --2- 172.21.15.50:0/3016283158 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9501edea0 0x7fb950144ad0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb95015b0a0 tx=0x7fb948007bc0 comp rx=0 tx=0).stop 2024-04-01T01:55:52.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.950+0000 7fb9558bc640 1 -- 172.21.15.50:0/3016283158 shutdown_connections 2024-04-01T01:55:52.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.950+0000 7fb9558bc640 1 --2- 172.21.15.50:0/3016283158 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fb93c067450 0x7fb93c069910 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:52.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.950+0000 7fb9558bc640 1 --2- 172.21.15.50:0/3016283158 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9501edea0 0x7fb950144ad0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:52.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.950+0000 7fb9558bc640 1 --2- 172.21.15.50:0/3016283158 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb95014cfb0 0x7fb9501ed960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:52.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.950+0000 7fb9558bc640 1 --2- 172.21.15.50:0/3016283158 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb938004810 0x7fb950071730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:52.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.950+0000 7fb9558bc640 1 -- 172.21.15.50:0/3016283158 >> 172.21.15.50:0/3016283158 conn(0x7fb950067560 msgr2=0x7fb9500c4e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:55:52.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.950+0000 7fb9558bc640 1 -- 172.21.15.50:0/3016283158 shutdown_connections 2024-04-01T01:55:52.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:52.950+0000 7fb9558bc640 1 -- 172.21.15.50:0/3016283158 wait complete. 2024-04-01T01:55:52.969 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-01T01:55:52.969 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-01T01:55:53.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.082+0000 7f6d1d05f640 1 Processor -- start 2024-04-01T01:55:53.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.082+0000 7f6d1d05f640 1 -- start start 2024-04-01T01:55:53.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.082+0000 7f6d1d05f640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6d180c77c0 0x7f6d1815a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:53.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.082+0000 7f6d1d05f640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d18156a20 con 0x7f6d180c73a0 2024-04-01T01:55:53.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.082+0000 7f6d1d05f640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d18156ce0 con 0x7f6d18150e60 2024-04-01T01:55:53.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.082+0000 7f6d1d05f640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f6d181578f0 con 0x7f6d180c77c0 2024-04-01T01:55:53.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.082+0000 7f6d0ffff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f6d180c73a0 0x7f6d180c2900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:47508/0 (socket says 172.21.15.50:47508) 2024-04-01T01:55:53.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.082+0000 7f6d0ffff640 1 -- 172.21.15.50:0/2672764618 learned_addr learned my addr 172.21.15.50:0/2672764618 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-04-01T01:55:53.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.086+0000 7f6d1759e640 1 --2- 172.21.15.50:0/2672764618 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6d180c77c0 0x7f6d1815a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:53.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.086+0000 7f6d1659c640 1 -- 172.21.15.50:0/2672764618 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2040588442 0 0) 0x7f6d18156a20 con 0x7f6d180c73a0 2024-04-01T01:55:53.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.086+0000 7f6d1659c640 1 -- 172.21.15.50:0/2672764618 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6d04003530 con 0x7f6d180c73a0 2024-04-01T01:55:53.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.086+0000 7f6d1659c640 1 -- 172.21.15.50:0/2672764618 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4177752726 0 0) 0x7f6d18156ce0 con 0x7f6d18150e60 2024-04-01T01:55:53.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.086+0000 7f6d1659c640 1 -- 172.21.15.50:0/2672764618 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6d18156a20 con 0x7f6d18150e60 2024-04-01T01:55:53.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.086+0000 7f6d1659c640 1 -- 172.21.15.50:0/2672764618 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3406203912 0 0) 0x7f6d04003530 con 0x7f6d180c73a0 2024-04-01T01:55:53.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.086+0000 7f6d1659c640 1 -- 172.21.15.50:0/2672764618 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6d180c77c0 msgr2=0x7f6d1815a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:55:53.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.086+0000 7f6d1659c640 1 --2- 172.21.15.50:0/2672764618 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6d180c77c0 0x7f6d1815a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:53.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.086+0000 7f6d1659c640 1 -- 172.21.15.50:0/2672764618 >> v1:172.21.15.97:6789/0 conn(0x7f6d18150e60 legacy=0x7f6d18072f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:53.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.086+0000 7f6d1659c640 1 -- 172.21.15.50:0/2672764618 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d18156fc0 con 0x7f6d180c73a0 2024-04-01T01:55:53.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.086+0000 7f6d1659c640 1 -- 172.21.15.50:0/2672764618 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2779672543 0 0) 0x7f6d00001680 con 0x7f6d180c73a0 2024-04-01T01:55:53.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.086+0000 7f6d1659c640 1 -- 172.21.15.50:0/2672764618 >> v1:172.21.15.50:6789/0 conn(0x7f6d180c73a0 legacy=0x7f6d180c2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:53.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.086+0000 7f6d1659c640 1 --2- 172.21.15.50:0/2672764618 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d04003b80 0x7f6d04003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:53.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.086+0000 7f6d1659c640 1 --2- 172.21.15.50:0/2672764618 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6d04004810 0x7f6d04004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:53.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.086+0000 7f6d1659c640 1 --2- 172.21.15.50:0/2672764618 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6d04005190 0x7f6d0400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:53.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.086+0000 7f6d1659c640 1 -- 172.21.15.50:0/2672764618 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6d181578f0 con 0x7f6d04003b80 2024-04-01T01:55:53.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.086+0000 7f6d1659c640 1 -- 172.21.15.50:0/2672764618 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f6d0400bf10 con 0x7f6d04005190 2024-04-01T01:55:53.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.086+0000 7f6d1659c640 1 -- 172.21.15.50:0/2672764618 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f6d0400c090 con 0x7f6d04004810 2024-04-01T01:55:53.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.086+0000 7f6d16d9d640 1 --2- 172.21.15.50:0/2672764618 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d04003b80 0x7f6d04003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:53.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.086+0000 7f6d0ffff640 1 --2- 172.21.15.50:0/2672764618 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6d04004810 0x7f6d04004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:53.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.086+0000 7f6d1759e640 1 --2- 172.21.15.50:0/2672764618 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6d04005190 0x7f6d0400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:53.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.086+0000 7f6d16d9d640 1 -- 172.21.15.50:0/2672764618 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6d04004810 msgr2=0x7f6d04004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:55:53.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.086+0000 7f6d16d9d640 1 --2- 172.21.15.50:0/2672764618 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6d04004810 0x7f6d04004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:53.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.086+0000 7f6d16d9d640 1 -- 172.21.15.50:0/2672764618 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6d04005190 msgr2=0x7f6d0400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:55:53.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.086+0000 7f6d16d9d640 1 --2- 172.21.15.50:0/2672764618 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6d04005190 0x7f6d0400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:53.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.086+0000 7f6d16d9d640 1 -- 172.21.15.50:0/2672764618 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d04003530 con 0x7f6d04003b80 2024-04-01T01:55:53.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.086+0000 7f6d0ffff640 1 --2- 172.21.15.50:0/2672764618 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6d04004810 0x7f6d04004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T01:55:53.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.086+0000 7f6d1759e640 1 --2- 172.21.15.50:0/2672764618 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6d04005190 0x7f6d0400b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T01:55:53.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.086+0000 7f6d16d9d640 1 --2- 172.21.15.50:0/2672764618 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d04003b80 0x7f6d04003f80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6d080018d0 tx=0x7f6d0801ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0030801cdfcccd9 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:53.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.086+0000 7f6d1659c640 1 -- 172.21.15.50:0/2672764618 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d08001520 con 0x7f6d04003b80 2024-04-01T01:55:53.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.086+0000 7f6d1659c640 1 -- 172.21.15.50:0/2672764618 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d080052f0 con 0x7f6d04003b80 2024-04-01T01:55:53.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.086+0000 7f6d1659c640 1 -- 172.21.15.50:0/2672764618 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d080a8950 con 0x7f6d04003b80 2024-04-01T01:55:53.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.086+0000 7f6d1d05f640 1 -- 172.21.15.50:0/2672764618 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d04003b80 msgr2=0x7f6d04003f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:53.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.086+0000 7f6d1d05f640 1 --2- 172.21.15.50:0/2672764618 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d04003b80 0x7f6d04003f80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6d080018d0 tx=0x7f6d0801ecf0 comp rx=0 tx=0).stop 2024-04-01T01:55:53.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.086+0000 7f6d1759e640 1 -- 172.21.15.50:0/2672764618 reap_dead start 2024-04-01T01:55:53.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.086+0000 7f6d1d05f640 1 -- 172.21.15.50:0/2672764618 shutdown_connections 2024-04-01T01:55:53.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.086+0000 7f6d1d05f640 1 -- 172.21.15.50:0/2672764618 >> 172.21.15.50:0/2672764618 conn(0x7f6d18067560 msgr2=0x7f6d1806b220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:55:53.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.086+0000 7f6d1d05f640 1 -- 172.21.15.50:0/2672764618 shutdown_connections 2024-04-01T01:55:53.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.086+0000 7f6d1d05f640 1 -- 172.21.15.50:0/2672764618 wait complete. 2024-04-01T01:55:53.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.090+0000 7f6d1d05f640 1 Processor -- start 2024-04-01T01:55:53.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.090+0000 7f6d1d05f640 1 -- start start 2024-04-01T01:55:53.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.090+0000 7f6d1d05f640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6d04003b80 0x7f6d18158030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:53.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.090+0000 7f6d1d05f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d18142970 0x7f6d1814ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:53.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.090+0000 7f6d1d05f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6d180728f0 0x7f6d180ca9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:53.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.090+0000 7f6d1d05f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6d180c3010 con 0x7f6d18142970 2024-04-01T01:55:53.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.090+0000 7f6d1d05f640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f6d18157580 con 0x7f6d180728f0 2024-04-01T01:55:53.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.090+0000 7f6d1d05f640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f6d180c3190 con 0x7f6d04003b80 2024-04-01T01:55:53.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.090+0000 7f6d0ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d18142970 0x7f6d1814ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:53.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.090+0000 7f6d0ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d18142970 0x7f6d1814ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55426/0 (socket says 172.21.15.50:55426) 2024-04-01T01:55:53.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.090+0000 7f6d0ffff640 1 -- 172.21.15.50:0/3851175238 learned_addr learned my addr 172.21.15.50:0/3851175238 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T01:55:53.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.090+0000 7f6d1759e640 1 --2- 172.21.15.50:0/3851175238 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6d180728f0 0x7f6d180ca9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:53.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.090+0000 7f6d16d9d640 1 --2- 172.21.15.50:0/3851175238 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6d04003b80 0x7f6d18158030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:53.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.090+0000 7f6d0ffff640 1 -- 172.21.15.50:0/3851175238 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6d04003b80 msgr2=0x7f6d18158030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:53.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.090+0000 7f6d0ffff640 1 --2- 172.21.15.50:0/3851175238 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6d04003b80 0x7f6d18158030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:53.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.090+0000 7f6d0ffff640 1 -- 172.21.15.50:0/3851175238 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6d180728f0 msgr2=0x7f6d180ca9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:53.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.090+0000 7f6d0ffff640 1 --2- 172.21.15.50:0/3851175238 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6d180728f0 0x7f6d180ca9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:53.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.090+0000 7f6d0ffff640 1 -- 172.21.15.50:0/3851175238 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d18158570 con 0x7f6d18142970 2024-04-01T01:55:53.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.090+0000 7f6d16d9d640 1 --2- 172.21.15.50:0/3851175238 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6d04003b80 0x7f6d18158030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T01:55:53.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.090+0000 7f6d1759e640 1 --2- 172.21.15.50:0/3851175238 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6d180728f0 0x7f6d180ca9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T01:55:53.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.090+0000 7f6d0ffff640 1 --2- 172.21.15.50:0/3851175238 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d18142970 0x7f6d1814ce80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6d0000d7d0 tx=0x7f6d0000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:53.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.090+0000 7f6d0f7fe640 1 -- 172.21.15.50:0/3851175238 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d00019070 con 0x7f6d18142970 2024-04-01T01:55:53.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.090+0000 7f6d0f7fe640 1 -- 172.21.15.50:0/3851175238 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d000074e0 con 0x7f6d18142970 2024-04-01T01:55:53.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.090+0000 7f6d1d05f640 1 -- 172.21.15.50:0/3851175238 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d18142e40 con 0x7f6d18142970 2024-04-01T01:55:53.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.090+0000 7f6d0f7fe640 1 -- 172.21.15.50:0/3851175238 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d000049f0 con 0x7f6d18142970 2024-04-01T01:55:53.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.090+0000 7f6d1d05f640 1 -- 172.21.15.50:0/3851175238 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d18158c50 con 0x7f6d18142970 2024-04-01T01:55:53.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.090+0000 7f6d1d05f640 1 -- 172.21.15.50:0/3851175238 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d18068230 con 0x7f6d18142970 2024-04-01T01:55:53.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.094+0000 7f6d0f7fe640 1 -- 172.21.15.50:0/3851175238 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 87103+0+0 (secure 0 0 0) 0x7f6d0001c070 con 0x7f6d18142970 2024-04-01T01:55:53.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.094+0000 7f6d0f7fe640 1 --2- 172.21.15.50:0/3851175238 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f6cf8067420 0x7f6cf80698e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:53.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.094+0000 7f6d0f7fe640 1 -- 172.21.15.50:0/3851175238 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f6d000850e0 con 0x7f6d18142970 2024-04-01T01:55:53.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.094+0000 7f6d16d9d640 1 --2- 172.21.15.50:0/3851175238 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f6cf8067420 0x7f6cf80698e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:53.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.094+0000 7f6d16d9d640 1 --2- 172.21.15.50:0/3851175238 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f6cf8067420 0x7f6cf80698e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6d080b0000 tx=0x7f6d080aa070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:53.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.098+0000 7f6d0f7fe640 1 -- 172.21.15.50:0/3851175238 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+176632 (secure 0 0 0) 0x7f6d00055df0 con 0x7f6d18142970 2024-04-01T01:55:53.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.254+0000 7f6d1d05f640 1 -- 172.21.15.50:0/3851175238 --> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6d180c48d0 con 0x7f6cf8067420 2024-04-01T01:55:53.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.274+0000 7f6d0f7fe640 1 -- 172.21.15.50:0/3851175238 <== mgr.4103 v2:172.21.15.97:6832/1677467570 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+241761 (secure 0 0 0) 0x7f6d080fa080 con 0x7f6cf8067420 2024-04-01T01:55:53.278 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-01T01:55:53.281 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-04-01T01:55:53.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.278+0000 7f6d1d05f640 1 -- 172.21.15.50:0/3851175238 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f6cf8067420 msgr2=0x7f6cf80698e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:53.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.278+0000 7f6d1d05f640 1 --2- 172.21.15.50:0/3851175238 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f6cf8067420 0x7f6cf80698e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6d080b0000 tx=0x7f6d080aa070 comp rx=0 tx=0).stop 2024-04-01T01:55:53.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.278+0000 7f6d1d05f640 1 -- 172.21.15.50:0/3851175238 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d18142970 msgr2=0x7f6d1814ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:53.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.278+0000 7f6d1d05f640 1 --2- 172.21.15.50:0/3851175238 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d18142970 0x7f6d1814ce80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6d0000d7d0 tx=0x7f6d0000dc90 comp rx=0 tx=0).stop 2024-04-01T01:55:53.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.278+0000 7f6d1d05f640 1 -- 172.21.15.50:0/3851175238 shutdown_connections 2024-04-01T01:55:53.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.278+0000 7f6d1d05f640 1 --2- 172.21.15.50:0/3851175238 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f6cf8067420 0x7f6cf80698e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:53.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.278+0000 7f6d1d05f640 1 --2- 172.21.15.50:0/3851175238 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6d180728f0 0x7f6d180ca9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:53.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.278+0000 7f6d1d05f640 1 --2- 172.21.15.50:0/3851175238 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d18142970 0x7f6d1814ce80 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:53.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.278+0000 7f6d1d05f640 1 --2- 172.21.15.50:0/3851175238 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6d04003b80 0x7f6d18158030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:53.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.278+0000 7f6d1d05f640 1 -- 172.21.15.50:0/3851175238 >> 172.21.15.50:0/3851175238 conn(0x7f6d18067560 msgr2=0x7f6d180c57f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:55:53.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.278+0000 7f6d1d05f640 1 -- 172.21.15.50:0/3851175238 shutdown_connections 2024-04-01T01:55:53.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.278+0000 7f6d1d05f640 1 -- 172.21.15.50:0/3851175238 wait complete. 2024-04-01T01:55:53.299 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-04-01T01:55:52.063406+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590438,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":160,"num_write_kb":2417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":84,"acting":84,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":44,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":234324,"kb_used_data":1504,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754740396,"statfs":{"total":773094113280,"available":772854165504,"internally_reserved":0,"allocated":1540096,"data_stored":1616945,"data_compressed":66838,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.885246"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.227142+0000","last_change":"2024-04-01T01:55:49.247181+0000","last_active":"2024-04-01T01:55:50.227142+0000","last_peered":"2024-04-01T01:55:50.227142+0000","last_clean":"2024-04-01T01:55:50.227142+0000","last_became_active":"2024-04-01T01:55:49.246660+0000","last_became_peered":"2024-04-01T01:55:49.246660+0000","last_unstale":"2024-04-01T01:55:50.227142+0000","last_undegraded":"2024-04-01T01:55:50.227142+0000","last_fullsized":"2024-04-01T01:55:50.227142+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:27:12.089520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.226983+0000","last_change":"2024-04-01T01:55:49.240347+0000","last_active":"2024-04-01T01:55:50.226983+0000","last_peered":"2024-04-01T01:55:50.226983+0000","last_clean":"2024-04-01T01:55:50.226983+0000","last_became_active":"2024-04-01T01:55:49.239904+0000","last_became_peered":"2024-04-01T01:55:49.239904+0000","last_unstale":"2024-04-01T01:55:50.226983+0000","last_undegraded":"2024-04-01T01:55:50.226983+0000","last_fullsized":"2024-04-01T01:55:50.226983+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:37:43.280869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.226492+0000","last_change":"2024-04-01T01:55:49.262994+0000","last_active":"2024-04-01T01:55:50.226492+0000","last_peered":"2024-04-01T01:55:50.226492+0000","last_clean":"2024-04-01T01:55:50.226492+0000","last_became_active":"2024-04-01T01:55:49.262736+0000","last_became_peered":"2024-04-01T01:55:49.262736+0000","last_unstale":"2024-04-01T01:55:50.226492+0000","last_undegraded":"2024-04-01T01:55:50.226492+0000","last_fullsized":"2024-04-01T01:55:50.226492+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:35:14.625545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.225923+0000","last_change":"2024-04-01T01:55:49.248046+0000","last_active":"2024-04-01T01:55:50.225923+0000","last_peered":"2024-04-01T01:55:50.225923+0000","last_clean":"2024-04-01T01:55:50.225923+0000","last_became_active":"2024-04-01T01:55:49.247662+0000","last_became_peered":"2024-04-01T01:55:49.247662+0000","last_unstale":"2024-04-01T01:55:50.225923+0000","last_undegraded":"2024-04-01T01:55:50.225923+0000","last_fullsized":"2024-04-01T01:55:50.225923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:59:26.879090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.226214+0000","last_change":"2024-04-01T01:55:49.250832+0000","last_active":"2024-04-01T01:55:50.226214+0000","last_peered":"2024-04-01T01:55:50.226214+0000","last_clean":"2024-04-01T01:55:50.226214+0000","last_became_active":"2024-04-01T01:55:49.250522+0000","last_became_peered":"2024-04-01T01:55:49.250522+0000","last_unstale":"2024-04-01T01:55:50.226214+0000","last_undegraded":"2024-04-01T01:55:50.226214+0000","last_fullsized":"2024-04-01T01:55:50.226214+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:47:04.592262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.227645+0000","last_change":"2024-04-01T01:55:49.243460+0000","last_active":"2024-04-01T01:55:50.227645+0000","last_peered":"2024-04-01T01:55:50.227645+0000","last_clean":"2024-04-01T01:55:50.227645+0000","last_became_active":"2024-04-01T01:55:49.243017+0000","last_became_peered":"2024-04-01T01:55:49.243017+0000","last_unstale":"2024-04-01T01:55:50.227645+0000","last_undegraded":"2024-04-01T01:55:50.227645+0000","last_fullsized":"2024-04-01T01:55:50.227645+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:20:18.156798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.227405+0000","last_change":"2024-04-01T01:55:49.252043+0000","last_active":"2024-04-01T01:55:50.227405+0000","last_peered":"2024-04-01T01:55:50.227405+0000","last_clean":"2024-04-01T01:55:50.227405+0000","last_became_active":"2024-04-01T01:55:49.251760+0000","last_became_peered":"2024-04-01T01:55:49.251760+0000","last_unstale":"2024-04-01T01:55:50.227405+0000","last_undegraded":"2024-04-01T01:55:50.227405+0000","last_fullsized":"2024-04-01T01:55:50.227405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:12:25.325040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.226757+0000","last_change":"2024-04-01T01:55:48.225145+0000","last_active":"2024-04-01T01:55:50.226757+0000","last_peered":"2024-04-01T01:55:50.226757+0000","last_clean":"2024-04-01T01:55:50.226757+0000","last_became_active":"2024-04-01T01:55:48.224408+0000","last_became_peered":"2024-04-01T01:55:48.224408+0000","last_unstale":"2024-04-01T01:55:50.226757+0000","last_undegraded":"2024-04-01T01:55:50.226757+0000","last_fullsized":"2024-04-01T01:55:50.226757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:41:59.465915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-01T01:55:47.187702+0000","last_change":"2024-04-01T01:55:47.187702+0000","last_active":"2024-04-01T01:55:47.163119+0000","last_peered":"2024-04-01T01:55:47.163119+0000","last_clean":"2024-04-01T01:55:47.163119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:47.187702+0000","last_undegraded":"2024-04-01T01:55:47.187702+0000","last_fullsized":"2024-04-01T01:55:47.187702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:47.163119+0000","last_change":"2024-04-01T01:55:47.163119+0000","last_active":"2024-04-01T01:55:47.163119+0000","last_peered":"2024-04-01T01:55:47.163119+0000","last_clean":"2024-04-01T01:55:47.163119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:47.163119+0000","last_undegraded":"2024-04-01T01:55:47.163119+0000","last_fullsized":"2024-04-01T01:55:47.163119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.227275+0000","last_change":"2024-04-01T01:55:49.246424+0000","last_active":"2024-04-01T01:55:50.227275+0000","last_peered":"2024-04-01T01:55:50.227275+0000","last_clean":"2024-04-01T01:55:50.227275+0000","last_became_active":"2024-04-01T01:55:49.243823+0000","last_became_peered":"2024-04-01T01:55:49.243823+0000","last_unstale":"2024-04-01T01:55:50.227275+0000","last_undegraded":"2024-04-01T01:55:50.227275+0000","last_fullsized":"2024-04-01T01:55:50.227275+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:27:45.663474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-01T01:55:47.187122+0000","last_change":"2024-04-01T01:55:47.187122+0000","last_active":"2024-04-01T01:55:47.163119+0000","last_peered":"2024-04-01T01:55:47.163119+0000","last_clean":"2024-04-01T01:55:47.163119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:47.187122+0000","last_undegraded":"2024-04-01T01:55:47.187122+0000","last_fullsized":"2024-04-01T01:55:47.187122+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-01T01:55:47.187214+0000","last_change":"2024-04-01T01:55:47.187214+0000","last_active":"2024-04-01T01:55:47.163119+0000","last_peered":"2024-04-01T01:55:47.163119+0000","last_clean":"2024-04-01T01:55:47.163119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:47.187214+0000","last_undegraded":"2024-04-01T01:55:47.187214+0000","last_fullsized":"2024-04-01T01:55:47.187214+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-01T01:55:47.182644+0000","last_change":"2024-04-01T01:55:47.182644+0000","last_active":"2024-04-01T01:55:47.163119+0000","last_peered":"2024-04-01T01:55:47.163119+0000","last_clean":"2024-04-01T01:55:47.163119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:47.182644+0000","last_undegraded":"2024-04-01T01:55:47.182644+0000","last_fullsized":"2024-04-01T01:55:47.182644+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.228364+0000","last_change":"2024-04-01T01:55:49.261532+0000","last_active":"2024-04-01T01:55:50.228364+0000","last_peered":"2024-04-01T01:55:50.228364+0000","last_clean":"2024-04-01T01:55:50.228364+0000","last_became_active":"2024-04-01T01:55:49.261260+0000","last_became_peered":"2024-04-01T01:55:49.261260+0000","last_unstale":"2024-04-01T01:55:50.228364+0000","last_undegraded":"2024-04-01T01:55:50.228364+0000","last_fullsized":"2024-04-01T01:55:50.228364+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:30:02.149564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-01T01:55:47.185591+0000","last_change":"2024-04-01T01:55:47.185591+0000","last_active":"2024-04-01T01:55:47.163119+0000","last_peered":"2024-04-01T01:55:47.163119+0000","last_clean":"2024-04-01T01:55:47.163119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:47.185591+0000","last_undegraded":"2024-04-01T01:55:47.185591+0000","last_fullsized":"2024-04-01T01:55:47.185591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-01T01:55:47.178823+0000","last_change":"2024-04-01T01:55:47.178823+0000","last_active":"2024-04-01T01:55:47.163119+0000","last_peered":"2024-04-01T01:55:47.163119+0000","last_clean":"2024-04-01T01:55:47.163119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:47.178823+0000","last_undegraded":"2024-04-01T01:55:47.178823+0000","last_fullsized":"2024-04-01T01:55:47.178823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-01T01:55:47.184193+0000","last_change":"2024-04-01T01:55:47.184193+0000","last_active":"2024-04-01T01:55:47.163119+0000","last_peered":"2024-04-01T01:55:47.163119+0000","last_clean":"2024-04-01T01:55:47.163119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:47.184193+0000","last_undegraded":"2024-04-01T01:55:47.184193+0000","last_fullsized":"2024-04-01T01:55:47.184193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-01T01:55:47.187002+0000","last_change":"2024-04-01T01:55:47.187002+0000","last_active":"2024-04-01T01:55:47.163119+0000","last_peered":"2024-04-01T01:55:47.163119+0000","last_clean":"2024-04-01T01:55:47.163119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:47.187002+0000","last_undegraded":"2024-04-01T01:55:47.187002+0000","last_fullsized":"2024-04-01T01:55:47.187002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-01T01:55:47.182645+0000","last_change":"2024-04-01T01:55:47.182645+0000","last_active":"2024-04-01T01:55:47.163119+0000","last_peered":"2024-04-01T01:55:47.163119+0000","last_clean":"2024-04-01T01:55:47.163119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:47.182645+0000","last_undegraded":"2024-04-01T01:55:47.182645+0000","last_fullsized":"2024-04-01T01:55:47.182645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-01T01:55:47.178156+0000","last_change":"2024-04-01T01:55:47.178156+0000","last_active":"2024-04-01T01:55:47.163119+0000","last_peered":"2024-04-01T01:55:47.163119+0000","last_clean":"2024-04-01T01:55:47.163119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:47.178156+0000","last_undegraded":"2024-04-01T01:55:47.178156+0000","last_fullsized":"2024-04-01T01:55:47.178156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-01T01:55:47.183652+0000","last_change":"2024-04-01T01:55:47.183652+0000","last_active":"2024-04-01T01:55:47.163119+0000","last_peered":"2024-04-01T01:55:47.163119+0000","last_clean":"2024-04-01T01:55:47.163119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:47.183652+0000","last_undegraded":"2024-04-01T01:55:47.183652+0000","last_fullsized":"2024-04-01T01:55:47.183652+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-01T01:55:47.180358+0000","last_change":"2024-04-01T01:55:47.180358+0000","last_active":"2024-04-01T01:55:47.163119+0000","last_peered":"2024-04-01T01:55:47.163119+0000","last_clean":"2024-04-01T01:55:47.163119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:47.180358+0000","last_undegraded":"2024-04-01T01:55:47.180358+0000","last_fullsized":"2024-04-01T01:55:47.180358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.227260+0000","last_change":"2024-04-01T01:55:48.216662+0000","last_active":"2024-04-01T01:55:50.227260+0000","last_peered":"2024-04-01T01:55:50.227260+0000","last_clean":"2024-04-01T01:55:50.227260+0000","last_became_active":"2024-04-01T01:55:48.215852+0000","last_became_peered":"2024-04-01T01:55:48.215852+0000","last_unstale":"2024-04-01T01:55:50.227260+0000","last_undegraded":"2024-04-01T01:55:50.227260+0000","last_fullsized":"2024-04-01T01:55:50.227260+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:25:39.713293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:47.163119+0000","last_change":"2024-04-01T01:55:47.163119+0000","last_active":"2024-04-01T01:55:47.163119+0000","last_peered":"2024-04-01T01:55:47.163119+0000","last_clean":"2024-04-01T01:55:47.163119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:47.163119+0000","last_undegraded":"2024-04-01T01:55:47.163119+0000","last_fullsized":"2024-04-01T01:55:47.163119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":164,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-01T01:55:47.186672+0000","last_change":"2024-04-01T01:55:43.145201+0000","last_active":"2024-04-01T01:55:47.186672+0000","last_peered":"2024-04-01T01:55:47.186672+0000","last_clean":"2024-04-01T01:55:47.186672+0000","last_became_active":"2024-04-01T01:55:43.144882+0000","last_became_peered":"2024-04-01T01:55:43.144882+0000","last_unstale":"2024-04-01T01:55:47.186672+0000","last_undegraded":"2024-04-01T01:55:47.186672+0000","last_fullsized":"2024-04-01T01:55:47.186672+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:42.134502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:42.134502+0000","last_clean_scrub_stamp":"2024-04-01T01:55:42.134502+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:02:26.589535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-01T01:55:47.185243+0000","last_change":"2024-04-01T01:55:47.185243+0000","last_active":"2024-04-01T01:55:47.163119+0000","last_peered":"2024-04-01T01:55:47.163119+0000","last_clean":"2024-04-01T01:55:47.163119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:47.185243+0000","last_undegraded":"2024-04-01T01:55:47.185243+0000","last_fullsized":"2024-04-01T01:55:47.185243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-01T01:55:47.184939+0000","last_change":"2024-04-01T01:55:47.184939+0000","last_active":"2024-04-01T01:55:47.163119+0000","last_peered":"2024-04-01T01:55:47.163119+0000","last_clean":"2024-04-01T01:55:47.163119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:47.184939+0000","last_undegraded":"2024-04-01T01:55:47.184939+0000","last_fullsized":"2024-04-01T01:55:47.184939+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-01T01:55:47.183838+0000","last_change":"2024-04-01T01:55:47.183838+0000","last_active":"2024-04-01T01:55:47.163119+0000","last_peered":"2024-04-01T01:55:47.163119+0000","last_clean":"2024-04-01T01:55:47.163119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:47.183838+0000","last_undegraded":"2024-04-01T01:55:47.183838+0000","last_fullsized":"2024-04-01T01:55:47.183838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.226891+0000","last_change":"2024-04-01T01:55:49.246734+0000","last_active":"2024-04-01T01:55:50.226891+0000","last_peered":"2024-04-01T01:55:50.226891+0000","last_clean":"2024-04-01T01:55:50.226891+0000","last_became_active":"2024-04-01T01:55:49.246152+0000","last_became_peered":"2024-04-01T01:55:49.246152+0000","last_unstale":"2024-04-01T01:55:50.226891+0000","last_undegraded":"2024-04-01T01:55:50.226891+0000","last_fullsized":"2024-04-01T01:55:50.226891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:52:34.992185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-01T01:55:47.185607+0000","last_change":"2024-04-01T01:55:47.185607+0000","last_active":"2024-04-01T01:55:47.163119+0000","last_peered":"2024-04-01T01:55:47.163119+0000","last_clean":"2024-04-01T01:55:47.163119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:47.185607+0000","last_undegraded":"2024-04-01T01:55:47.185607+0000","last_fullsized":"2024-04-01T01:55:47.185607+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.226200+0000","last_change":"2024-04-01T01:55:48.226323+0000","last_active":"2024-04-01T01:55:50.226200+0000","last_peered":"2024-04-01T01:55:50.226200+0000","last_clean":"2024-04-01T01:55:50.226200+0000","last_became_active":"2024-04-01T01:55:48.225487+0000","last_became_peered":"2024-04-01T01:55:48.225487+0000","last_unstale":"2024-04-01T01:55:50.226200+0000","last_undegraded":"2024-04-01T01:55:50.226200+0000","last_fullsized":"2024-04-01T01:55:50.226200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:13:17.832963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-01T01:55:47.185871+0000","last_change":"2024-04-01T01:55:47.185871+0000","last_active":"2024-04-01T01:55:47.163119+0000","last_peered":"2024-04-01T01:55:47.163119+0000","last_clean":"2024-04-01T01:55:47.163119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:47.185871+0000","last_undegraded":"2024-04-01T01:55:47.185871+0000","last_fullsized":"2024-04-01T01:55:47.185871+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-01T01:55:47.178842+0000","last_change":"2024-04-01T01:55:47.178842+0000","last_active":"2024-04-01T01:55:47.163119+0000","last_peered":"2024-04-01T01:55:47.163119+0000","last_clean":"2024-04-01T01:55:47.163119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:47.178842+0000","last_undegraded":"2024-04-01T01:55:47.178842+0000","last_fullsized":"2024-04-01T01:55:47.178842+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-01T01:55:47.185032+0000","last_change":"2024-04-01T01:55:47.185032+0000","last_active":"2024-04-01T01:55:47.163119+0000","last_peered":"2024-04-01T01:55:47.163119+0000","last_clean":"2024-04-01T01:55:47.163119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:47.185032+0000","last_undegraded":"2024-04-01T01:55:47.185032+0000","last_fullsized":"2024-04-01T01:55:47.185032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-01T01:55:47.182623+0000","last_change":"2024-04-01T01:55:47.182623+0000","last_active":"2024-04-01T01:55:47.163119+0000","last_peered":"2024-04-01T01:55:47.163119+0000","last_clean":"2024-04-01T01:55:47.163119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:47.182623+0000","last_undegraded":"2024-04-01T01:55:47.182623+0000","last_fullsized":"2024-04-01T01:55:47.182623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-01T01:55:47.178196+0000","last_change":"2024-04-01T01:55:47.178196+0000","last_active":"2024-04-01T01:55:47.163119+0000","last_peered":"2024-04-01T01:55:47.163119+0000","last_clean":"2024-04-01T01:55:47.163119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:47.178196+0000","last_undegraded":"2024-04-01T01:55:47.178196+0000","last_fullsized":"2024-04-01T01:55:47.178196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:47.163119+0000","last_change":"2024-04-01T01:55:47.163119+0000","last_active":"2024-04-01T01:55:47.163119+0000","last_peered":"2024-04-01T01:55:47.163119+0000","last_clean":"2024-04-01T01:55:47.163119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:47.163119+0000","last_undegraded":"2024-04-01T01:55:47.163119+0000","last_fullsized":"2024-04-01T01:55:47.163119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-01T01:55:47.186538+0000","last_change":"2024-04-01T01:55:47.186538+0000","last_active":"2024-04-01T01:55:47.163119+0000","last_peered":"2024-04-01T01:55:47.163119+0000","last_clean":"2024-04-01T01:55:47.163119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:47.186538+0000","last_undegraded":"2024-04-01T01:55:47.186538+0000","last_fullsized":"2024-04-01T01:55:47.186538+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-01T01:55:47.182944+0000","last_change":"2024-04-01T01:55:47.182944+0000","last_active":"2024-04-01T01:55:47.163119+0000","last_peered":"2024-04-01T01:55:47.163119+0000","last_clean":"2024-04-01T01:55:47.163119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:47.182944+0000","last_undegraded":"2024-04-01T01:55:47.182944+0000","last_fullsized":"2024-04-01T01:55:47.182944+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-01T01:55:47.183022+0000","last_change":"2024-04-01T01:55:47.183022+0000","last_active":"2024-04-01T01:55:47.163119+0000","last_peered":"2024-04-01T01:55:47.163119+0000","last_clean":"2024-04-01T01:55:47.163119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:47.183022+0000","last_undegraded":"2024-04-01T01:55:47.183022+0000","last_fullsized":"2024-04-01T01:55:47.183022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.228017+0000","last_change":"2024-04-01T01:55:49.243377+0000","last_active":"2024-04-01T01:55:50.228017+0000","last_peered":"2024-04-01T01:55:50.228017+0000","last_clean":"2024-04-01T01:55:50.228017+0000","last_became_active":"2024-04-01T01:55:49.242851+0000","last_became_peered":"2024-04-01T01:55:49.242851+0000","last_unstale":"2024-04-01T01:55:50.228017+0000","last_undegraded":"2024-04-01T01:55:50.228017+0000","last_fullsized":"2024-04-01T01:55:50.228017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:48:38.596647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.227487+0000","last_change":"2024-04-01T01:55:48.213862+0000","last_active":"2024-04-01T01:55:50.227487+0000","last_peered":"2024-04-01T01:55:50.227487+0000","last_clean":"2024-04-01T01:55:50.227487+0000","last_became_active":"2024-04-01T01:55:48.213122+0000","last_became_peered":"2024-04-01T01:55:48.213122+0000","last_unstale":"2024-04-01T01:55:50.227487+0000","last_undegraded":"2024-04-01T01:55:50.227487+0000","last_fullsized":"2024-04-01T01:55:50.227487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:59:23.563864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.227575+0000","last_change":"2024-04-01T01:55:49.252273+0000","last_active":"2024-04-01T01:55:50.227575+0000","last_peered":"2024-04-01T01:55:50.227575+0000","last_clean":"2024-04-01T01:55:50.227575+0000","last_became_active":"2024-04-01T01:55:49.251963+0000","last_became_peered":"2024-04-01T01:55:49.251963+0000","last_unstale":"2024-04-01T01:55:50.227575+0000","last_undegraded":"2024-04-01T01:55:50.227575+0000","last_fullsized":"2024-04-01T01:55:50.227575+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:56:18.086766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-01T01:55:47.179994+0000","last_change":"2024-04-01T01:55:47.179994+0000","last_active":"2024-04-01T01:55:47.163119+0000","last_peered":"2024-04-01T01:55:47.163119+0000","last_clean":"2024-04-01T01:55:47.163119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:47.179994+0000","last_undegraded":"2024-04-01T01:55:47.179994+0000","last_fullsized":"2024-04-01T01:55:47.179994+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":1},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":58,"acting":58,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66838,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27188,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":172032,"data_stored":52823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27188,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":172032,"data_stored":52823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509443,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31348,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340492,"statfs":{"total":96636764160,"available":96604663808,"internally_reserved":0,"allocated":172032,"data_stored":52823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31348,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340492,"statfs":{"total":96636764160,"available":96604663808,"internally_reserved":0,"allocated":172032,"data_stored":52823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509444,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31424,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340416,"statfs":{"total":96636764160,"available":96604585984,"internally_reserved":0,"allocated":237568,"data_stored":643191,"data_compressed":33419,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509443,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31348,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340492,"statfs":{"total":96636764160,"available":96604663808,"internally_reserved":0,"allocated":172032,"data_stored":52823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542147,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27176,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":159744,"data_stored":47006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":282624,"data_stored":662633,"data_compressed":33419,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33419,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33419,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-01T01:55:53.306 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-01T01:55:53.459 INFO:tasks.ceph.mds.f.smithi097.stderr:2024-04-01T01:55:53.457+0000 7f805e6ad640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-01T01:55:53.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.466+0000 7f333c6e8640 1 Processor -- start 2024-04-01T01:55:53.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.466+0000 7f333c6e8640 1 -- start start 2024-04-01T01:55:53.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.466+0000 7f333c6e8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f33340c73a0 0x7f33340c2900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:53.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.466+0000 7f333c6e8640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f33340c77c0 0x7f33340c2e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:53.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.466+0000 7f333c6e8640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3334156a20 con 0x7f3334150e60 2024-04-01T01:55:53.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.466+0000 7f333c6e8640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f33341578f0 con 0x7f33340c77c0 2024-04-01T01:55:53.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.466+0000 7f333c6e8640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f3334156ce0 con 0x7f33340c73a0 2024-04-01T01:55:53.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.466+0000 7f333ac85640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f33340c77c0 0x7f33340c2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:53.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.466+0000 7f333ac85640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f33340c77c0 0x7f33340c2e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55442/0 (socket says 172.21.15.50:55442) 2024-04-01T01:55:53.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.466+0000 7f333ac85640 1 -- 172.21.15.50:0/2883748 learned_addr learned my addr 172.21.15.50:0/2883748 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T01:55:53.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.466+0000 7f3339c83640 1 --2- 172.21.15.50:0/2883748 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f33340c73a0 0x7f33340c2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:53.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.466+0000 7f333ac85640 1 -- 172.21.15.50:0/2883748 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f33340c73a0 msgr2=0x7f33340c2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:55:53.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.466+0000 7f333ac85640 1 --2- 172.21.15.50:0/2883748 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f33340c73a0 0x7f33340c2900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:53.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.466+0000 7f333ac85640 1 -- 172.21.15.50:0/2883748 >> v1:172.21.15.97:6789/0 conn(0x7f3334150e60 legacy=0x7f3334072f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:53.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.466+0000 7f333ac85640 1 -- 172.21.15.50:0/2883748 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3334156fc0 con 0x7f33340c77c0 2024-04-01T01:55:53.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.466+0000 7f3339c83640 1 --2- 172.21.15.50:0/2883748 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f33340c73a0 0x7f33340c2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T01:55:53.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.470+0000 7f333ac85640 1 --2- 172.21.15.50:0/2883748 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33340c77c0 0x7f33340c2e40 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f332c009e50 tx=0x7f332c01f210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2eac07c105b2b3f6 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:53.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.470+0000 7f3339482640 1 -- 172.21.15.50:0/2883748 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f332c0b4070 con 0x7f33340c77c0 2024-04-01T01:55:53.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.470+0000 7f3339482640 1 -- 172.21.15.50:0/2883748 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f332c0af400 con 0x7f33340c77c0 2024-04-01T01:55:53.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.470+0000 7f3339482640 1 -- 172.21.15.50:0/2883748 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f332c0af7d0 con 0x7f33340c77c0 2024-04-01T01:55:53.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.470+0000 7f333c6e8640 1 -- 172.21.15.50:0/2883748 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33340c77c0 msgr2=0x7f33340c2e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:53.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.470+0000 7f333c6e8640 1 --2- 172.21.15.50:0/2883748 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33340c77c0 0x7f33340c2e40 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f332c009e50 tx=0x7f332c01f210 comp rx=0 tx=0).stop 2024-04-01T01:55:53.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.470+0000 7f333c6e8640 1 -- 172.21.15.50:0/2883748 shutdown_connections 2024-04-01T01:55:53.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.470+0000 7f333c6e8640 1 --2- 172.21.15.50:0/2883748 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33340c77c0 0x7f33340c2e40 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:53.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.470+0000 7f333c6e8640 1 --2- 172.21.15.50:0/2883748 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f33340c73a0 0x7f33340c2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:53.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.470+0000 7f333c6e8640 1 -- 172.21.15.50:0/2883748 >> 172.21.15.50:0/2883748 conn(0x7f3334067560 msgr2=0x7f333406b220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:55:53.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.470+0000 7f333c6e8640 1 -- 172.21.15.50:0/2883748 shutdown_connections 2024-04-01T01:55:53.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.470+0000 7f333c6e8640 1 -- 172.21.15.50:0/2883748 wait complete. 2024-04-01T01:55:53.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.470+0000 7f333c6e8640 1 Processor -- start 2024-04-01T01:55:53.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.470+0000 7f333c6e8640 1 -- start start 2024-04-01T01:55:53.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.470+0000 7f333c6e8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f33340c73a0 0x7f333413df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:53.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.470+0000 7f333c6e8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3334150e60 0x7f333414ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:53.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.470+0000 7f333c6e8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33340c2150 0x7f33340ca250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:53.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.470+0000 7f333c6e8640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f333415a2f0 con 0x7f33340c2150 2024-04-01T01:55:53.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.470+0000 7f333c6e8640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f3334157580 con 0x7f33340c73a0 2024-04-01T01:55:53.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.470+0000 7f333c6e8640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f333415a470 con 0x7f3334150e60 2024-04-01T01:55:53.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.470+0000 7f333ac85640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33340c2150 0x7f33340ca250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:53.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.470+0000 7f333ac85640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33340c2150 0x7f33340ca250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55444/0 (socket says 172.21.15.50:55444) 2024-04-01T01:55:53.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.470+0000 7f333ac85640 1 -- 172.21.15.50:0/3775694529 learned_addr learned my addr 172.21.15.50:0/3775694529 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T01:55:53.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.470+0000 7f3339c83640 1 --2- 172.21.15.50:0/3775694529 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3334150e60 0x7f333414ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:53.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.470+0000 7f333a484640 1 --2- 172.21.15.50:0/3775694529 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f33340c73a0 0x7f333413df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:53.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.470+0000 7f333ac85640 1 -- 172.21.15.50:0/3775694529 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3334150e60 msgr2=0x7f333414ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:53.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.470+0000 7f333ac85640 1 --2- 172.21.15.50:0/3775694529 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3334150e60 0x7f333414ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:53.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.470+0000 7f333ac85640 1 -- 172.21.15.50:0/3775694529 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f33340c73a0 msgr2=0x7f333413df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:53.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.470+0000 7f333ac85640 1 --2- 172.21.15.50:0/3775694529 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f33340c73a0 0x7f333413df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:53.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.470+0000 7f333ac85640 1 -- 172.21.15.50:0/3775694529 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f333414db40 con 0x7f33340c2150 2024-04-01T01:55:53.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.470+0000 7f333a484640 1 --2- 172.21.15.50:0/3775694529 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f33340c73a0 0x7f333413df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T01:55:53.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.470+0000 7f333ac85640 1 --2- 172.21.15.50:0/3775694529 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33340c2150 0x7f33340ca250 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f332c0b2040 tx=0x7f332c01bfb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:53.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.474+0000 7f332affd640 1 -- 172.21.15.50:0/3775694529 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f332c0c0070 con 0x7f33340c2150 2024-04-01T01:55:53.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.474+0000 7f332affd640 1 -- 172.21.15.50:0/3775694529 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f332c0090d0 con 0x7f33340c2150 2024-04-01T01:55:53.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.474+0000 7f333c6e8640 1 -- 172.21.15.50:0/3775694529 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f333414dde0 con 0x7f33340c2150 2024-04-01T01:55:53.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.474+0000 7f332affd640 1 -- 172.21.15.50:0/3775694529 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f332c0b4040 con 0x7f33340c2150 2024-04-01T01:55:53.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.474+0000 7f333c6e8640 1 -- 172.21.15.50:0/3775694529 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33341f14c0 con 0x7f33340c2150 2024-04-01T01:55:53.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.474+0000 7f333c6e8640 1 -- 172.21.15.50:0/3775694529 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3334068230 con 0x7f33340c2150 2024-04-01T01:55:53.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.474+0000 7f332affd640 1 -- 172.21.15.50:0/3775694529 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 87103+0+0 (secure 0 0 0) 0x7f332c0c3070 con 0x7f33340c2150 2024-04-01T01:55:53.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.474+0000 7f332affd640 1 --2- 172.21.15.50:0/3775694529 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f3318067420 0x7f33180698e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:53.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.474+0000 7f332affd640 1 -- 172.21.15.50:0/3775694529 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f332c122ea0 con 0x7f33340c2150 2024-04-01T01:55:53.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.474+0000 7f333a484640 1 --2- 172.21.15.50:0/3775694529 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f3318067420 0x7f33180698e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:53.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.474+0000 7f333a484640 1 --2- 172.21.15.50:0/3775694529 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f3318067420 0x7f33180698e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3324001670 tx=0x7f3324009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:53.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.478+0000 7f332affd640 1 -- 172.21.15.50:0/3775694529 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+176632 (secure 0 0 0) 0x7f332c018d70 con 0x7f33340c2150 2024-04-01T01:55:53.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.634+0000 7f333c6e8640 1 -- 172.21.15.50:0/3775694529 --> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f33340712b0 con 0x7f3318067420 2024-04-01T01:55:53.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.654+0000 7f332affd640 1 -- 172.21.15.50:0/3775694529 <== mgr.4103 v2:172.21.15.97:6832/1677467570 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+241761 (secure 0 0 0) 0x7f33340712b0 con 0x7f3318067420 2024-04-01T01:55:53.657 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-01T01:55:53.658 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-04-01T01:55:53.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.654+0000 7f333c6e8640 1 -- 172.21.15.50:0/3775694529 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f3318067420 msgr2=0x7f33180698e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:53.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.654+0000 7f333c6e8640 1 --2- 172.21.15.50:0/3775694529 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f3318067420 0x7f33180698e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3324001670 tx=0x7f3324009040 comp rx=0 tx=0).stop 2024-04-01T01:55:53.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.654+0000 7f333c6e8640 1 -- 172.21.15.50:0/3775694529 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33340c2150 msgr2=0x7f33340ca250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:53.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.654+0000 7f333c6e8640 1 --2- 172.21.15.50:0/3775694529 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33340c2150 0x7f33340ca250 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f332c0b2040 tx=0x7f332c01bfb0 comp rx=0 tx=0).stop 2024-04-01T01:55:53.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.654+0000 7f333c6e8640 1 -- 172.21.15.50:0/3775694529 shutdown_connections 2024-04-01T01:55:53.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.654+0000 7f333c6e8640 1 --2- 172.21.15.50:0/3775694529 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f3318067420 0x7f33180698e0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:53.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.654+0000 7f333c6e8640 1 --2- 172.21.15.50:0/3775694529 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33340c2150 0x7f33340ca250 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:53.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.654+0000 7f333c6e8640 1 --2- 172.21.15.50:0/3775694529 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3334150e60 0x7f333414ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:53.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.654+0000 7f333c6e8640 1 --2- 172.21.15.50:0/3775694529 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f33340c73a0 0x7f333413df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:53.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.654+0000 7f333c6e8640 1 -- 172.21.15.50:0/3775694529 >> 172.21.15.50:0/3775694529 conn(0x7f3334067560 msgr2=0x7f33340c5820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:55:53.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.658+0000 7f333c6e8640 1 -- 172.21.15.50:0/3775694529 shutdown_connections 2024-04-01T01:55:53.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.658+0000 7f333c6e8640 1 -- 172.21.15.50:0/3775694529 wait complete. 2024-04-01T01:55:53.675 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-04-01T01:55:52.063406+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590438,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":160,"num_write_kb":2417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":84,"acting":84,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":44,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":234324,"kb_used_data":1504,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754740396,"statfs":{"total":773094113280,"available":772854165504,"internally_reserved":0,"allocated":1540096,"data_stored":1616945,"data_compressed":66838,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.885246"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.227142+0000","last_change":"2024-04-01T01:55:49.247181+0000","last_active":"2024-04-01T01:55:50.227142+0000","last_peered":"2024-04-01T01:55:50.227142+0000","last_clean":"2024-04-01T01:55:50.227142+0000","last_became_active":"2024-04-01T01:55:49.246660+0000","last_became_peered":"2024-04-01T01:55:49.246660+0000","last_unstale":"2024-04-01T01:55:50.227142+0000","last_undegraded":"2024-04-01T01:55:50.227142+0000","last_fullsized":"2024-04-01T01:55:50.227142+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:27:12.089520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.226983+0000","last_change":"2024-04-01T01:55:49.240347+0000","last_active":"2024-04-01T01:55:50.226983+0000","last_peered":"2024-04-01T01:55:50.226983+0000","last_clean":"2024-04-01T01:55:50.226983+0000","last_became_active":"2024-04-01T01:55:49.239904+0000","last_became_peered":"2024-04-01T01:55:49.239904+0000","last_unstale":"2024-04-01T01:55:50.226983+0000","last_undegraded":"2024-04-01T01:55:50.226983+0000","last_fullsized":"2024-04-01T01:55:50.226983+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:37:43.280869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.226492+0000","last_change":"2024-04-01T01:55:49.262994+0000","last_active":"2024-04-01T01:55:50.226492+0000","last_peered":"2024-04-01T01:55:50.226492+0000","last_clean":"2024-04-01T01:55:50.226492+0000","last_became_active":"2024-04-01T01:55:49.262736+0000","last_became_peered":"2024-04-01T01:55:49.262736+0000","last_unstale":"2024-04-01T01:55:50.226492+0000","last_undegraded":"2024-04-01T01:55:50.226492+0000","last_fullsized":"2024-04-01T01:55:50.226492+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:35:14.625545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.225923+0000","last_change":"2024-04-01T01:55:49.248046+0000","last_active":"2024-04-01T01:55:50.225923+0000","last_peered":"2024-04-01T01:55:50.225923+0000","last_clean":"2024-04-01T01:55:50.225923+0000","last_became_active":"2024-04-01T01:55:49.247662+0000","last_became_peered":"2024-04-01T01:55:49.247662+0000","last_unstale":"2024-04-01T01:55:50.225923+0000","last_undegraded":"2024-04-01T01:55:50.225923+0000","last_fullsized":"2024-04-01T01:55:50.225923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:59:26.879090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.226214+0000","last_change":"2024-04-01T01:55:49.250832+0000","last_active":"2024-04-01T01:55:50.226214+0000","last_peered":"2024-04-01T01:55:50.226214+0000","last_clean":"2024-04-01T01:55:50.226214+0000","last_became_active":"2024-04-01T01:55:49.250522+0000","last_became_peered":"2024-04-01T01:55:49.250522+0000","last_unstale":"2024-04-01T01:55:50.226214+0000","last_undegraded":"2024-04-01T01:55:50.226214+0000","last_fullsized":"2024-04-01T01:55:50.226214+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:47:04.592262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.227645+0000","last_change":"2024-04-01T01:55:49.243460+0000","last_active":"2024-04-01T01:55:50.227645+0000","last_peered":"2024-04-01T01:55:50.227645+0000","last_clean":"2024-04-01T01:55:50.227645+0000","last_became_active":"2024-04-01T01:55:49.243017+0000","last_became_peered":"2024-04-01T01:55:49.243017+0000","last_unstale":"2024-04-01T01:55:50.227645+0000","last_undegraded":"2024-04-01T01:55:50.227645+0000","last_fullsized":"2024-04-01T01:55:50.227645+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:20:18.156798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.227405+0000","last_change":"2024-04-01T01:55:49.252043+0000","last_active":"2024-04-01T01:55:50.227405+0000","last_peered":"2024-04-01T01:55:50.227405+0000","last_clean":"2024-04-01T01:55:50.227405+0000","last_became_active":"2024-04-01T01:55:49.251760+0000","last_became_peered":"2024-04-01T01:55:49.251760+0000","last_unstale":"2024-04-01T01:55:50.227405+0000","last_undegraded":"2024-04-01T01:55:50.227405+0000","last_fullsized":"2024-04-01T01:55:50.227405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:12:25.325040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.226757+0000","last_change":"2024-04-01T01:55:48.225145+0000","last_active":"2024-04-01T01:55:50.226757+0000","last_peered":"2024-04-01T01:55:50.226757+0000","last_clean":"2024-04-01T01:55:50.226757+0000","last_became_active":"2024-04-01T01:55:48.224408+0000","last_became_peered":"2024-04-01T01:55:48.224408+0000","last_unstale":"2024-04-01T01:55:50.226757+0000","last_undegraded":"2024-04-01T01:55:50.226757+0000","last_fullsized":"2024-04-01T01:55:50.226757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:41:59.465915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-01T01:55:47.187702+0000","last_change":"2024-04-01T01:55:47.187702+0000","last_active":"2024-04-01T01:55:47.163119+0000","last_peered":"2024-04-01T01:55:47.163119+0000","last_clean":"2024-04-01T01:55:47.163119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:47.187702+0000","last_undegraded":"2024-04-01T01:55:47.187702+0000","last_fullsized":"2024-04-01T01:55:47.187702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:47.163119+0000","last_change":"2024-04-01T01:55:47.163119+0000","last_active":"2024-04-01T01:55:47.163119+0000","last_peered":"2024-04-01T01:55:47.163119+0000","last_clean":"2024-04-01T01:55:47.163119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:47.163119+0000","last_undegraded":"2024-04-01T01:55:47.163119+0000","last_fullsized":"2024-04-01T01:55:47.163119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.227275+0000","last_change":"2024-04-01T01:55:49.246424+0000","last_active":"2024-04-01T01:55:50.227275+0000","last_peered":"2024-04-01T01:55:50.227275+0000","last_clean":"2024-04-01T01:55:50.227275+0000","last_became_active":"2024-04-01T01:55:49.243823+0000","last_became_peered":"2024-04-01T01:55:49.243823+0000","last_unstale":"2024-04-01T01:55:50.227275+0000","last_undegraded":"2024-04-01T01:55:50.227275+0000","last_fullsized":"2024-04-01T01:55:50.227275+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:27:45.663474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-01T01:55:47.187122+0000","last_change":"2024-04-01T01:55:47.187122+0000","last_active":"2024-04-01T01:55:47.163119+0000","last_peered":"2024-04-01T01:55:47.163119+0000","last_clean":"2024-04-01T01:55:47.163119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:47.187122+0000","last_undegraded":"2024-04-01T01:55:47.187122+0000","last_fullsized":"2024-04-01T01:55:47.187122+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-01T01:55:47.187214+0000","last_change":"2024-04-01T01:55:47.187214+0000","last_active":"2024-04-01T01:55:47.163119+0000","last_peered":"2024-04-01T01:55:47.163119+0000","last_clean":"2024-04-01T01:55:47.163119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:47.187214+0000","last_undegraded":"2024-04-01T01:55:47.187214+0000","last_fullsized":"2024-04-01T01:55:47.187214+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-01T01:55:47.182644+0000","last_change":"2024-04-01T01:55:47.182644+0000","last_active":"2024-04-01T01:55:47.163119+0000","last_peered":"2024-04-01T01:55:47.163119+0000","last_clean":"2024-04-01T01:55:47.163119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:47.182644+0000","last_undegraded":"2024-04-01T01:55:47.182644+0000","last_fullsized":"2024-04-01T01:55:47.182644+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.228364+0000","last_change":"2024-04-01T01:55:49.261532+0000","last_active":"2024-04-01T01:55:50.228364+0000","last_peered":"2024-04-01T01:55:50.228364+0000","last_clean":"2024-04-01T01:55:50.228364+0000","last_became_active":"2024-04-01T01:55:49.261260+0000","last_became_peered":"2024-04-01T01:55:49.261260+0000","last_unstale":"2024-04-01T01:55:50.228364+0000","last_undegraded":"2024-04-01T01:55:50.228364+0000","last_fullsized":"2024-04-01T01:55:50.228364+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:30:02.149564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-01T01:55:47.185591+0000","last_change":"2024-04-01T01:55:47.185591+0000","last_active":"2024-04-01T01:55:47.163119+0000","last_peered":"2024-04-01T01:55:47.163119+0000","last_clean":"2024-04-01T01:55:47.163119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:47.185591+0000","last_undegraded":"2024-04-01T01:55:47.185591+0000","last_fullsized":"2024-04-01T01:55:47.185591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-01T01:55:47.178823+0000","last_change":"2024-04-01T01:55:47.178823+0000","last_active":"2024-04-01T01:55:47.163119+0000","last_peered":"2024-04-01T01:55:47.163119+0000","last_clean":"2024-04-01T01:55:47.163119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:47.178823+0000","last_undegraded":"2024-04-01T01:55:47.178823+0000","last_fullsized":"2024-04-01T01:55:47.178823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-01T01:55:47.184193+0000","last_change":"2024-04-01T01:55:47.184193+0000","last_active":"2024-04-01T01:55:47.163119+0000","last_peered":"2024-04-01T01:55:47.163119+0000","last_clean":"2024-04-01T01:55:47.163119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:47.184193+0000","last_undegraded":"2024-04-01T01:55:47.184193+0000","last_fullsized":"2024-04-01T01:55:47.184193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-01T01:55:47.187002+0000","last_change":"2024-04-01T01:55:47.187002+0000","last_active":"2024-04-01T01:55:47.163119+0000","last_peered":"2024-04-01T01:55:47.163119+0000","last_clean":"2024-04-01T01:55:47.163119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:47.187002+0000","last_undegraded":"2024-04-01T01:55:47.187002+0000","last_fullsized":"2024-04-01T01:55:47.187002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-01T01:55:47.182645+0000","last_change":"2024-04-01T01:55:47.182645+0000","last_active":"2024-04-01T01:55:47.163119+0000","last_peered":"2024-04-01T01:55:47.163119+0000","last_clean":"2024-04-01T01:55:47.163119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:47.182645+0000","last_undegraded":"2024-04-01T01:55:47.182645+0000","last_fullsized":"2024-04-01T01:55:47.182645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-01T01:55:47.178156+0000","last_change":"2024-04-01T01:55:47.178156+0000","last_active":"2024-04-01T01:55:47.163119+0000","last_peered":"2024-04-01T01:55:47.163119+0000","last_clean":"2024-04-01T01:55:47.163119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:47.178156+0000","last_undegraded":"2024-04-01T01:55:47.178156+0000","last_fullsized":"2024-04-01T01:55:47.178156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-01T01:55:47.183652+0000","last_change":"2024-04-01T01:55:47.183652+0000","last_active":"2024-04-01T01:55:47.163119+0000","last_peered":"2024-04-01T01:55:47.163119+0000","last_clean":"2024-04-01T01:55:47.163119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:47.183652+0000","last_undegraded":"2024-04-01T01:55:47.183652+0000","last_fullsized":"2024-04-01T01:55:47.183652+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-01T01:55:47.180358+0000","last_change":"2024-04-01T01:55:47.180358+0000","last_active":"2024-04-01T01:55:47.163119+0000","last_peered":"2024-04-01T01:55:47.163119+0000","last_clean":"2024-04-01T01:55:47.163119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:47.180358+0000","last_undegraded":"2024-04-01T01:55:47.180358+0000","last_fullsized":"2024-04-01T01:55:47.180358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.227260+0000","last_change":"2024-04-01T01:55:48.216662+0000","last_active":"2024-04-01T01:55:50.227260+0000","last_peered":"2024-04-01T01:55:50.227260+0000","last_clean":"2024-04-01T01:55:50.227260+0000","last_became_active":"2024-04-01T01:55:48.215852+0000","last_became_peered":"2024-04-01T01:55:48.215852+0000","last_unstale":"2024-04-01T01:55:50.227260+0000","last_undegraded":"2024-04-01T01:55:50.227260+0000","last_fullsized":"2024-04-01T01:55:50.227260+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:25:39.713293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:47.163119+0000","last_change":"2024-04-01T01:55:47.163119+0000","last_active":"2024-04-01T01:55:47.163119+0000","last_peered":"2024-04-01T01:55:47.163119+0000","last_clean":"2024-04-01T01:55:47.163119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:47.163119+0000","last_undegraded":"2024-04-01T01:55:47.163119+0000","last_fullsized":"2024-04-01T01:55:47.163119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":164,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-01T01:55:47.186672+0000","last_change":"2024-04-01T01:55:43.145201+0000","last_active":"2024-04-01T01:55:47.186672+0000","last_peered":"2024-04-01T01:55:47.186672+0000","last_clean":"2024-04-01T01:55:47.186672+0000","last_became_active":"2024-04-01T01:55:43.144882+0000","last_became_peered":"2024-04-01T01:55:43.144882+0000","last_unstale":"2024-04-01T01:55:47.186672+0000","last_undegraded":"2024-04-01T01:55:47.186672+0000","last_fullsized":"2024-04-01T01:55:47.186672+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:42.134502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:42.134502+0000","last_clean_scrub_stamp":"2024-04-01T01:55:42.134502+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:02:26.589535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-01T01:55:47.185243+0000","last_change":"2024-04-01T01:55:47.185243+0000","last_active":"2024-04-01T01:55:47.163119+0000","last_peered":"2024-04-01T01:55:47.163119+0000","last_clean":"2024-04-01T01:55:47.163119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:47.185243+0000","last_undegraded":"2024-04-01T01:55:47.185243+0000","last_fullsized":"2024-04-01T01:55:47.185243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-01T01:55:47.184939+0000","last_change":"2024-04-01T01:55:47.184939+0000","last_active":"2024-04-01T01:55:47.163119+0000","last_peered":"2024-04-01T01:55:47.163119+0000","last_clean":"2024-04-01T01:55:47.163119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:47.184939+0000","last_undegraded":"2024-04-01T01:55:47.184939+0000","last_fullsized":"2024-04-01T01:55:47.184939+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-01T01:55:47.183838+0000","last_change":"2024-04-01T01:55:47.183838+0000","last_active":"2024-04-01T01:55:47.163119+0000","last_peered":"2024-04-01T01:55:47.163119+0000","last_clean":"2024-04-01T01:55:47.163119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:47.183838+0000","last_undegraded":"2024-04-01T01:55:47.183838+0000","last_fullsized":"2024-04-01T01:55:47.183838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.226891+0000","last_change":"2024-04-01T01:55:49.246734+0000","last_active":"2024-04-01T01:55:50.226891+0000","last_peered":"2024-04-01T01:55:50.226891+0000","last_clean":"2024-04-01T01:55:50.226891+0000","last_became_active":"2024-04-01T01:55:49.246152+0000","last_became_peered":"2024-04-01T01:55:49.246152+0000","last_unstale":"2024-04-01T01:55:50.226891+0000","last_undegraded":"2024-04-01T01:55:50.226891+0000","last_fullsized":"2024-04-01T01:55:50.226891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:52:34.992185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-01T01:55:47.185607+0000","last_change":"2024-04-01T01:55:47.185607+0000","last_active":"2024-04-01T01:55:47.163119+0000","last_peered":"2024-04-01T01:55:47.163119+0000","last_clean":"2024-04-01T01:55:47.163119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:47.185607+0000","last_undegraded":"2024-04-01T01:55:47.185607+0000","last_fullsized":"2024-04-01T01:55:47.185607+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.226200+0000","last_change":"2024-04-01T01:55:48.226323+0000","last_active":"2024-04-01T01:55:50.226200+0000","last_peered":"2024-04-01T01:55:50.226200+0000","last_clean":"2024-04-01T01:55:50.226200+0000","last_became_active":"2024-04-01T01:55:48.225487+0000","last_became_peered":"2024-04-01T01:55:48.225487+0000","last_unstale":"2024-04-01T01:55:50.226200+0000","last_undegraded":"2024-04-01T01:55:50.226200+0000","last_fullsized":"2024-04-01T01:55:50.226200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:13:17.832963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-01T01:55:47.185871+0000","last_change":"2024-04-01T01:55:47.185871+0000","last_active":"2024-04-01T01:55:47.163119+0000","last_peered":"2024-04-01T01:55:47.163119+0000","last_clean":"2024-04-01T01:55:47.163119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:47.185871+0000","last_undegraded":"2024-04-01T01:55:47.185871+0000","last_fullsized":"2024-04-01T01:55:47.185871+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-01T01:55:47.178842+0000","last_change":"2024-04-01T01:55:47.178842+0000","last_active":"2024-04-01T01:55:47.163119+0000","last_peered":"2024-04-01T01:55:47.163119+0000","last_clean":"2024-04-01T01:55:47.163119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:47.178842+0000","last_undegraded":"2024-04-01T01:55:47.178842+0000","last_fullsized":"2024-04-01T01:55:47.178842+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-01T01:55:47.185032+0000","last_change":"2024-04-01T01:55:47.185032+0000","last_active":"2024-04-01T01:55:47.163119+0000","last_peered":"2024-04-01T01:55:47.163119+0000","last_clean":"2024-04-01T01:55:47.163119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:47.185032+0000","last_undegraded":"2024-04-01T01:55:47.185032+0000","last_fullsized":"2024-04-01T01:55:47.185032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-01T01:55:47.182623+0000","last_change":"2024-04-01T01:55:47.182623+0000","last_active":"2024-04-01T01:55:47.163119+0000","last_peered":"2024-04-01T01:55:47.163119+0000","last_clean":"2024-04-01T01:55:47.163119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:47.182623+0000","last_undegraded":"2024-04-01T01:55:47.182623+0000","last_fullsized":"2024-04-01T01:55:47.182623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-01T01:55:47.178196+0000","last_change":"2024-04-01T01:55:47.178196+0000","last_active":"2024-04-01T01:55:47.163119+0000","last_peered":"2024-04-01T01:55:47.163119+0000","last_clean":"2024-04-01T01:55:47.163119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:47.178196+0000","last_undegraded":"2024-04-01T01:55:47.178196+0000","last_fullsized":"2024-04-01T01:55:47.178196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:47.163119+0000","last_change":"2024-04-01T01:55:47.163119+0000","last_active":"2024-04-01T01:55:47.163119+0000","last_peered":"2024-04-01T01:55:47.163119+0000","last_clean":"2024-04-01T01:55:47.163119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:47.163119+0000","last_undegraded":"2024-04-01T01:55:47.163119+0000","last_fullsized":"2024-04-01T01:55:47.163119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-01T01:55:47.186538+0000","last_change":"2024-04-01T01:55:47.186538+0000","last_active":"2024-04-01T01:55:47.163119+0000","last_peered":"2024-04-01T01:55:47.163119+0000","last_clean":"2024-04-01T01:55:47.163119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:47.186538+0000","last_undegraded":"2024-04-01T01:55:47.186538+0000","last_fullsized":"2024-04-01T01:55:47.186538+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-01T01:55:47.182944+0000","last_change":"2024-04-01T01:55:47.182944+0000","last_active":"2024-04-01T01:55:47.163119+0000","last_peered":"2024-04-01T01:55:47.163119+0000","last_clean":"2024-04-01T01:55:47.163119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:47.182944+0000","last_undegraded":"2024-04-01T01:55:47.182944+0000","last_fullsized":"2024-04-01T01:55:47.182944+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-01T01:55:47.183022+0000","last_change":"2024-04-01T01:55:47.183022+0000","last_active":"2024-04-01T01:55:47.163119+0000","last_peered":"2024-04-01T01:55:47.163119+0000","last_clean":"2024-04-01T01:55:47.163119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:47.183022+0000","last_undegraded":"2024-04-01T01:55:47.183022+0000","last_fullsized":"2024-04-01T01:55:47.183022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.228017+0000","last_change":"2024-04-01T01:55:49.243377+0000","last_active":"2024-04-01T01:55:50.228017+0000","last_peered":"2024-04-01T01:55:50.228017+0000","last_clean":"2024-04-01T01:55:50.228017+0000","last_became_active":"2024-04-01T01:55:49.242851+0000","last_became_peered":"2024-04-01T01:55:49.242851+0000","last_unstale":"2024-04-01T01:55:50.228017+0000","last_undegraded":"2024-04-01T01:55:50.228017+0000","last_fullsized":"2024-04-01T01:55:50.228017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:48:38.596647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.227487+0000","last_change":"2024-04-01T01:55:48.213862+0000","last_active":"2024-04-01T01:55:50.227487+0000","last_peered":"2024-04-01T01:55:50.227487+0000","last_clean":"2024-04-01T01:55:50.227487+0000","last_became_active":"2024-04-01T01:55:48.213122+0000","last_became_peered":"2024-04-01T01:55:48.213122+0000","last_unstale":"2024-04-01T01:55:50.227487+0000","last_undegraded":"2024-04-01T01:55:50.227487+0000","last_fullsized":"2024-04-01T01:55:50.227487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:59:23.563864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.227575+0000","last_change":"2024-04-01T01:55:49.252273+0000","last_active":"2024-04-01T01:55:50.227575+0000","last_peered":"2024-04-01T01:55:50.227575+0000","last_clean":"2024-04-01T01:55:50.227575+0000","last_became_active":"2024-04-01T01:55:49.251963+0000","last_became_peered":"2024-04-01T01:55:49.251963+0000","last_unstale":"2024-04-01T01:55:50.227575+0000","last_undegraded":"2024-04-01T01:55:50.227575+0000","last_fullsized":"2024-04-01T01:55:50.227575+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:56:18.086766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-01T01:55:47.179994+0000","last_change":"2024-04-01T01:55:47.179994+0000","last_active":"2024-04-01T01:55:47.163119+0000","last_peered":"2024-04-01T01:55:47.163119+0000","last_clean":"2024-04-01T01:55:47.163119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:47.179994+0000","last_undegraded":"2024-04-01T01:55:47.179994+0000","last_fullsized":"2024-04-01T01:55:47.179994+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":1},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":58,"acting":58,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66838,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27188,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":172032,"data_stored":52823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27188,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":172032,"data_stored":52823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509443,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31348,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340492,"statfs":{"total":96636764160,"available":96604663808,"internally_reserved":0,"allocated":172032,"data_stored":52823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31348,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340492,"statfs":{"total":96636764160,"available":96604663808,"internally_reserved":0,"allocated":172032,"data_stored":52823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509444,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31424,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340416,"statfs":{"total":96636764160,"available":96604585984,"internally_reserved":0,"allocated":237568,"data_stored":643191,"data_compressed":33419,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509443,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31348,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340492,"statfs":{"total":96636764160,"available":96604663808,"internally_reserved":0,"allocated":172032,"data_stored":52823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542147,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27176,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":159744,"data_stored":47006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":282624,"data_stored":662633,"data_compressed":33419,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33419,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33419,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-01T01:55:53.679 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-01T01:55:53.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.842+0000 7f4c5af32640 1 Processor -- start 2024-04-01T01:55:53.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.842+0000 7f4c5af32640 1 -- start start 2024-04-01T01:55:53.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.842+0000 7f4c5af32640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4c540c7430 0x7f4c540c7980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:53.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.842+0000 7f4c5af32640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f4c540c7ec0 0x7f4c54161410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:53.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.842+0000 7f4c5af32640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c540c2ed0 con 0x7f4c54150e50 2024-04-01T01:55:53.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.842+0000 7f4c5af32640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f4c540c6f10 con 0x7f4c540c7430 2024-04-01T01:55:53.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.842+0000 7f4c5af32640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f4c540c0e40 con 0x7f4c540c7ec0 2024-04-01T01:55:53.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.842+0000 7f4c53fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4c540c7430 0x7f4c540c7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:53.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.842+0000 7f4c58cce640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f4c54150e50 0x7f4c54072c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.50:33714/0 (socket says 172.21.15.50:33714) 2024-04-01T01:55:53.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.842+0000 7f4c58cce640 1 -- 172.21.15.50:0/2997465636 learned_addr learned my addr 172.21.15.50:0/2997465636 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-04-01T01:55:53.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.842+0000 7f4c594cf640 1 --2- 172.21.15.50:0/2997465636 >> v2:172.21.15.97:3300/0 conn(0x7f4c540c7ec0 0x7f4c54161410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:53.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.842+0000 7f4c53fff640 1 -- 172.21.15.50:0/2997465636 >> v2:172.21.15.97:3300/0 conn(0x7f4c540c7ec0 msgr2=0x7f4c54161410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:55:53.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.842+0000 7f4c53fff640 1 --2- 172.21.15.50:0/2997465636 >> v2:172.21.15.97:3300/0 conn(0x7f4c540c7ec0 0x7f4c54161410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:53.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.842+0000 7f4c53fff640 1 -- 172.21.15.50:0/2997465636 >> v1:172.21.15.97:6789/0 conn(0x7f4c54150e50 legacy=0x7f4c54072c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:53.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.842+0000 7f4c53fff640 1 -- 172.21.15.50:0/2997465636 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c540c1120 con 0x7f4c540c7430 2024-04-01T01:55:53.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.846+0000 7f4c53fff640 1 --2- 172.21.15.50:0/2997465636 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c540c7430 0x7f4c540c7980 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4c5406d250 tx=0x7f4c4801ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10b072ae9db0c4b6 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:53.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.846+0000 7f4c537fe640 1 -- 172.21.15.50:0/2997465636 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c480b5070 con 0x7f4c540c7430 2024-04-01T01:55:53.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.846+0000 7f4c537fe640 1 -- 172.21.15.50:0/2997465636 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c480a8970 con 0x7f4c540c7430 2024-04-01T01:55:53.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.846+0000 7f4c537fe640 1 -- 172.21.15.50:0/2997465636 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c480a8d40 con 0x7f4c540c7430 2024-04-01T01:55:53.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.846+0000 7f4c5af32640 1 -- 172.21.15.50:0/2997465636 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c540c7430 msgr2=0x7f4c540c7980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:53.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.846+0000 7f4c5af32640 1 --2- 172.21.15.50:0/2997465636 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c540c7430 0x7f4c540c7980 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4c5406d250 tx=0x7f4c4801ec70 comp rx=0 tx=0).stop 2024-04-01T01:55:53.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.846+0000 7f4c5af32640 1 -- 172.21.15.50:0/2997465636 shutdown_connections 2024-04-01T01:55:53.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.846+0000 7f4c5af32640 1 --2- 172.21.15.50:0/2997465636 >> v2:172.21.15.97:3300/0 conn(0x7f4c540c7ec0 0x7f4c54161410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:53.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.846+0000 7f4c5af32640 1 --2- 172.21.15.50:0/2997465636 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c540c7430 0x7f4c540c7980 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:53.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.846+0000 7f4c5af32640 1 -- 172.21.15.50:0/2997465636 >> 172.21.15.50:0/2997465636 conn(0x7f4c5406f4d0 msgr2=0x7f4c5406f8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:55:53.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.846+0000 7f4c5af32640 1 -- 172.21.15.50:0/2997465636 shutdown_connections 2024-04-01T01:55:53.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.846+0000 7f4c5af32640 1 -- 172.21.15.50:0/2997465636 wait complete. 2024-04-01T01:55:53.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.846+0000 7f4c5af32640 1 Processor -- start 2024-04-01T01:55:53.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.846+0000 7f4c5af32640 1 -- start start 2024-04-01T01:55:53.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.846+0000 7f4c5af32640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4c540c7430 0x7f4c54145750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:53.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.846+0000 7f4c5af32640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c540c7ec0 0x7f4c541ebec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:53.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.846+0000 7f4c5af32640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4c54150e50 0x7f4c541ec900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:53.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.846+0000 7f4c5af32640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4c540c6ba0 con 0x7f4c540c7ec0 2024-04-01T01:55:53.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.846+0000 7f4c5af32640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f4c540c68c0 con 0x7f4c54150e50 2024-04-01T01:55:53.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.846+0000 7f4c5af32640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f4c54151230 con 0x7f4c540c7430 2024-04-01T01:55:53.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.846+0000 7f4c53fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c540c7ec0 0x7f4c541ebec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:53.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.846+0000 7f4c53fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c540c7ec0 0x7f4c541ebec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55470/0 (socket says 172.21.15.50:55470) 2024-04-01T01:55:53.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.846+0000 7f4c53fff640 1 -- 172.21.15.50:0/2415249647 learned_addr learned my addr 172.21.15.50:0/2415249647 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T01:55:53.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.846+0000 7f4c594cf640 1 --2- 172.21.15.50:0/2415249647 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4c54150e50 0x7f4c541ec900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:53.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.846+0000 7f4c58cce640 1 --2- 172.21.15.50:0/2415249647 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4c540c7430 0x7f4c54145750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:53.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.846+0000 7f4c53fff640 1 -- 172.21.15.50:0/2415249647 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4c540c7430 msgr2=0x7f4c54145750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:53.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.846+0000 7f4c53fff640 1 --2- 172.21.15.50:0/2415249647 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4c540c7430 0x7f4c54145750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:53.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.846+0000 7f4c53fff640 1 -- 172.21.15.50:0/2415249647 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4c54150e50 msgr2=0x7f4c541ec900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:53.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.846+0000 7f4c53fff640 1 --2- 172.21.15.50:0/2415249647 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4c54150e50 0x7f4c541ec900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:53.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.846+0000 7f4c53fff640 1 -- 172.21.15.50:0/2415249647 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c54145c90 con 0x7f4c540c7ec0 2024-04-01T01:55:53.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.846+0000 7f4c594cf640 1 --2- 172.21.15.50:0/2415249647 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4c54150e50 0x7f4c541ec900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T01:55:53.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.850+0000 7f4c53fff640 1 --2- 172.21.15.50:0/2415249647 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c540c7ec0 0x7f4c541ebec0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4c480b3040 tx=0x7f4c4801ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:53.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.850+0000 7f4c517fa640 1 -- 172.21.15.50:0/2415249647 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c480bf070 con 0x7f4c540c7ec0 2024-04-01T01:55:53.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.850+0000 7f4c517fa640 1 -- 172.21.15.50:0/2415249647 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c480b0740 con 0x7f4c540c7ec0 2024-04-01T01:55:53.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.850+0000 7f4c517fa640 1 -- 172.21.15.50:0/2415249647 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c480b5040 con 0x7f4c540c7ec0 2024-04-01T01:55:53.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.850+0000 7f4c5af32640 1 -- 172.21.15.50:0/2415249647 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c541ec400 con 0x7f4c540c7ec0 2024-04-01T01:55:53.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.850+0000 7f4c5af32640 1 -- 172.21.15.50:0/2415249647 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c540c3350 con 0x7f4c540c7ec0 2024-04-01T01:55:53.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.850+0000 7f4c5af32640 1 -- 172.21.15.50:0/2415249647 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c54068940 con 0x7f4c540c7ec0 2024-04-01T01:55:53.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.850+0000 7f4c517fa640 1 -- 172.21.15.50:0/2415249647 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 87103+0+0 (secure 0 0 0) 0x7f4c480b0b30 con 0x7f4c540c7ec0 2024-04-01T01:55:53.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.850+0000 7f4c517fa640 1 --2- 172.21.15.50:0/2415249647 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f4c40067420 0x7f4c400698e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:53.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.850+0000 7f4c517fa640 1 -- 172.21.15.50:0/2415249647 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f4c481220b0 con 0x7f4c540c7ec0 2024-04-01T01:55:53.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.850+0000 7f4c58cce640 1 --2- 172.21.15.50:0/2415249647 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f4c40067420 0x7f4c400698e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:53.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.850+0000 7f4c58cce640 1 --2- 172.21.15.50:0/2415249647 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f4c40067420 0x7f4c400698e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4c4c000f70 tx=0x7f4c4c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:53.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:53.854+0000 7f4c517fa640 1 -- 172.21.15.50:0/2415249647 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+176632 (secure 0 0 0) 0x7f4c480187d0 con 0x7f4c540c7ec0 2024-04-01T01:55:54.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.010+0000 7f4c5af32640 1 -- 172.21.15.50:0/2415249647 --> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4c540c4be0 con 0x7f4c40067420 2024-04-01T01:55:54.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.030+0000 7f4c517fa640 1 -- 172.21.15.50:0/2415249647 <== mgr.4103 v2:172.21.15.97:6832/1677467570 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+241761 (secure 0 0 0) 0x7f4c540c4be0 con 0x7f4c40067420 2024-04-01T01:55:54.033 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-01T01:55:54.035 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-04-01T01:55:54.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.034+0000 7f4c5af32640 1 -- 172.21.15.50:0/2415249647 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f4c40067420 msgr2=0x7f4c400698e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:54.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.034+0000 7f4c5af32640 1 --2- 172.21.15.50:0/2415249647 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f4c40067420 0x7f4c400698e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4c4c000f70 tx=0x7f4c4c009040 comp rx=0 tx=0).stop 2024-04-01T01:55:54.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.034+0000 7f4c5af32640 1 -- 172.21.15.50:0/2415249647 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c540c7ec0 msgr2=0x7f4c541ebec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:54.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.034+0000 7f4c5af32640 1 --2- 172.21.15.50:0/2415249647 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c540c7ec0 0x7f4c541ebec0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4c480b3040 tx=0x7f4c4801ba10 comp rx=0 tx=0).stop 2024-04-01T01:55:54.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.034+0000 7f4c5af32640 1 -- 172.21.15.50:0/2415249647 shutdown_connections 2024-04-01T01:55:54.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.034+0000 7f4c5af32640 1 --2- 172.21.15.50:0/2415249647 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f4c40067420 0x7f4c400698e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:54.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.034+0000 7f4c5af32640 1 --2- 172.21.15.50:0/2415249647 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4c54150e50 0x7f4c541ec900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:54.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.034+0000 7f4c5af32640 1 --2- 172.21.15.50:0/2415249647 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c540c7ec0 0x7f4c541ebec0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:54.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.034+0000 7f4c5af32640 1 --2- 172.21.15.50:0/2415249647 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4c540c7430 0x7f4c54145750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:54.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.034+0000 7f4c5af32640 1 -- 172.21.15.50:0/2415249647 >> 172.21.15.50:0/2415249647 conn(0x7f4c5406f4d0 msgr2=0x7f4c541478b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:55:54.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.034+0000 7f4c5af32640 1 -- 172.21.15.50:0/2415249647 shutdown_connections 2024-04-01T01:55:54.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.034+0000 7f4c5af32640 1 -- 172.21.15.50:0/2415249647 wait complete. 2024-04-01T01:55:54.052 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-04-01T01:55:52.063406+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590438,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":160,"num_write_kb":2417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":84,"acting":84,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":44,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":234324,"kb_used_data":1504,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754740396,"statfs":{"total":773094113280,"available":772854165504,"internally_reserved":0,"allocated":1540096,"data_stored":1616945,"data_compressed":66838,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.885246"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.227142+0000","last_change":"2024-04-01T01:55:49.247181+0000","last_active":"2024-04-01T01:55:50.227142+0000","last_peered":"2024-04-01T01:55:50.227142+0000","last_clean":"2024-04-01T01:55:50.227142+0000","last_became_active":"2024-04-01T01:55:49.246660+0000","last_became_peered":"2024-04-01T01:55:49.246660+0000","last_unstale":"2024-04-01T01:55:50.227142+0000","last_undegraded":"2024-04-01T01:55:50.227142+0000","last_fullsized":"2024-04-01T01:55:50.227142+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:27:12.089520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.226983+0000","last_change":"2024-04-01T01:55:49.240347+0000","last_active":"2024-04-01T01:55:50.226983+0000","last_peered":"2024-04-01T01:55:50.226983+0000","last_clean":"2024-04-01T01:55:50.226983+0000","last_became_active":"2024-04-01T01:55:49.239904+0000","last_became_peered":"2024-04-01T01:55:49.239904+0000","last_unstale":"2024-04-01T01:55:50.226983+0000","last_undegraded":"2024-04-01T01:55:50.226983+0000","last_fullsized":"2024-04-01T01:55:50.226983+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:37:43.280869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.226492+0000","last_change":"2024-04-01T01:55:49.262994+0000","last_active":"2024-04-01T01:55:50.226492+0000","last_peered":"2024-04-01T01:55:50.226492+0000","last_clean":"2024-04-01T01:55:50.226492+0000","last_became_active":"2024-04-01T01:55:49.262736+0000","last_became_peered":"2024-04-01T01:55:49.262736+0000","last_unstale":"2024-04-01T01:55:50.226492+0000","last_undegraded":"2024-04-01T01:55:50.226492+0000","last_fullsized":"2024-04-01T01:55:50.226492+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:35:14.625545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.225923+0000","last_change":"2024-04-01T01:55:49.248046+0000","last_active":"2024-04-01T01:55:50.225923+0000","last_peered":"2024-04-01T01:55:50.225923+0000","last_clean":"2024-04-01T01:55:50.225923+0000","last_became_active":"2024-04-01T01:55:49.247662+0000","last_became_peered":"2024-04-01T01:55:49.247662+0000","last_unstale":"2024-04-01T01:55:50.225923+0000","last_undegraded":"2024-04-01T01:55:50.225923+0000","last_fullsized":"2024-04-01T01:55:50.225923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:59:26.879090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.226214+0000","last_change":"2024-04-01T01:55:49.250832+0000","last_active":"2024-04-01T01:55:50.226214+0000","last_peered":"2024-04-01T01:55:50.226214+0000","last_clean":"2024-04-01T01:55:50.226214+0000","last_became_active":"2024-04-01T01:55:49.250522+0000","last_became_peered":"2024-04-01T01:55:49.250522+0000","last_unstale":"2024-04-01T01:55:50.226214+0000","last_undegraded":"2024-04-01T01:55:50.226214+0000","last_fullsized":"2024-04-01T01:55:50.226214+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:47:04.592262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.227645+0000","last_change":"2024-04-01T01:55:49.243460+0000","last_active":"2024-04-01T01:55:50.227645+0000","last_peered":"2024-04-01T01:55:50.227645+0000","last_clean":"2024-04-01T01:55:50.227645+0000","last_became_active":"2024-04-01T01:55:49.243017+0000","last_became_peered":"2024-04-01T01:55:49.243017+0000","last_unstale":"2024-04-01T01:55:50.227645+0000","last_undegraded":"2024-04-01T01:55:50.227645+0000","last_fullsized":"2024-04-01T01:55:50.227645+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:20:18.156798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.227405+0000","last_change":"2024-04-01T01:55:49.252043+0000","last_active":"2024-04-01T01:55:50.227405+0000","last_peered":"2024-04-01T01:55:50.227405+0000","last_clean":"2024-04-01T01:55:50.227405+0000","last_became_active":"2024-04-01T01:55:49.251760+0000","last_became_peered":"2024-04-01T01:55:49.251760+0000","last_unstale":"2024-04-01T01:55:50.227405+0000","last_undegraded":"2024-04-01T01:55:50.227405+0000","last_fullsized":"2024-04-01T01:55:50.227405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:12:25.325040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.226757+0000","last_change":"2024-04-01T01:55:48.225145+0000","last_active":"2024-04-01T01:55:50.226757+0000","last_peered":"2024-04-01T01:55:50.226757+0000","last_clean":"2024-04-01T01:55:50.226757+0000","last_became_active":"2024-04-01T01:55:48.224408+0000","last_became_peered":"2024-04-01T01:55:48.224408+0000","last_unstale":"2024-04-01T01:55:50.226757+0000","last_undegraded":"2024-04-01T01:55:50.226757+0000","last_fullsized":"2024-04-01T01:55:50.226757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:41:59.465915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-01T01:55:47.187702+0000","last_change":"2024-04-01T01:55:47.187702+0000","last_active":"2024-04-01T01:55:47.163119+0000","last_peered":"2024-04-01T01:55:47.163119+0000","last_clean":"2024-04-01T01:55:47.163119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:47.187702+0000","last_undegraded":"2024-04-01T01:55:47.187702+0000","last_fullsized":"2024-04-01T01:55:47.187702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:47.163119+0000","last_change":"2024-04-01T01:55:47.163119+0000","last_active":"2024-04-01T01:55:47.163119+0000","last_peered":"2024-04-01T01:55:47.163119+0000","last_clean":"2024-04-01T01:55:47.163119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:47.163119+0000","last_undegraded":"2024-04-01T01:55:47.163119+0000","last_fullsized":"2024-04-01T01:55:47.163119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.227275+0000","last_change":"2024-04-01T01:55:49.246424+0000","last_active":"2024-04-01T01:55:50.227275+0000","last_peered":"2024-04-01T01:55:50.227275+0000","last_clean":"2024-04-01T01:55:50.227275+0000","last_became_active":"2024-04-01T01:55:49.243823+0000","last_became_peered":"2024-04-01T01:55:49.243823+0000","last_unstale":"2024-04-01T01:55:50.227275+0000","last_undegraded":"2024-04-01T01:55:50.227275+0000","last_fullsized":"2024-04-01T01:55:50.227275+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:27:45.663474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-01T01:55:47.187122+0000","last_change":"2024-04-01T01:55:47.187122+0000","last_active":"2024-04-01T01:55:47.163119+0000","last_peered":"2024-04-01T01:55:47.163119+0000","last_clean":"2024-04-01T01:55:47.163119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:47.187122+0000","last_undegraded":"2024-04-01T01:55:47.187122+0000","last_fullsized":"2024-04-01T01:55:47.187122+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-01T01:55:47.187214+0000","last_change":"2024-04-01T01:55:47.187214+0000","last_active":"2024-04-01T01:55:47.163119+0000","last_peered":"2024-04-01T01:55:47.163119+0000","last_clean":"2024-04-01T01:55:47.163119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:47.187214+0000","last_undegraded":"2024-04-01T01:55:47.187214+0000","last_fullsized":"2024-04-01T01:55:47.187214+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-01T01:55:47.182644+0000","last_change":"2024-04-01T01:55:47.182644+0000","last_active":"2024-04-01T01:55:47.163119+0000","last_peered":"2024-04-01T01:55:47.163119+0000","last_clean":"2024-04-01T01:55:47.163119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:47.182644+0000","last_undegraded":"2024-04-01T01:55:47.182644+0000","last_fullsized":"2024-04-01T01:55:47.182644+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.228364+0000","last_change":"2024-04-01T01:55:49.261532+0000","last_active":"2024-04-01T01:55:50.228364+0000","last_peered":"2024-04-01T01:55:50.228364+0000","last_clean":"2024-04-01T01:55:50.228364+0000","last_became_active":"2024-04-01T01:55:49.261260+0000","last_became_peered":"2024-04-01T01:55:49.261260+0000","last_unstale":"2024-04-01T01:55:50.228364+0000","last_undegraded":"2024-04-01T01:55:50.228364+0000","last_fullsized":"2024-04-01T01:55:50.228364+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:30:02.149564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-01T01:55:47.185591+0000","last_change":"2024-04-01T01:55:47.185591+0000","last_active":"2024-04-01T01:55:47.163119+0000","last_peered":"2024-04-01T01:55:47.163119+0000","last_clean":"2024-04-01T01:55:47.163119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:47.185591+0000","last_undegraded":"2024-04-01T01:55:47.185591+0000","last_fullsized":"2024-04-01T01:55:47.185591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-01T01:55:47.178823+0000","last_change":"2024-04-01T01:55:47.178823+0000","last_active":"2024-04-01T01:55:47.163119+0000","last_peered":"2024-04-01T01:55:47.163119+0000","last_clean":"2024-04-01T01:55:47.163119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:47.178823+0000","last_undegraded":"2024-04-01T01:55:47.178823+0000","last_fullsized":"2024-04-01T01:55:47.178823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-01T01:55:47.184193+0000","last_change":"2024-04-01T01:55:47.184193+0000","last_active":"2024-04-01T01:55:47.163119+0000","last_peered":"2024-04-01T01:55:47.163119+0000","last_clean":"2024-04-01T01:55:47.163119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:47.184193+0000","last_undegraded":"2024-04-01T01:55:47.184193+0000","last_fullsized":"2024-04-01T01:55:47.184193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-01T01:55:47.187002+0000","last_change":"2024-04-01T01:55:47.187002+0000","last_active":"2024-04-01T01:55:47.163119+0000","last_peered":"2024-04-01T01:55:47.163119+0000","last_clean":"2024-04-01T01:55:47.163119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:47.187002+0000","last_undegraded":"2024-04-01T01:55:47.187002+0000","last_fullsized":"2024-04-01T01:55:47.187002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-01T01:55:47.182645+0000","last_change":"2024-04-01T01:55:47.182645+0000","last_active":"2024-04-01T01:55:47.163119+0000","last_peered":"2024-04-01T01:55:47.163119+0000","last_clean":"2024-04-01T01:55:47.163119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:47.182645+0000","last_undegraded":"2024-04-01T01:55:47.182645+0000","last_fullsized":"2024-04-01T01:55:47.182645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-01T01:55:47.178156+0000","last_change":"2024-04-01T01:55:47.178156+0000","last_active":"2024-04-01T01:55:47.163119+0000","last_peered":"2024-04-01T01:55:47.163119+0000","last_clean":"2024-04-01T01:55:47.163119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:47.178156+0000","last_undegraded":"2024-04-01T01:55:47.178156+0000","last_fullsized":"2024-04-01T01:55:47.178156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-01T01:55:47.183652+0000","last_change":"2024-04-01T01:55:47.183652+0000","last_active":"2024-04-01T01:55:47.163119+0000","last_peered":"2024-04-01T01:55:47.163119+0000","last_clean":"2024-04-01T01:55:47.163119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:47.183652+0000","last_undegraded":"2024-04-01T01:55:47.183652+0000","last_fullsized":"2024-04-01T01:55:47.183652+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-01T01:55:47.180358+0000","last_change":"2024-04-01T01:55:47.180358+0000","last_active":"2024-04-01T01:55:47.163119+0000","last_peered":"2024-04-01T01:55:47.163119+0000","last_clean":"2024-04-01T01:55:47.163119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:47.180358+0000","last_undegraded":"2024-04-01T01:55:47.180358+0000","last_fullsized":"2024-04-01T01:55:47.180358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.227260+0000","last_change":"2024-04-01T01:55:48.216662+0000","last_active":"2024-04-01T01:55:50.227260+0000","last_peered":"2024-04-01T01:55:50.227260+0000","last_clean":"2024-04-01T01:55:50.227260+0000","last_became_active":"2024-04-01T01:55:48.215852+0000","last_became_peered":"2024-04-01T01:55:48.215852+0000","last_unstale":"2024-04-01T01:55:50.227260+0000","last_undegraded":"2024-04-01T01:55:50.227260+0000","last_fullsized":"2024-04-01T01:55:50.227260+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:25:39.713293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:47.163119+0000","last_change":"2024-04-01T01:55:47.163119+0000","last_active":"2024-04-01T01:55:47.163119+0000","last_peered":"2024-04-01T01:55:47.163119+0000","last_clean":"2024-04-01T01:55:47.163119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:47.163119+0000","last_undegraded":"2024-04-01T01:55:47.163119+0000","last_fullsized":"2024-04-01T01:55:47.163119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":164,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-01T01:55:47.186672+0000","last_change":"2024-04-01T01:55:43.145201+0000","last_active":"2024-04-01T01:55:47.186672+0000","last_peered":"2024-04-01T01:55:47.186672+0000","last_clean":"2024-04-01T01:55:47.186672+0000","last_became_active":"2024-04-01T01:55:43.144882+0000","last_became_peered":"2024-04-01T01:55:43.144882+0000","last_unstale":"2024-04-01T01:55:47.186672+0000","last_undegraded":"2024-04-01T01:55:47.186672+0000","last_fullsized":"2024-04-01T01:55:47.186672+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:42.134502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:42.134502+0000","last_clean_scrub_stamp":"2024-04-01T01:55:42.134502+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:02:26.589535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-01T01:55:47.185243+0000","last_change":"2024-04-01T01:55:47.185243+0000","last_active":"2024-04-01T01:55:47.163119+0000","last_peered":"2024-04-01T01:55:47.163119+0000","last_clean":"2024-04-01T01:55:47.163119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:47.185243+0000","last_undegraded":"2024-04-01T01:55:47.185243+0000","last_fullsized":"2024-04-01T01:55:47.185243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-01T01:55:47.184939+0000","last_change":"2024-04-01T01:55:47.184939+0000","last_active":"2024-04-01T01:55:47.163119+0000","last_peered":"2024-04-01T01:55:47.163119+0000","last_clean":"2024-04-01T01:55:47.163119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:47.184939+0000","last_undegraded":"2024-04-01T01:55:47.184939+0000","last_fullsized":"2024-04-01T01:55:47.184939+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-01T01:55:47.183838+0000","last_change":"2024-04-01T01:55:47.183838+0000","last_active":"2024-04-01T01:55:47.163119+0000","last_peered":"2024-04-01T01:55:47.163119+0000","last_clean":"2024-04-01T01:55:47.163119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:47.183838+0000","last_undegraded":"2024-04-01T01:55:47.183838+0000","last_fullsized":"2024-04-01T01:55:47.183838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.226891+0000","last_change":"2024-04-01T01:55:49.246734+0000","last_active":"2024-04-01T01:55:50.226891+0000","last_peered":"2024-04-01T01:55:50.226891+0000","last_clean":"2024-04-01T01:55:50.226891+0000","last_became_active":"2024-04-01T01:55:49.246152+0000","last_became_peered":"2024-04-01T01:55:49.246152+0000","last_unstale":"2024-04-01T01:55:50.226891+0000","last_undegraded":"2024-04-01T01:55:50.226891+0000","last_fullsized":"2024-04-01T01:55:50.226891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:52:34.992185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-01T01:55:47.185607+0000","last_change":"2024-04-01T01:55:47.185607+0000","last_active":"2024-04-01T01:55:47.163119+0000","last_peered":"2024-04-01T01:55:47.163119+0000","last_clean":"2024-04-01T01:55:47.163119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:47.185607+0000","last_undegraded":"2024-04-01T01:55:47.185607+0000","last_fullsized":"2024-04-01T01:55:47.185607+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.226200+0000","last_change":"2024-04-01T01:55:48.226323+0000","last_active":"2024-04-01T01:55:50.226200+0000","last_peered":"2024-04-01T01:55:50.226200+0000","last_clean":"2024-04-01T01:55:50.226200+0000","last_became_active":"2024-04-01T01:55:48.225487+0000","last_became_peered":"2024-04-01T01:55:48.225487+0000","last_unstale":"2024-04-01T01:55:50.226200+0000","last_undegraded":"2024-04-01T01:55:50.226200+0000","last_fullsized":"2024-04-01T01:55:50.226200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:13:17.832963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-01T01:55:47.185871+0000","last_change":"2024-04-01T01:55:47.185871+0000","last_active":"2024-04-01T01:55:47.163119+0000","last_peered":"2024-04-01T01:55:47.163119+0000","last_clean":"2024-04-01T01:55:47.163119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:47.185871+0000","last_undegraded":"2024-04-01T01:55:47.185871+0000","last_fullsized":"2024-04-01T01:55:47.185871+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-01T01:55:47.178842+0000","last_change":"2024-04-01T01:55:47.178842+0000","last_active":"2024-04-01T01:55:47.163119+0000","last_peered":"2024-04-01T01:55:47.163119+0000","last_clean":"2024-04-01T01:55:47.163119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:47.178842+0000","last_undegraded":"2024-04-01T01:55:47.178842+0000","last_fullsized":"2024-04-01T01:55:47.178842+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-01T01:55:47.185032+0000","last_change":"2024-04-01T01:55:47.185032+0000","last_active":"2024-04-01T01:55:47.163119+0000","last_peered":"2024-04-01T01:55:47.163119+0000","last_clean":"2024-04-01T01:55:47.163119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:47.185032+0000","last_undegraded":"2024-04-01T01:55:47.185032+0000","last_fullsized":"2024-04-01T01:55:47.185032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-01T01:55:47.182623+0000","last_change":"2024-04-01T01:55:47.182623+0000","last_active":"2024-04-01T01:55:47.163119+0000","last_peered":"2024-04-01T01:55:47.163119+0000","last_clean":"2024-04-01T01:55:47.163119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:47.182623+0000","last_undegraded":"2024-04-01T01:55:47.182623+0000","last_fullsized":"2024-04-01T01:55:47.182623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-01T01:55:47.178196+0000","last_change":"2024-04-01T01:55:47.178196+0000","last_active":"2024-04-01T01:55:47.163119+0000","last_peered":"2024-04-01T01:55:47.163119+0000","last_clean":"2024-04-01T01:55:47.163119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:47.178196+0000","last_undegraded":"2024-04-01T01:55:47.178196+0000","last_fullsized":"2024-04-01T01:55:47.178196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:47.163119+0000","last_change":"2024-04-01T01:55:47.163119+0000","last_active":"2024-04-01T01:55:47.163119+0000","last_peered":"2024-04-01T01:55:47.163119+0000","last_clean":"2024-04-01T01:55:47.163119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:47.163119+0000","last_undegraded":"2024-04-01T01:55:47.163119+0000","last_fullsized":"2024-04-01T01:55:47.163119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-01T01:55:47.186538+0000","last_change":"2024-04-01T01:55:47.186538+0000","last_active":"2024-04-01T01:55:47.163119+0000","last_peered":"2024-04-01T01:55:47.163119+0000","last_clean":"2024-04-01T01:55:47.163119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:47.186538+0000","last_undegraded":"2024-04-01T01:55:47.186538+0000","last_fullsized":"2024-04-01T01:55:47.186538+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-01T01:55:47.182944+0000","last_change":"2024-04-01T01:55:47.182944+0000","last_active":"2024-04-01T01:55:47.163119+0000","last_peered":"2024-04-01T01:55:47.163119+0000","last_clean":"2024-04-01T01:55:47.163119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:47.182944+0000","last_undegraded":"2024-04-01T01:55:47.182944+0000","last_fullsized":"2024-04-01T01:55:47.182944+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-01T01:55:48.172901+0000","last_change":"2024-04-01T01:55:48.172901+0000","last_active":"2024-04-01T01:55:48.172901+0000","last_peered":"2024-04-01T01:55:48.172901+0000","last_clean":"2024-04-01T01:55:48.172901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:48.172901+0000","last_undegraded":"2024-04-01T01:55:48.172901+0000","last_fullsized":"2024-04-01T01:55:48.172901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-01T01:55:47.183022+0000","last_change":"2024-04-01T01:55:47.183022+0000","last_active":"2024-04-01T01:55:47.163119+0000","last_peered":"2024-04-01T01:55:47.163119+0000","last_clean":"2024-04-01T01:55:47.163119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:47.183022+0000","last_undegraded":"2024-04-01T01:55:47.183022+0000","last_fullsized":"2024-04-01T01:55:47.183022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.228017+0000","last_change":"2024-04-01T01:55:49.243377+0000","last_active":"2024-04-01T01:55:50.228017+0000","last_peered":"2024-04-01T01:55:50.228017+0000","last_clean":"2024-04-01T01:55:50.228017+0000","last_became_active":"2024-04-01T01:55:49.242851+0000","last_became_peered":"2024-04-01T01:55:49.242851+0000","last_unstale":"2024-04-01T01:55:50.228017+0000","last_undegraded":"2024-04-01T01:55:50.228017+0000","last_fullsized":"2024-04-01T01:55:50.228017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:48:38.596647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.227487+0000","last_change":"2024-04-01T01:55:48.213862+0000","last_active":"2024-04-01T01:55:50.227487+0000","last_peered":"2024-04-01T01:55:50.227487+0000","last_clean":"2024-04-01T01:55:50.227487+0000","last_became_active":"2024-04-01T01:55:48.213122+0000","last_became_peered":"2024-04-01T01:55:48.213122+0000","last_unstale":"2024-04-01T01:55:50.227487+0000","last_undegraded":"2024-04-01T01:55:50.227487+0000","last_fullsized":"2024-04-01T01:55:50.227487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:59:23.563864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.227575+0000","last_change":"2024-04-01T01:55:49.252273+0000","last_active":"2024-04-01T01:55:50.227575+0000","last_peered":"2024-04-01T01:55:50.227575+0000","last_clean":"2024-04-01T01:55:50.227575+0000","last_became_active":"2024-04-01T01:55:49.251963+0000","last_became_peered":"2024-04-01T01:55:49.251963+0000","last_unstale":"2024-04-01T01:55:50.227575+0000","last_undegraded":"2024-04-01T01:55:50.227575+0000","last_fullsized":"2024-04-01T01:55:50.227575+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:56:18.086766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-01T01:55:47.179994+0000","last_change":"2024-04-01T01:55:47.179994+0000","last_active":"2024-04-01T01:55:47.163119+0000","last_peered":"2024-04-01T01:55:47.163119+0000","last_clean":"2024-04-01T01:55:47.163119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T01:55:47.179994+0000","last_undegraded":"2024-04-01T01:55:47.179994+0000","last_fullsized":"2024-04-01T01:55:47.179994+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":1},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":58,"acting":58,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66838,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27188,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":172032,"data_stored":52823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27188,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":172032,"data_stored":52823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509443,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31348,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340492,"statfs":{"total":96636764160,"available":96604663808,"internally_reserved":0,"allocated":172032,"data_stored":52823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31348,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340492,"statfs":{"total":96636764160,"available":96604663808,"internally_reserved":0,"allocated":172032,"data_stored":52823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509444,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31424,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340416,"statfs":{"total":96636764160,"available":96604585984,"internally_reserved":0,"allocated":237568,"data_stored":643191,"data_compressed":33419,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509443,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31348,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340492,"statfs":{"total":96636764160,"available":96604663808,"internally_reserved":0,"allocated":172032,"data_stored":52823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542147,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27176,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":159744,"data_stored":47006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":282624,"data_stored":662633,"data_compressed":33419,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33419,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33419,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-01T01:55:54.056 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3f is not active+clean 2024-04-01T01:55:54.056 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-01T01:55:48.172901+0000', 'last_change': '2024-04-01T01:55:48.172901+0000', 'last_active': '2024-04-01T01:55:48.172901+0000', 'last_peered': '2024-04-01T01:55:48.172901+0000', 'last_clean': '2024-04-01T01:55:48.172901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-01T01:55:48.172901+0000', 'last_undegraded': '2024-04-01T01:55:48.172901+0000', 'last_fullsized': '2024-04-01T01:55:48.172901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'last_clean_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-01T01:55:54.056 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3c is not active+clean 2024-04-01T01:55:54.056 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-01T01:55:48.172901+0000', 'last_change': '2024-04-01T01:55:48.172901+0000', 'last_active': '2024-04-01T01:55:48.172901+0000', 'last_peered': '2024-04-01T01:55:48.172901+0000', 'last_clean': '2024-04-01T01:55:48.172901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-01T01:55:48.172901+0000', 'last_undegraded': '2024-04-01T01:55:48.172901+0000', 'last_fullsized': '2024-04-01T01:55:48.172901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'last_clean_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-01T01:55:54.056 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3b is not active+clean 2024-04-01T01:55:54.056 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-01T01:55:48.172901+0000', 'last_change': '2024-04-01T01:55:48.172901+0000', 'last_active': '2024-04-01T01:55:48.172901+0000', 'last_peered': '2024-04-01T01:55:48.172901+0000', 'last_clean': '2024-04-01T01:55:48.172901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-01T01:55:48.172901+0000', 'last_undegraded': '2024-04-01T01:55:48.172901+0000', 'last_fullsized': '2024-04-01T01:55:48.172901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'last_clean_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-01T01:55:54.056 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3a is not active+clean 2024-04-01T01:55:54.056 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-01T01:55:48.172901+0000', 'last_change': '2024-04-01T01:55:48.172901+0000', 'last_active': '2024-04-01T01:55:48.172901+0000', 'last_peered': '2024-04-01T01:55:48.172901+0000', 'last_clean': '2024-04-01T01:55:48.172901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-01T01:55:48.172901+0000', 'last_undegraded': '2024-04-01T01:55:48.172901+0000', 'last_fullsized': '2024-04-01T01:55:48.172901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'last_clean_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-01T01:55:54.056 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.39 is not active+clean 2024-04-01T01:55:54.056 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-01T01:55:48.172901+0000', 'last_change': '2024-04-01T01:55:48.172901+0000', 'last_active': '2024-04-01T01:55:48.172901+0000', 'last_peered': '2024-04-01T01:55:48.172901+0000', 'last_clean': '2024-04-01T01:55:48.172901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-01T01:55:48.172901+0000', 'last_undegraded': '2024-04-01T01:55:48.172901+0000', 'last_fullsized': '2024-04-01T01:55:48.172901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'last_clean_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-01T01:55:54.057 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.37 is not active+clean 2024-04-01T01:55:54.057 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-01T01:55:48.172901+0000', 'last_change': '2024-04-01T01:55:48.172901+0000', 'last_active': '2024-04-01T01:55:48.172901+0000', 'last_peered': '2024-04-01T01:55:48.172901+0000', 'last_clean': '2024-04-01T01:55:48.172901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-01T01:55:48.172901+0000', 'last_undegraded': '2024-04-01T01:55:48.172901+0000', 'last_fullsized': '2024-04-01T01:55:48.172901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'last_clean_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-01T01:55:54.058 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.36 is not active+clean 2024-04-01T01:55:54.058 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-01T01:55:48.172901+0000', 'last_change': '2024-04-01T01:55:48.172901+0000', 'last_active': '2024-04-01T01:55:48.172901+0000', 'last_peered': '2024-04-01T01:55:48.172901+0000', 'last_clean': '2024-04-01T01:55:48.172901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-01T01:55:48.172901+0000', 'last_undegraded': '2024-04-01T01:55:48.172901+0000', 'last_fullsized': '2024-04-01T01:55:48.172901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'last_clean_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-01T01:55:54.058 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.35 is not active+clean 2024-04-01T01:55:54.058 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-01T01:55:48.172901+0000', 'last_change': '2024-04-01T01:55:48.172901+0000', 'last_active': '2024-04-01T01:55:48.172901+0000', 'last_peered': '2024-04-01T01:55:48.172901+0000', 'last_clean': '2024-04-01T01:55:48.172901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-01T01:55:48.172901+0000', 'last_undegraded': '2024-04-01T01:55:48.172901+0000', 'last_fullsized': '2024-04-01T01:55:48.172901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'last_clean_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-01T01:55:54.058 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.34 is not active+clean 2024-04-01T01:55:54.058 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-01T01:55:48.172901+0000', 'last_change': '2024-04-01T01:55:48.172901+0000', 'last_active': '2024-04-01T01:55:48.172901+0000', 'last_peered': '2024-04-01T01:55:48.172901+0000', 'last_clean': '2024-04-01T01:55:48.172901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-01T01:55:48.172901+0000', 'last_undegraded': '2024-04-01T01:55:48.172901+0000', 'last_fullsized': '2024-04-01T01:55:48.172901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'last_clean_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-01T01:55:54.058 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.33 is not active+clean 2024-04-01T01:55:54.058 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-01T01:55:48.172901+0000', 'last_change': '2024-04-01T01:55:48.172901+0000', 'last_active': '2024-04-01T01:55:48.172901+0000', 'last_peered': '2024-04-01T01:55:48.172901+0000', 'last_clean': '2024-04-01T01:55:48.172901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-01T01:55:48.172901+0000', 'last_undegraded': '2024-04-01T01:55:48.172901+0000', 'last_fullsized': '2024-04-01T01:55:48.172901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'last_clean_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-01T01:55:54.058 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.32 is not active+clean 2024-04-01T01:55:54.058 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-01T01:55:48.172901+0000', 'last_change': '2024-04-01T01:55:48.172901+0000', 'last_active': '2024-04-01T01:55:48.172901+0000', 'last_peered': '2024-04-01T01:55:48.172901+0000', 'last_clean': '2024-04-01T01:55:48.172901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-01T01:55:48.172901+0000', 'last_undegraded': '2024-04-01T01:55:48.172901+0000', 'last_fullsized': '2024-04-01T01:55:48.172901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'last_clean_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-01T01:55:54.059 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.30 is not active+clean 2024-04-01T01:55:54.059 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-01T01:55:48.172901+0000', 'last_change': '2024-04-01T01:55:48.172901+0000', 'last_active': '2024-04-01T01:55:48.172901+0000', 'last_peered': '2024-04-01T01:55:48.172901+0000', 'last_clean': '2024-04-01T01:55:48.172901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-01T01:55:48.172901+0000', 'last_undegraded': '2024-04-01T01:55:48.172901+0000', 'last_fullsized': '2024-04-01T01:55:48.172901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'last_clean_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-01T01:55:54.059 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2f is not active+clean 2024-04-01T01:55:54.059 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-01T01:55:48.172901+0000', 'last_change': '2024-04-01T01:55:48.172901+0000', 'last_active': '2024-04-01T01:55:48.172901+0000', 'last_peered': '2024-04-01T01:55:48.172901+0000', 'last_clean': '2024-04-01T01:55:48.172901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-01T01:55:48.172901+0000', 'last_undegraded': '2024-04-01T01:55:48.172901+0000', 'last_fullsized': '2024-04-01T01:55:48.172901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'last_clean_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-01T01:55:54.059 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2e is not active+clean 2024-04-01T01:55:54.059 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-01T01:55:48.172901+0000', 'last_change': '2024-04-01T01:55:48.172901+0000', 'last_active': '2024-04-01T01:55:48.172901+0000', 'last_peered': '2024-04-01T01:55:48.172901+0000', 'last_clean': '2024-04-01T01:55:48.172901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-01T01:55:48.172901+0000', 'last_undegraded': '2024-04-01T01:55:48.172901+0000', 'last_fullsized': '2024-04-01T01:55:48.172901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'last_clean_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-01T01:55:54.059 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2d is not active+clean 2024-04-01T01:55:54.059 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-01T01:55:48.172901+0000', 'last_change': '2024-04-01T01:55:48.172901+0000', 'last_active': '2024-04-01T01:55:48.172901+0000', 'last_peered': '2024-04-01T01:55:48.172901+0000', 'last_clean': '2024-04-01T01:55:48.172901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-01T01:55:48.172901+0000', 'last_undegraded': '2024-04-01T01:55:48.172901+0000', 'last_fullsized': '2024-04-01T01:55:48.172901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'last_clean_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-01T01:55:54.059 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2c is not active+clean 2024-04-01T01:55:54.059 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-01T01:55:48.172901+0000', 'last_change': '2024-04-01T01:55:48.172901+0000', 'last_active': '2024-04-01T01:55:48.172901+0000', 'last_peered': '2024-04-01T01:55:48.172901+0000', 'last_clean': '2024-04-01T01:55:48.172901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-01T01:55:48.172901+0000', 'last_undegraded': '2024-04-01T01:55:48.172901+0000', 'last_fullsized': '2024-04-01T01:55:48.172901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'last_clean_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-01T01:55:54.059 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2b is not active+clean 2024-04-01T01:55:54.060 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-01T01:55:48.172901+0000', 'last_change': '2024-04-01T01:55:48.172901+0000', 'last_active': '2024-04-01T01:55:48.172901+0000', 'last_peered': '2024-04-01T01:55:48.172901+0000', 'last_clean': '2024-04-01T01:55:48.172901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-01T01:55:48.172901+0000', 'last_undegraded': '2024-04-01T01:55:48.172901+0000', 'last_fullsized': '2024-04-01T01:55:48.172901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'last_clean_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-01T01:55:54.060 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2a is not active+clean 2024-04-01T01:55:54.060 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-01T01:55:48.172901+0000', 'last_change': '2024-04-01T01:55:48.172901+0000', 'last_active': '2024-04-01T01:55:48.172901+0000', 'last_peered': '2024-04-01T01:55:48.172901+0000', 'last_clean': '2024-04-01T01:55:48.172901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-01T01:55:48.172901+0000', 'last_undegraded': '2024-04-01T01:55:48.172901+0000', 'last_fullsized': '2024-04-01T01:55:48.172901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'last_clean_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-01T01:55:54.060 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.28 is not active+clean 2024-04-01T01:55:54.060 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-01T01:55:48.172901+0000', 'last_change': '2024-04-01T01:55:48.172901+0000', 'last_active': '2024-04-01T01:55:48.172901+0000', 'last_peered': '2024-04-01T01:55:48.172901+0000', 'last_clean': '2024-04-01T01:55:48.172901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-01T01:55:48.172901+0000', 'last_undegraded': '2024-04-01T01:55:48.172901+0000', 'last_fullsized': '2024-04-01T01:55:48.172901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'last_clean_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-01T01:55:54.060 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.26 is not active+clean 2024-04-01T01:55:54.060 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-01T01:55:48.172901+0000', 'last_change': '2024-04-01T01:55:48.172901+0000', 'last_active': '2024-04-01T01:55:48.172901+0000', 'last_peered': '2024-04-01T01:55:48.172901+0000', 'last_clean': '2024-04-01T01:55:48.172901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-01T01:55:48.172901+0000', 'last_undegraded': '2024-04-01T01:55:48.172901+0000', 'last_fullsized': '2024-04-01T01:55:48.172901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'last_clean_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-01T01:55:54.060 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.25 is not active+clean 2024-04-01T01:55:54.060 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-01T01:55:48.172901+0000', 'last_change': '2024-04-01T01:55:48.172901+0000', 'last_active': '2024-04-01T01:55:48.172901+0000', 'last_peered': '2024-04-01T01:55:48.172901+0000', 'last_clean': '2024-04-01T01:55:48.172901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-01T01:55:48.172901+0000', 'last_undegraded': '2024-04-01T01:55:48.172901+0000', 'last_fullsized': '2024-04-01T01:55:48.172901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'last_clean_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-01T01:55:54.060 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.24 is not active+clean 2024-04-01T01:55:54.060 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-01T01:55:48.172901+0000', 'last_change': '2024-04-01T01:55:48.172901+0000', 'last_active': '2024-04-01T01:55:48.172901+0000', 'last_peered': '2024-04-01T01:55:48.172901+0000', 'last_clean': '2024-04-01T01:55:48.172901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-01T01:55:48.172901+0000', 'last_undegraded': '2024-04-01T01:55:48.172901+0000', 'last_fullsized': '2024-04-01T01:55:48.172901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'last_clean_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-01T01:55:54.061 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.22 is not active+clean 2024-04-01T01:55:54.061 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-01T01:55:48.172901+0000', 'last_change': '2024-04-01T01:55:48.172901+0000', 'last_active': '2024-04-01T01:55:48.172901+0000', 'last_peered': '2024-04-01T01:55:48.172901+0000', 'last_clean': '2024-04-01T01:55:48.172901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-01T01:55:48.172901+0000', 'last_undegraded': '2024-04-01T01:55:48.172901+0000', 'last_fullsized': '2024-04-01T01:55:48.172901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'last_clean_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-01T01:55:54.061 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.21 is not active+clean 2024-04-01T01:55:54.061 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-01T01:55:48.172901+0000', 'last_change': '2024-04-01T01:55:48.172901+0000', 'last_active': '2024-04-01T01:55:48.172901+0000', 'last_peered': '2024-04-01T01:55:48.172901+0000', 'last_clean': '2024-04-01T01:55:48.172901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-01T01:55:48.172901+0000', 'last_undegraded': '2024-04-01T01:55:48.172901+0000', 'last_fullsized': '2024-04-01T01:55:48.172901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'last_clean_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-01T01:55:54.061 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.20 is not active+clean 2024-04-01T01:55:54.061 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-01T01:55:48.172901+0000', 'last_change': '2024-04-01T01:55:48.172901+0000', 'last_active': '2024-04-01T01:55:48.172901+0000', 'last_peered': '2024-04-01T01:55:48.172901+0000', 'last_clean': '2024-04-01T01:55:48.172901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-01T01:55:48.172901+0000', 'last_undegraded': '2024-04-01T01:55:48.172901+0000', 'last_fullsized': '2024-04-01T01:55:48.172901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'last_clean_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-01T01:55:54.061 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1a is not active+clean 2024-04-01T01:55:54.061 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-01T01:55:48.172901+0000', 'last_change': '2024-04-01T01:55:48.172901+0000', 'last_active': '2024-04-01T01:55:48.172901+0000', 'last_peered': '2024-04-01T01:55:48.172901+0000', 'last_clean': '2024-04-01T01:55:48.172901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-01T01:55:48.172901+0000', 'last_undegraded': '2024-04-01T01:55:48.172901+0000', 'last_fullsized': '2024-04-01T01:55:48.172901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'last_clean_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-01T01:55:54.061 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1b is not active+clean 2024-04-01T01:55:54.061 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-01T01:55:48.172901+0000', 'last_change': '2024-04-01T01:55:48.172901+0000', 'last_active': '2024-04-01T01:55:48.172901+0000', 'last_peered': '2024-04-01T01:55:48.172901+0000', 'last_clean': '2024-04-01T01:55:48.172901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-01T01:55:48.172901+0000', 'last_undegraded': '2024-04-01T01:55:48.172901+0000', 'last_fullsized': '2024-04-01T01:55:48.172901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'last_clean_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-01T01:55:54.061 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1a is not active+clean 2024-04-01T01:55:54.062 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-04-01T01:55:47.187702+0000', 'last_change': '2024-04-01T01:55:47.187702+0000', 'last_active': '2024-04-01T01:55:47.163119+0000', 'last_peered': '2024-04-01T01:55:47.163119+0000', 'last_clean': '2024-04-01T01:55:47.163119+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-01T01:55:47.187702+0000', 'last_undegraded': '2024-04-01T01:55:47.187702+0000', 'last_fullsized': '2024-04-01T01:55:47.187702+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-01T01:55:47.163119+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-01T01:55:47.163119+0000', 'last_clean_scrub_stamp': '2024-04-01T01:55:47.163119+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-01T01:55:54.062 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.19 is not active+clean 2024-04-01T01:55:54.062 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-01T01:55:47.163119+0000', 'last_change': '2024-04-01T01:55:47.163119+0000', 'last_active': '2024-04-01T01:55:47.163119+0000', 'last_peered': '2024-04-01T01:55:47.163119+0000', 'last_clean': '2024-04-01T01:55:47.163119+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-01T01:55:47.163119+0000', 'last_undegraded': '2024-04-01T01:55:47.163119+0000', 'last_fullsized': '2024-04-01T01:55:47.163119+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-01T01:55:47.163119+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-01T01:55:47.163119+0000', 'last_clean_scrub_stamp': '2024-04-01T01:55:47.163119+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-01T01:55:54.062 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.18 is not active+clean 2024-04-01T01:55:54.062 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-04-01T01:55:47.187122+0000', 'last_change': '2024-04-01T01:55:47.187122+0000', 'last_active': '2024-04-01T01:55:47.163119+0000', 'last_peered': '2024-04-01T01:55:47.163119+0000', 'last_clean': '2024-04-01T01:55:47.163119+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-01T01:55:47.187122+0000', 'last_undegraded': '2024-04-01T01:55:47.187122+0000', 'last_fullsized': '2024-04-01T01:55:47.187122+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-01T01:55:47.163119+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-01T01:55:47.163119+0000', 'last_clean_scrub_stamp': '2024-04-01T01:55:47.163119+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-01T01:55:54.062 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.19 is not active+clean 2024-04-01T01:55:54.062 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-01T01:55:48.172901+0000', 'last_change': '2024-04-01T01:55:48.172901+0000', 'last_active': '2024-04-01T01:55:48.172901+0000', 'last_peered': '2024-04-01T01:55:48.172901+0000', 'last_clean': '2024-04-01T01:55:48.172901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-01T01:55:48.172901+0000', 'last_undegraded': '2024-04-01T01:55:48.172901+0000', 'last_fullsized': '2024-04-01T01:55:48.172901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'last_clean_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-01T01:55:54.062 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.17 is not active+clean 2024-04-01T01:55:54.062 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-04-01T01:55:47.187214+0000', 'last_change': '2024-04-01T01:55:47.187214+0000', 'last_active': '2024-04-01T01:55:47.163119+0000', 'last_peered': '2024-04-01T01:55:47.163119+0000', 'last_clean': '2024-04-01T01:55:47.163119+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-01T01:55:47.187214+0000', 'last_undegraded': '2024-04-01T01:55:47.187214+0000', 'last_fullsized': '2024-04-01T01:55:47.187214+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-01T01:55:47.163119+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-01T01:55:47.163119+0000', 'last_clean_scrub_stamp': '2024-04-01T01:55:47.163119+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-01T01:55:54.062 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.16 is not active+clean 2024-04-01T01:55:54.062 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-01T01:55:48.172901+0000', 'last_change': '2024-04-01T01:55:48.172901+0000', 'last_active': '2024-04-01T01:55:48.172901+0000', 'last_peered': '2024-04-01T01:55:48.172901+0000', 'last_clean': '2024-04-01T01:55:48.172901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-01T01:55:48.172901+0000', 'last_undegraded': '2024-04-01T01:55:48.172901+0000', 'last_fullsized': '2024-04-01T01:55:48.172901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'last_clean_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-01T01:55:54.063 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.16 is not active+clean 2024-04-01T01:55:54.063 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-04-01T01:55:47.182644+0000', 'last_change': '2024-04-01T01:55:47.182644+0000', 'last_active': '2024-04-01T01:55:47.163119+0000', 'last_peered': '2024-04-01T01:55:47.163119+0000', 'last_clean': '2024-04-01T01:55:47.163119+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-01T01:55:47.182644+0000', 'last_undegraded': '2024-04-01T01:55:47.182644+0000', 'last_fullsized': '2024-04-01T01:55:47.182644+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-01T01:55:47.163119+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-01T01:55:47.163119+0000', 'last_clean_scrub_stamp': '2024-04-01T01:55:47.163119+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-01T01:55:54.063 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.15 is not active+clean 2024-04-01T01:55:54.063 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-04-01T01:55:47.185591+0000', 'last_change': '2024-04-01T01:55:47.185591+0000', 'last_active': '2024-04-01T01:55:47.163119+0000', 'last_peered': '2024-04-01T01:55:47.163119+0000', 'last_clean': '2024-04-01T01:55:47.163119+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-01T01:55:47.185591+0000', 'last_undegraded': '2024-04-01T01:55:47.185591+0000', 'last_fullsized': '2024-04-01T01:55:47.185591+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-01T01:55:47.163119+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-01T01:55:47.163119+0000', 'last_clean_scrub_stamp': '2024-04-01T01:55:47.163119+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-01T01:55:54.063 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.14 is not active+clean 2024-04-01T01:55:54.063 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-01T01:55:48.172901+0000', 'last_change': '2024-04-01T01:55:48.172901+0000', 'last_active': '2024-04-01T01:55:48.172901+0000', 'last_peered': '2024-04-01T01:55:48.172901+0000', 'last_clean': '2024-04-01T01:55:48.172901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-01T01:55:48.172901+0000', 'last_undegraded': '2024-04-01T01:55:48.172901+0000', 'last_fullsized': '2024-04-01T01:55:48.172901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'last_clean_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-01T01:55:54.063 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.14 is not active+clean 2024-04-01T01:55:54.063 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-04-01T01:55:47.178823+0000', 'last_change': '2024-04-01T01:55:47.178823+0000', 'last_active': '2024-04-01T01:55:47.163119+0000', 'last_peered': '2024-04-01T01:55:47.163119+0000', 'last_clean': '2024-04-01T01:55:47.163119+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-01T01:55:47.178823+0000', 'last_undegraded': '2024-04-01T01:55:47.178823+0000', 'last_fullsized': '2024-04-01T01:55:47.178823+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-01T01:55:47.163119+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-01T01:55:47.163119+0000', 'last_clean_scrub_stamp': '2024-04-01T01:55:47.163119+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-01T01:55:54.063 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.15 is not active+clean 2024-04-01T01:55:54.063 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-01T01:55:48.172901+0000', 'last_change': '2024-04-01T01:55:48.172901+0000', 'last_active': '2024-04-01T01:55:48.172901+0000', 'last_peered': '2024-04-01T01:55:48.172901+0000', 'last_clean': '2024-04-01T01:55:48.172901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-01T01:55:48.172901+0000', 'last_undegraded': '2024-04-01T01:55:48.172901+0000', 'last_fullsized': '2024-04-01T01:55:48.172901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'last_clean_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-01T01:55:54.064 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.13 is not active+clean 2024-04-01T01:55:54.064 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-04-01T01:55:47.184193+0000', 'last_change': '2024-04-01T01:55:47.184193+0000', 'last_active': '2024-04-01T01:55:47.163119+0000', 'last_peered': '2024-04-01T01:55:47.163119+0000', 'last_clean': '2024-04-01T01:55:47.163119+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-01T01:55:47.184193+0000', 'last_undegraded': '2024-04-01T01:55:47.184193+0000', 'last_fullsized': '2024-04-01T01:55:47.184193+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-01T01:55:47.163119+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-01T01:55:47.163119+0000', 'last_clean_scrub_stamp': '2024-04-01T01:55:47.163119+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-01T01:55:54.064 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.12 is not active+clean 2024-04-01T01:55:54.064 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-01T01:55:48.172901+0000', 'last_change': '2024-04-01T01:55:48.172901+0000', 'last_active': '2024-04-01T01:55:48.172901+0000', 'last_peered': '2024-04-01T01:55:48.172901+0000', 'last_clean': '2024-04-01T01:55:48.172901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-01T01:55:48.172901+0000', 'last_undegraded': '2024-04-01T01:55:48.172901+0000', 'last_fullsized': '2024-04-01T01:55:48.172901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'last_clean_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-01T01:55:54.064 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.12 is not active+clean 2024-04-01T01:55:54.064 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-04-01T01:55:47.187002+0000', 'last_change': '2024-04-01T01:55:47.187002+0000', 'last_active': '2024-04-01T01:55:47.163119+0000', 'last_peered': '2024-04-01T01:55:47.163119+0000', 'last_clean': '2024-04-01T01:55:47.163119+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-01T01:55:47.187002+0000', 'last_undegraded': '2024-04-01T01:55:47.187002+0000', 'last_fullsized': '2024-04-01T01:55:47.187002+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-01T01:55:47.163119+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-01T01:55:47.163119+0000', 'last_clean_scrub_stamp': '2024-04-01T01:55:47.163119+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-01T01:55:54.064 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.13 is not active+clean 2024-04-01T01:55:54.064 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-01T01:55:48.172901+0000', 'last_change': '2024-04-01T01:55:48.172901+0000', 'last_active': '2024-04-01T01:55:48.172901+0000', 'last_peered': '2024-04-01T01:55:48.172901+0000', 'last_clean': '2024-04-01T01:55:48.172901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-01T01:55:48.172901+0000', 'last_undegraded': '2024-04-01T01:55:48.172901+0000', 'last_fullsized': '2024-04-01T01:55:48.172901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'last_clean_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-01T01:55:54.065 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.11 is not active+clean 2024-04-01T01:55:54.065 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-04-01T01:55:47.182645+0000', 'last_change': '2024-04-01T01:55:47.182645+0000', 'last_active': '2024-04-01T01:55:47.163119+0000', 'last_peered': '2024-04-01T01:55:47.163119+0000', 'last_clean': '2024-04-01T01:55:47.163119+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-01T01:55:47.182645+0000', 'last_undegraded': '2024-04-01T01:55:47.182645+0000', 'last_fullsized': '2024-04-01T01:55:47.182645+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-01T01:55:47.163119+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-01T01:55:47.163119+0000', 'last_clean_scrub_stamp': '2024-04-01T01:55:47.163119+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-01T01:55:54.065 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.10 is not active+clean 2024-04-01T01:55:54.065 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-01T01:55:48.172901+0000', 'last_change': '2024-04-01T01:55:48.172901+0000', 'last_active': '2024-04-01T01:55:48.172901+0000', 'last_peered': '2024-04-01T01:55:48.172901+0000', 'last_clean': '2024-04-01T01:55:48.172901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-01T01:55:48.172901+0000', 'last_undegraded': '2024-04-01T01:55:48.172901+0000', 'last_fullsized': '2024-04-01T01:55:48.172901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'last_clean_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-01T01:55:54.065 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.10 is not active+clean 2024-04-01T01:55:54.065 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-04-01T01:55:47.178156+0000', 'last_change': '2024-04-01T01:55:47.178156+0000', 'last_active': '2024-04-01T01:55:47.163119+0000', 'last_peered': '2024-04-01T01:55:47.163119+0000', 'last_clean': '2024-04-01T01:55:47.163119+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-01T01:55:47.178156+0000', 'last_undegraded': '2024-04-01T01:55:47.178156+0000', 'last_fullsized': '2024-04-01T01:55:47.178156+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-01T01:55:47.163119+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-01T01:55:47.163119+0000', 'last_clean_scrub_stamp': '2024-04-01T01:55:47.163119+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-01T01:55:54.065 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.11 is not active+clean 2024-04-01T01:55:54.065 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-01T01:55:48.172901+0000', 'last_change': '2024-04-01T01:55:48.172901+0000', 'last_active': '2024-04-01T01:55:48.172901+0000', 'last_peered': '2024-04-01T01:55:48.172901+0000', 'last_clean': '2024-04-01T01:55:48.172901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-01T01:55:48.172901+0000', 'last_undegraded': '2024-04-01T01:55:48.172901+0000', 'last_fullsized': '2024-04-01T01:55:48.172901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'last_clean_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-01T01:55:54.065 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.f is not active+clean 2024-04-01T01:55:54.065 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-04-01T01:55:47.183652+0000', 'last_change': '2024-04-01T01:55:47.183652+0000', 'last_active': '2024-04-01T01:55:47.163119+0000', 'last_peered': '2024-04-01T01:55:47.163119+0000', 'last_clean': '2024-04-01T01:55:47.163119+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-01T01:55:47.183652+0000', 'last_undegraded': '2024-04-01T01:55:47.183652+0000', 'last_fullsized': '2024-04-01T01:55:47.183652+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-01T01:55:47.163119+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-01T01:55:47.163119+0000', 'last_clean_scrub_stamp': '2024-04-01T01:55:47.163119+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-01T01:55:54.066 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.e is not active+clean 2024-04-01T01:55:54.066 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-01T01:55:48.172901+0000', 'last_change': '2024-04-01T01:55:48.172901+0000', 'last_active': '2024-04-01T01:55:48.172901+0000', 'last_peered': '2024-04-01T01:55:48.172901+0000', 'last_clean': '2024-04-01T01:55:48.172901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-01T01:55:48.172901+0000', 'last_undegraded': '2024-04-01T01:55:48.172901+0000', 'last_fullsized': '2024-04-01T01:55:48.172901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'last_clean_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-01T01:55:54.066 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.e is not active+clean 2024-04-01T01:55:54.066 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-04-01T01:55:47.180358+0000', 'last_change': '2024-04-01T01:55:47.180358+0000', 'last_active': '2024-04-01T01:55:47.163119+0000', 'last_peered': '2024-04-01T01:55:47.163119+0000', 'last_clean': '2024-04-01T01:55:47.163119+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-01T01:55:47.180358+0000', 'last_undegraded': '2024-04-01T01:55:47.180358+0000', 'last_fullsized': '2024-04-01T01:55:47.180358+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-01T01:55:47.163119+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-01T01:55:47.163119+0000', 'last_clean_scrub_stamp': '2024-04-01T01:55:47.163119+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-01T01:55:54.066 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.f is not active+clean 2024-04-01T01:55:54.066 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-01T01:55:48.172901+0000', 'last_change': '2024-04-01T01:55:48.172901+0000', 'last_active': '2024-04-01T01:55:48.172901+0000', 'last_peered': '2024-04-01T01:55:48.172901+0000', 'last_clean': '2024-04-01T01:55:48.172901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-01T01:55:48.172901+0000', 'last_undegraded': '2024-04-01T01:55:48.172901+0000', 'last_fullsized': '2024-04-01T01:55:48.172901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'last_clean_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-01T01:55:54.066 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.c is not active+clean 2024-04-01T01:55:54.066 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-01T01:55:48.172901+0000', 'last_change': '2024-04-01T01:55:48.172901+0000', 'last_active': '2024-04-01T01:55:48.172901+0000', 'last_peered': '2024-04-01T01:55:48.172901+0000', 'last_clean': '2024-04-01T01:55:48.172901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-01T01:55:48.172901+0000', 'last_undegraded': '2024-04-01T01:55:48.172901+0000', 'last_fullsized': '2024-04-01T01:55:48.172901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'last_clean_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-01T01:55:54.066 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.c is not active+clean 2024-04-01T01:55:54.066 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-01T01:55:47.163119+0000', 'last_change': '2024-04-01T01:55:47.163119+0000', 'last_active': '2024-04-01T01:55:47.163119+0000', 'last_peered': '2024-04-01T01:55:47.163119+0000', 'last_clean': '2024-04-01T01:55:47.163119+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-01T01:55:47.163119+0000', 'last_undegraded': '2024-04-01T01:55:47.163119+0000', 'last_fullsized': '2024-04-01T01:55:47.163119+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-01T01:55:47.163119+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-01T01:55:47.163119+0000', 'last_clean_scrub_stamp': '2024-04-01T01:55:47.163119+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-01T01:55:54.066 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.d is not active+clean 2024-04-01T01:55:54.067 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-01T01:55:48.172901+0000', 'last_change': '2024-04-01T01:55:48.172901+0000', 'last_active': '2024-04-01T01:55:48.172901+0000', 'last_peered': '2024-04-01T01:55:48.172901+0000', 'last_clean': '2024-04-01T01:55:48.172901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-01T01:55:48.172901+0000', 'last_undegraded': '2024-04-01T01:55:48.172901+0000', 'last_fullsized': '2024-04-01T01:55:48.172901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'last_clean_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-01T01:55:54.067 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.3 is not active+clean 2024-04-01T01:55:54.067 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-04-01T01:55:47.185243+0000', 'last_change': '2024-04-01T01:55:47.185243+0000', 'last_active': '2024-04-01T01:55:47.163119+0000', 'last_peered': '2024-04-01T01:55:47.163119+0000', 'last_clean': '2024-04-01T01:55:47.163119+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-01T01:55:47.185243+0000', 'last_undegraded': '2024-04-01T01:55:47.185243+0000', 'last_fullsized': '2024-04-01T01:55:47.185243+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-01T01:55:47.163119+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-01T01:55:47.163119+0000', 'last_clean_scrub_stamp': '2024-04-01T01:55:47.163119+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-01T01:55:54.067 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2 is not active+clean 2024-04-01T01:55:54.067 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-01T01:55:48.172901+0000', 'last_change': '2024-04-01T01:55:48.172901+0000', 'last_active': '2024-04-01T01:55:48.172901+0000', 'last_peered': '2024-04-01T01:55:48.172901+0000', 'last_clean': '2024-04-01T01:55:48.172901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-01T01:55:48.172901+0000', 'last_undegraded': '2024-04-01T01:55:48.172901+0000', 'last_fullsized': '2024-04-01T01:55:48.172901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'last_clean_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-01T01:55:54.067 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.0 is not active+clean 2024-04-01T01:55:54.067 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-04-01T01:55:47.184939+0000', 'last_change': '2024-04-01T01:55:47.184939+0000', 'last_active': '2024-04-01T01:55:47.163119+0000', 'last_peered': '2024-04-01T01:55:47.163119+0000', 'last_clean': '2024-04-01T01:55:47.163119+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-01T01:55:47.184939+0000', 'last_undegraded': '2024-04-01T01:55:47.184939+0000', 'last_fullsized': '2024-04-01T01:55:47.184939+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-01T01:55:47.163119+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-01T01:55:47.163119+0000', 'last_clean_scrub_stamp': '2024-04-01T01:55:47.163119+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-01T01:55:54.067 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1 is not active+clean 2024-04-01T01:55:54.067 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-01T01:55:48.172901+0000', 'last_change': '2024-04-01T01:55:48.172901+0000', 'last_active': '2024-04-01T01:55:48.172901+0000', 'last_peered': '2024-04-01T01:55:48.172901+0000', 'last_clean': '2024-04-01T01:55:48.172901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-01T01:55:48.172901+0000', 'last_undegraded': '2024-04-01T01:55:48.172901+0000', 'last_fullsized': '2024-04-01T01:55:48.172901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'last_clean_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-01T01:55:54.068 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1 is not active+clean 2024-04-01T01:55:54.068 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-04-01T01:55:47.183838+0000', 'last_change': '2024-04-01T01:55:47.183838+0000', 'last_active': '2024-04-01T01:55:47.163119+0000', 'last_peered': '2024-04-01T01:55:47.163119+0000', 'last_clean': '2024-04-01T01:55:47.163119+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-01T01:55:47.183838+0000', 'last_undegraded': '2024-04-01T01:55:47.183838+0000', 'last_fullsized': '2024-04-01T01:55:47.183838+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-01T01:55:47.163119+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-01T01:55:47.163119+0000', 'last_clean_scrub_stamp': '2024-04-01T01:55:47.163119+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-01T01:55:54.068 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.2 is not active+clean 2024-04-01T01:55:54.068 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-04-01T01:55:47.185607+0000', 'last_change': '2024-04-01T01:55:47.185607+0000', 'last_active': '2024-04-01T01:55:47.163119+0000', 'last_peered': '2024-04-01T01:55:47.163119+0000', 'last_clean': '2024-04-01T01:55:47.163119+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-01T01:55:47.185607+0000', 'last_undegraded': '2024-04-01T01:55:47.185607+0000', 'last_fullsized': '2024-04-01T01:55:47.185607+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-01T01:55:47.163119+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-01T01:55:47.163119+0000', 'last_clean_scrub_stamp': '2024-04-01T01:55:47.163119+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-01T01:55:54.068 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3 is not active+clean 2024-04-01T01:55:54.068 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-01T01:55:48.172901+0000', 'last_change': '2024-04-01T01:55:48.172901+0000', 'last_active': '2024-04-01T01:55:48.172901+0000', 'last_peered': '2024-04-01T01:55:48.172901+0000', 'last_clean': '2024-04-01T01:55:48.172901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-01T01:55:48.172901+0000', 'last_undegraded': '2024-04-01T01:55:48.172901+0000', 'last_fullsized': '2024-04-01T01:55:48.172901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'last_clean_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-01T01:55:54.068 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.5 is not active+clean 2024-04-01T01:55:54.068 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-01T01:55:48.172901+0000', 'last_change': '2024-04-01T01:55:48.172901+0000', 'last_active': '2024-04-01T01:55:48.172901+0000', 'last_peered': '2024-04-01T01:55:48.172901+0000', 'last_clean': '2024-04-01T01:55:48.172901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-01T01:55:48.172901+0000', 'last_undegraded': '2024-04-01T01:55:48.172901+0000', 'last_fullsized': '2024-04-01T01:55:48.172901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'last_clean_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-01T01:55:54.068 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.5 is not active+clean 2024-04-01T01:55:54.068 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-04-01T01:55:47.185871+0000', 'last_change': '2024-04-01T01:55:47.185871+0000', 'last_active': '2024-04-01T01:55:47.163119+0000', 'last_peered': '2024-04-01T01:55:47.163119+0000', 'last_clean': '2024-04-01T01:55:47.163119+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-01T01:55:47.185871+0000', 'last_undegraded': '2024-04-01T01:55:47.185871+0000', 'last_fullsized': '2024-04-01T01:55:47.185871+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-01T01:55:47.163119+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-01T01:55:47.163119+0000', 'last_clean_scrub_stamp': '2024-04-01T01:55:47.163119+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-01T01:55:54.069 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.4 is not active+clean 2024-04-01T01:55:54.069 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-01T01:55:48.172901+0000', 'last_change': '2024-04-01T01:55:48.172901+0000', 'last_active': '2024-04-01T01:55:48.172901+0000', 'last_peered': '2024-04-01T01:55:48.172901+0000', 'last_clean': '2024-04-01T01:55:48.172901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-01T01:55:48.172901+0000', 'last_undegraded': '2024-04-01T01:55:48.172901+0000', 'last_fullsized': '2024-04-01T01:55:48.172901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'last_clean_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-01T01:55:54.069 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.6 is not active+clean 2024-04-01T01:55:54.069 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-04-01T01:55:47.178842+0000', 'last_change': '2024-04-01T01:55:47.178842+0000', 'last_active': '2024-04-01T01:55:47.163119+0000', 'last_peered': '2024-04-01T01:55:47.163119+0000', 'last_clean': '2024-04-01T01:55:47.163119+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-01T01:55:47.178842+0000', 'last_undegraded': '2024-04-01T01:55:47.178842+0000', 'last_fullsized': '2024-04-01T01:55:47.178842+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-01T01:55:47.163119+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-01T01:55:47.163119+0000', 'last_clean_scrub_stamp': '2024-04-01T01:55:47.163119+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-01T01:55:54.069 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.7 is not active+clean 2024-04-01T01:55:54.069 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-01T01:55:48.172901+0000', 'last_change': '2024-04-01T01:55:48.172901+0000', 'last_active': '2024-04-01T01:55:48.172901+0000', 'last_peered': '2024-04-01T01:55:48.172901+0000', 'last_clean': '2024-04-01T01:55:48.172901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-01T01:55:48.172901+0000', 'last_undegraded': '2024-04-01T01:55:48.172901+0000', 'last_fullsized': '2024-04-01T01:55:48.172901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'last_clean_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-01T01:55:54.069 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.7 is not active+clean 2024-04-01T01:55:54.069 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-04-01T01:55:47.185032+0000', 'last_change': '2024-04-01T01:55:47.185032+0000', 'last_active': '2024-04-01T01:55:47.163119+0000', 'last_peered': '2024-04-01T01:55:47.163119+0000', 'last_clean': '2024-04-01T01:55:47.163119+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-01T01:55:47.185032+0000', 'last_undegraded': '2024-04-01T01:55:47.185032+0000', 'last_fullsized': '2024-04-01T01:55:47.185032+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-01T01:55:47.163119+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-01T01:55:47.163119+0000', 'last_clean_scrub_stamp': '2024-04-01T01:55:47.163119+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-01T01:55:54.069 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.6 is not active+clean 2024-04-01T01:55:54.069 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-01T01:55:48.172901+0000', 'last_change': '2024-04-01T01:55:48.172901+0000', 'last_active': '2024-04-01T01:55:48.172901+0000', 'last_peered': '2024-04-01T01:55:48.172901+0000', 'last_clean': '2024-04-01T01:55:48.172901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-01T01:55:48.172901+0000', 'last_undegraded': '2024-04-01T01:55:48.172901+0000', 'last_fullsized': '2024-04-01T01:55:48.172901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'last_clean_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-01T01:55:54.069 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.8 is not active+clean 2024-04-01T01:55:54.070 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-04-01T01:55:47.182623+0000', 'last_change': '2024-04-01T01:55:47.182623+0000', 'last_active': '2024-04-01T01:55:47.163119+0000', 'last_peered': '2024-04-01T01:55:47.163119+0000', 'last_clean': '2024-04-01T01:55:47.163119+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-01T01:55:47.182623+0000', 'last_undegraded': '2024-04-01T01:55:47.182623+0000', 'last_fullsized': '2024-04-01T01:55:47.182623+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-01T01:55:47.163119+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-01T01:55:47.163119+0000', 'last_clean_scrub_stamp': '2024-04-01T01:55:47.163119+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-01T01:55:54.070 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.9 is not active+clean 2024-04-01T01:55:54.070 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-01T01:55:48.172901+0000', 'last_change': '2024-04-01T01:55:48.172901+0000', 'last_active': '2024-04-01T01:55:48.172901+0000', 'last_peered': '2024-04-01T01:55:48.172901+0000', 'last_clean': '2024-04-01T01:55:48.172901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-01T01:55:48.172901+0000', 'last_undegraded': '2024-04-01T01:55:48.172901+0000', 'last_fullsized': '2024-04-01T01:55:48.172901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'last_clean_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-01T01:55:54.070 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.9 is not active+clean 2024-04-01T01:55:54.070 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-04-01T01:55:47.178196+0000', 'last_change': '2024-04-01T01:55:47.178196+0000', 'last_active': '2024-04-01T01:55:47.163119+0000', 'last_peered': '2024-04-01T01:55:47.163119+0000', 'last_clean': '2024-04-01T01:55:47.163119+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-01T01:55:47.178196+0000', 'last_undegraded': '2024-04-01T01:55:47.178196+0000', 'last_fullsized': '2024-04-01T01:55:47.178196+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-01T01:55:47.163119+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-01T01:55:47.163119+0000', 'last_clean_scrub_stamp': '2024-04-01T01:55:47.163119+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-01T01:55:54.070 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.8 is not active+clean 2024-04-01T01:55:54.070 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-01T01:55:48.172901+0000', 'last_change': '2024-04-01T01:55:48.172901+0000', 'last_active': '2024-04-01T01:55:48.172901+0000', 'last_peered': '2024-04-01T01:55:48.172901+0000', 'last_clean': '2024-04-01T01:55:48.172901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-01T01:55:48.172901+0000', 'last_undegraded': '2024-04-01T01:55:48.172901+0000', 'last_fullsized': '2024-04-01T01:55:48.172901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'last_clean_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-01T01:55:54.070 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.a is not active+clean 2024-04-01T01:55:54.070 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-01T01:55:47.163119+0000', 'last_change': '2024-04-01T01:55:47.163119+0000', 'last_active': '2024-04-01T01:55:47.163119+0000', 'last_peered': '2024-04-01T01:55:47.163119+0000', 'last_clean': '2024-04-01T01:55:47.163119+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-01T01:55:47.163119+0000', 'last_undegraded': '2024-04-01T01:55:47.163119+0000', 'last_fullsized': '2024-04-01T01:55:47.163119+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-01T01:55:47.163119+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-01T01:55:47.163119+0000', 'last_clean_scrub_stamp': '2024-04-01T01:55:47.163119+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-01T01:55:54.070 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.b is not active+clean 2024-04-01T01:55:54.071 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-01T01:55:48.172901+0000', 'last_change': '2024-04-01T01:55:48.172901+0000', 'last_active': '2024-04-01T01:55:48.172901+0000', 'last_peered': '2024-04-01T01:55:48.172901+0000', 'last_clean': '2024-04-01T01:55:48.172901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-01T01:55:48.172901+0000', 'last_undegraded': '2024-04-01T01:55:48.172901+0000', 'last_fullsized': '2024-04-01T01:55:48.172901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'last_clean_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-01T01:55:54.071 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.b is not active+clean 2024-04-01T01:55:54.071 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-04-01T01:55:47.186538+0000', 'last_change': '2024-04-01T01:55:47.186538+0000', 'last_active': '2024-04-01T01:55:47.163119+0000', 'last_peered': '2024-04-01T01:55:47.163119+0000', 'last_clean': '2024-04-01T01:55:47.163119+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-01T01:55:47.186538+0000', 'last_undegraded': '2024-04-01T01:55:47.186538+0000', 'last_fullsized': '2024-04-01T01:55:47.186538+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-01T01:55:47.163119+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-01T01:55:47.163119+0000', 'last_clean_scrub_stamp': '2024-04-01T01:55:47.163119+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-01T01:55:54.071 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.a is not active+clean 2024-04-01T01:55:54.071 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-01T01:55:48.172901+0000', 'last_change': '2024-04-01T01:55:48.172901+0000', 'last_active': '2024-04-01T01:55:48.172901+0000', 'last_peered': '2024-04-01T01:55:48.172901+0000', 'last_clean': '2024-04-01T01:55:48.172901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-01T01:55:48.172901+0000', 'last_undegraded': '2024-04-01T01:55:48.172901+0000', 'last_fullsized': '2024-04-01T01:55:48.172901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'last_clean_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-01T01:55:54.071 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1d is not active+clean 2024-04-01T01:55:54.071 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-01T01:55:48.172901+0000', 'last_change': '2024-04-01T01:55:48.172901+0000', 'last_active': '2024-04-01T01:55:48.172901+0000', 'last_peered': '2024-04-01T01:55:48.172901+0000', 'last_clean': '2024-04-01T01:55:48.172901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-01T01:55:48.172901+0000', 'last_undegraded': '2024-04-01T01:55:48.172901+0000', 'last_fullsized': '2024-04-01T01:55:48.172901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'last_clean_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-01T01:55:54.071 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1c is not active+clean 2024-04-01T01:55:54.071 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-04-01T01:55:47.182944+0000', 'last_change': '2024-04-01T01:55:47.182944+0000', 'last_active': '2024-04-01T01:55:47.163119+0000', 'last_peered': '2024-04-01T01:55:47.163119+0000', 'last_clean': '2024-04-01T01:55:47.163119+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-01T01:55:47.182944+0000', 'last_undegraded': '2024-04-01T01:55:47.182944+0000', 'last_fullsized': '2024-04-01T01:55:47.182944+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-01T01:55:47.163119+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-01T01:55:47.163119+0000', 'last_clean_scrub_stamp': '2024-04-01T01:55:47.163119+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-01T01:55:54.071 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1c is not active+clean 2024-04-01T01:55:54.071 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-01T01:55:48.172901+0000', 'last_change': '2024-04-01T01:55:48.172901+0000', 'last_active': '2024-04-01T01:55:48.172901+0000', 'last_peered': '2024-04-01T01:55:48.172901+0000', 'last_clean': '2024-04-01T01:55:48.172901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-01T01:55:48.172901+0000', 'last_undegraded': '2024-04-01T01:55:48.172901+0000', 'last_fullsized': '2024-04-01T01:55:48.172901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'last_clean_scrub_stamp': '2024-04-01T01:55:48.172901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-01T01:55:54.072 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1d is not active+clean 2024-04-01T01:55:54.072 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-04-01T01:55:47.183022+0000', 'last_change': '2024-04-01T01:55:47.183022+0000', 'last_active': '2024-04-01T01:55:47.163119+0000', 'last_peered': '2024-04-01T01:55:47.163119+0000', 'last_clean': '2024-04-01T01:55:47.163119+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-01T01:55:47.183022+0000', 'last_undegraded': '2024-04-01T01:55:47.183022+0000', 'last_fullsized': '2024-04-01T01:55:47.183022+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-01T01:55:47.163119+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-01T01:55:47.163119+0000', 'last_clean_scrub_stamp': '2024-04-01T01:55:47.163119+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-01T01:55:54.072 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1f is not active+clean 2024-04-01T01:55:54.072 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-04-01T01:55:47.179994+0000', 'last_change': '2024-04-01T01:55:47.179994+0000', 'last_active': '2024-04-01T01:55:47.163119+0000', 'last_peered': '2024-04-01T01:55:47.163119+0000', 'last_clean': '2024-04-01T01:55:47.163119+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-01T01:55:47.179994+0000', 'last_undegraded': '2024-04-01T01:55:47.179994+0000', 'last_fullsized': '2024-04-01T01:55:47.179994+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-01T01:55:47.163119+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-01T01:55:47.163119+0000', 'last_clean_scrub_stamp': '2024-04-01T01:55:47.163119+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-01T01:55:54.072 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-01T01:55:54.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.210+0000 7fb4ec294640 1 Processor -- start 2024-04-01T01:55:54.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.210+0000 7fb4ec294640 1 -- start start 2024-04-01T01:55:54.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.214+0000 7fb4ec294640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb4e4158860 0x7fb4e40c79f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:54.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.214+0000 7fb4ec294640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4e4157c50 con 0x7fb4e4151e50 2024-04-01T01:55:54.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.214+0000 7fb4ec294640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4e415b490 con 0x7fb4e40c1f10 2024-04-01T01:55:54.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.214+0000 7fb4ec294640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fb4e415b240 con 0x7fb4e4158860 2024-04-01T01:55:54.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.214+0000 7fb4ea030640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fb4e4151e50 0x7fb4e406ee40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:47518/0 (socket says 172.21.15.50:47518) 2024-04-01T01:55:54.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.214+0000 7fb4ea030640 1 -- 172.21.15.50:0/1752603608 learned_addr learned my addr 172.21.15.50:0/1752603608 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-04-01T01:55:54.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.214+0000 7fb4ea831640 1 --2- 172.21.15.50:0/1752603608 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb4e4158860 0x7fb4e40c79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:54.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.214+0000 7fb4e902e640 1 -- 172.21.15.50:0/1752603608 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2573862326 0 0) 0x7fb4e4157c50 con 0x7fb4e4151e50 2024-04-01T01:55:54.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.214+0000 7fb4e902e640 1 -- 172.21.15.50:0/1752603608 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb4d0003530 con 0x7fb4e4151e50 2024-04-01T01:55:54.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.214+0000 7fb4e902e640 1 -- 172.21.15.50:0/1752603608 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1457341447 0 0) 0x7fb4d0003530 con 0x7fb4e4151e50 2024-04-01T01:55:54.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.214+0000 7fb4e902e640 1 -- 172.21.15.50:0/1752603608 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb4e4158860 msgr2=0x7fb4e40c79f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:55:54.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.214+0000 7fb4e902e640 1 --2- 172.21.15.50:0/1752603608 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb4e4158860 0x7fb4e40c79f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:54.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.214+0000 7fb4e902e640 1 -- 172.21.15.50:0/1752603608 >> v1:172.21.15.97:6789/0 conn(0x7fb4e40c1f10 legacy=0x7fb4e4158150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:54.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.214+0000 7fb4e902e640 1 -- 172.21.15.50:0/1752603608 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4e415b770 con 0x7fb4e4151e50 2024-04-01T01:55:54.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.214+0000 7fb4e902e640 1 -- 172.21.15.50:0/1752603608 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2779672543 0 0) 0x7fb4e0001a00 con 0x7fb4e4151e50 2024-04-01T01:55:54.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.214+0000 7fb4e902e640 1 -- 172.21.15.50:0/1752603608 >> v1:172.21.15.50:6789/0 conn(0x7fb4e4151e50 legacy=0x7fb4e406ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:54.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.214+0000 7fb4e902e640 1 --2- 172.21.15.50:0/1752603608 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb4e4158860 0x7fb4d00039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:54.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.214+0000 7fb4e902e640 1 --2- 172.21.15.50:0/1752603608 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb4d0003f30 0x7fb4d0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:54.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.214+0000 7fb4e902e640 1 --2- 172.21.15.50:0/1752603608 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4d0004d50 0x7fb4d00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:54.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.214+0000 7fb4e902e640 1 -- 172.21.15.50:0/1752603608 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb4e415b240 con 0x7fb4d0004d50 2024-04-01T01:55:54.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.214+0000 7fb4e902e640 1 -- 172.21.15.50:0/1752603608 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fb4d000ba30 con 0x7fb4d0003f30 2024-04-01T01:55:54.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.214+0000 7fb4e902e640 1 -- 172.21.15.50:0/1752603608 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fb4d000bc30 con 0x7fb4e4158860 2024-04-01T01:55:54.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.214+0000 7fb4ea831640 1 --2- 172.21.15.50:0/1752603608 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4d0004d50 0x7fb4d00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:54.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.214+0000 7fb4ea030640 1 --2- 172.21.15.50:0/1752603608 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb4e4158860 0x7fb4d00039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:54.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.214+0000 7fb4e982f640 1 --2- 172.21.15.50:0/1752603608 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb4d0003f30 0x7fb4d0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:54.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.214+0000 7fb4ea831640 1 -- 172.21.15.50:0/1752603608 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb4e4158860 msgr2=0x7fb4d00039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:55:54.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.214+0000 7fb4ea831640 1 --2- 172.21.15.50:0/1752603608 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb4e4158860 0x7fb4d00039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:54.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.214+0000 7fb4ea831640 1 -- 172.21.15.50:0/1752603608 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb4d0003f30 msgr2=0x7fb4d0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:55:54.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.214+0000 7fb4ea831640 1 --2- 172.21.15.50:0/1752603608 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb4d0003f30 0x7fb4d0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:54.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.214+0000 7fb4ea831640 1 -- 172.21.15.50:0/1752603608 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4d0003530 con 0x7fb4d0004d50 2024-04-01T01:55:54.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.218+0000 7fb4ea831640 1 --2- 172.21.15.50:0/1752603608 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4d0004d50 0x7fb4d00051d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb4dc009ae0 tx=0x7fb4dc01ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a86e901543b8c35 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:54.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.218+0000 7fb4e902e640 1 -- 172.21.15.50:0/1752603608 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4dc0b2070 con 0x7fb4d0004d50 2024-04-01T01:55:54.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.218+0000 7fb4e902e640 1 -- 172.21.15.50:0/1752603608 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4dc0a5660 con 0x7fb4d0004d50 2024-04-01T01:55:54.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.218+0000 7fb4e902e640 1 -- 172.21.15.50:0/1752603608 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4dc0096b0 con 0x7fb4d0004d50 2024-04-01T01:55:54.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.218+0000 7fb4ec294640 1 -- 172.21.15.50:0/1752603608 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4d0004d50 msgr2=0x7fb4d00051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:54.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.218+0000 7fb4ec294640 1 --2- 172.21.15.50:0/1752603608 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4d0004d50 0x7fb4d00051d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb4dc009ae0 tx=0x7fb4dc01ca70 comp rx=0 tx=0).stop 2024-04-01T01:55:54.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.218+0000 7fb4ea831640 1 -- 172.21.15.50:0/1752603608 reap_dead start 2024-04-01T01:55:54.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.218+0000 7fb4ec294640 1 -- 172.21.15.50:0/1752603608 shutdown_connections 2024-04-01T01:55:54.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.218+0000 7fb4ec294640 1 -- 172.21.15.50:0/1752603608 >> 172.21.15.50:0/1752603608 conn(0x7fb4e40676f0 msgr2=0x7fb4e40c8010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:55:54.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.218+0000 7fb4ec294640 1 -- 172.21.15.50:0/1752603608 shutdown_connections 2024-04-01T01:55:54.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.218+0000 7fb4ec294640 1 -- 172.21.15.50:0/1752603608 wait complete. 2024-04-01T01:55:54.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.218+0000 7fb4ec294640 1 Processor -- start 2024-04-01T01:55:54.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.218+0000 7fb4ec294640 1 -- start start 2024-04-01T01:55:54.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.218+0000 7fb4ec294640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4e414c260 0x7fb4e41532e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:54.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.218+0000 7fb4ec294640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb4e414c640 0x7fb4e4154db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:54.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.218+0000 7fb4ec294640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb4e41ed6c0 0x7fb4e4149ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:54.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.218+0000 7fb4ec294640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb4e415c010 con 0x7fb4e414c260 2024-04-01T01:55:54.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.218+0000 7fb4ec294640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fb4e415bd30 con 0x7fb4e414c640 2024-04-01T01:55:54.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.218+0000 7fb4ec294640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fb4e406f550 con 0x7fb4e41ed6c0 2024-04-01T01:55:54.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.222+0000 7fb4ea030640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4e414c260 0x7fb4e41532e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:54.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.222+0000 7fb4ea030640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4e414c260 0x7fb4e41532e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55486/0 (socket says 172.21.15.50:55486) 2024-04-01T01:55:54.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.222+0000 7fb4ea030640 1 -- 172.21.15.50:0/1221784805 learned_addr learned my addr 172.21.15.50:0/1221784805 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T01:55:54.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.222+0000 7fb4ea831640 1 --2- 172.21.15.50:0/1221784805 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb4e41ed6c0 0x7fb4e4149ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:54.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.222+0000 7fb4e982f640 1 --2- 172.21.15.50:0/1221784805 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb4e414c640 0x7fb4e4154db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:54.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.222+0000 7fb4ea030640 1 -- 172.21.15.50:0/1221784805 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb4e41ed6c0 msgr2=0x7fb4e4149ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:54.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.222+0000 7fb4ea030640 1 --2- 172.21.15.50:0/1221784805 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb4e41ed6c0 0x7fb4e4149ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:54.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.222+0000 7fb4ea030640 1 -- 172.21.15.50:0/1221784805 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb4e414c640 msgr2=0x7fb4e4154db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:54.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.222+0000 7fb4ea030640 1 --2- 172.21.15.50:0/1221784805 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb4e414c640 0x7fb4e4154db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:54.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.222+0000 7fb4ea030640 1 -- 172.21.15.50:0/1221784805 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4e4153a50 con 0x7fb4e414c260 2024-04-01T01:55:54.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.222+0000 7fb4ea030640 1 --2- 172.21.15.50:0/1221784805 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4e414c260 0x7fb4e41532e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb4e0007820 tx=0x7fb4e000a750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:54.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.222+0000 7fb4daffd640 1 -- 172.21.15.50:0/1221784805 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4e00133f0 con 0x7fb4e414c260 2024-04-01T01:55:54.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.222+0000 7fb4daffd640 1 -- 172.21.15.50:0/1221784805 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4e0018070 con 0x7fb4e414c260 2024-04-01T01:55:54.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.222+0000 7fb4ec294640 1 -- 172.21.15.50:0/1221784805 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4e4153d10 con 0x7fb4e414c260 2024-04-01T01:55:54.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.222+0000 7fb4daffd640 1 -- 172.21.15.50:0/1221784805 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4e00137d0 con 0x7fb4e414c260 2024-04-01T01:55:54.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.222+0000 7fb4ec294640 1 -- 172.21.15.50:0/1221784805 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4e41542d0 con 0x7fb4e414c260 2024-04-01T01:55:54.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.222+0000 7fb4ec294640 1 -- 172.21.15.50:0/1221784805 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4e4068230 con 0x7fb4e414c260 2024-04-01T01:55:54.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.222+0000 7fb4daffd640 1 -- 172.21.15.50:0/1221784805 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 87103+0+0 (secure 0 0 0) 0x7fb4e0013970 con 0x7fb4e414c260 2024-04-01T01:55:54.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.222+0000 7fb4daffd640 1 --2- 172.21.15.50:0/1221784805 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fb4c8067450 0x7fb4c8069910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:54.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.222+0000 7fb4daffd640 1 -- 172.21.15.50:0/1221784805 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fb4e0086020 con 0x7fb4e414c260 2024-04-01T01:55:54.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.222+0000 7fb4e982f640 1 --2- 172.21.15.50:0/1221784805 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fb4c8067450 0x7fb4c8069910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:54.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.222+0000 7fb4e982f640 1 --2- 172.21.15.50:0/1221784805 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fb4c8067450 0x7fb4c8069910 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb4e414a9a0 tx=0x7fb4d4007c60 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:54.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.226+0000 7fb4daffd640 1 -- 172.21.15.50:0/1221784805 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+176632 (secure 0 0 0) 0x7fb4e0056e00 con 0x7fb4e414c260 2024-04-01T01:55:54.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.438+0000 7fb4ec294640 1 -- 172.21.15.50:0/1221784805 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fb4e40c7b90 con 0x7fb4e414c260 2024-04-01T01:55:54.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.438+0000 7fb4daffd640 1 -- 172.21.15.50:0/1221784805 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1011 (secure 0 0 0) 0x7fb4e0056700 con 0x7fb4e414c260 2024-04-01T01:55:54.441 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-01T01:55:54.441 INFO:teuthology.orchestra.run.smithi050.stdout:{"fsid":"f67878a9-bc75-426b-962d-fa7bc2517f7d","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":22,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":21,"num_osds":8,"num_up_osds":8,"osd_up_since":1711936542,"num_in_osds":8,"osd_in_since":1711936533,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592778,"bytes_used":240267264,"bytes_avail":772853846016,"bytes_total":773094113280,"write_bytes_sec":2435,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":7,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"f","status":"up:active","gid":4279}],"up:standby":5},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-04-01T01:55:31.566034+0000","services":{}},"progress_events":{}} 2024-04-01T01:55:54.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.442+0000 7fb4ec294640 1 -- 172.21.15.50:0/1221784805 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fb4c8067450 msgr2=0x7fb4c8069910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:54.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.442+0000 7fb4ec294640 1 --2- 172.21.15.50:0/1221784805 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fb4c8067450 0x7fb4c8069910 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb4e414a9a0 tx=0x7fb4d4007c60 comp rx=0 tx=0).stop 2024-04-01T01:55:54.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.442+0000 7fb4ec294640 1 -- 172.21.15.50:0/1221784805 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4e414c260 msgr2=0x7fb4e41532e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:54.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.442+0000 7fb4ec294640 1 --2- 172.21.15.50:0/1221784805 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4e414c260 0x7fb4e41532e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb4e0007820 tx=0x7fb4e000a750 comp rx=0 tx=0).stop 2024-04-01T01:55:54.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.442+0000 7fb4ec294640 1 -- 172.21.15.50:0/1221784805 shutdown_connections 2024-04-01T01:55:54.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.442+0000 7fb4ec294640 1 --2- 172.21.15.50:0/1221784805 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fb4c8067450 0x7fb4c8069910 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:54.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.442+0000 7fb4ec294640 1 --2- 172.21.15.50:0/1221784805 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb4e41ed6c0 0x7fb4e4149ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:54.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.442+0000 7fb4ec294640 1 --2- 172.21.15.50:0/1221784805 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb4e414c640 0x7fb4e4154db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:54.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.442+0000 7fb4ec294640 1 --2- 172.21.15.50:0/1221784805 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4e414c260 0x7fb4e41532e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:54.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.442+0000 7fb4ec294640 1 -- 172.21.15.50:0/1221784805 >> 172.21.15.50:0/1221784805 conn(0x7fb4e40676f0 msgr2=0x7fb4e4159930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:55:54.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.442+0000 7fb4ec294640 1 -- 172.21.15.50:0/1221784805 shutdown_connections 2024-04-01T01:55:54.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.442+0000 7fb4ec294640 1 -- 172.21.15.50:0/1221784805 wait complete. 2024-04-01T01:55:54.459 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-04-01T01:55:54.459 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-01T01:55:54.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.582+0000 7f8ac0664640 1 Processor -- start 2024-04-01T01:55:54.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.582+0000 7f8ac0664640 1 -- start start 2024-04-01T01:55:54.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.582+0000 7f8ac0664640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8ab806ea80 0x7f8ab806eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:54.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.582+0000 7f8ac0664640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ab806f410 con 0x7f8ab80c98d0 2024-04-01T01:55:54.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.582+0000 7f8ac0664640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ab815b0c0 con 0x7f8ab8151d70 2024-04-01T01:55:54.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.582+0000 7f8ac0664640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f8ab815bcd0 con 0x7f8ab806ea80 2024-04-01T01:55:54.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.582+0000 7f8abdbff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f8ab80c98d0 0x7f8ab80c9f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:47524/0 (socket says 172.21.15.50:47524) 2024-04-01T01:55:54.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.582+0000 7f8abdbff640 1 -- 172.21.15.50:0/2627054389 learned_addr learned my addr 172.21.15.50:0/2627054389 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-04-01T01:55:54.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.582+0000 7f8abec01640 1 --2- 172.21.15.50:0/2627054389 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8ab806ea80 0x7f8ab806eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:54.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.582+0000 7f8abd3fe640 1 -- 172.21.15.50:0/2627054389 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1882803280 0 0) 0x7f8ab806f410 con 0x7f8ab80c98d0 2024-04-01T01:55:54.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.582+0000 7f8abd3fe640 1 -- 172.21.15.50:0/2627054389 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8aa4003530 con 0x7f8ab80c98d0 2024-04-01T01:55:54.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.582+0000 7f8abd3fe640 1 -- 172.21.15.50:0/2627054389 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3802624357 0 0) 0x7f8aa4003530 con 0x7f8ab80c98d0 2024-04-01T01:55:54.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.582+0000 7f8abd3fe640 1 -- 172.21.15.50:0/2627054389 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8ab806ea80 msgr2=0x7f8ab806eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:55:54.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.582+0000 7f8abd3fe640 1 --2- 172.21.15.50:0/2627054389 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8ab806ea80 0x7f8ab806eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:54.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.582+0000 7f8abd3fe640 1 -- 172.21.15.50:0/2627054389 >> v1:172.21.15.97:6789/0 conn(0x7f8ab8151d70 legacy=0x7f8ab80c24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:54.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.582+0000 7f8abd3fe640 1 -- 172.21.15.50:0/2627054389 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ab815b3a0 con 0x7f8ab80c98d0 2024-04-01T01:55:54.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.582+0000 7f8abd3fe640 1 -- 172.21.15.50:0/2627054389 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2779672543 0 0) 0x7f8aac001680 con 0x7f8ab80c98d0 2024-04-01T01:55:54.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.582+0000 7f8abd3fe640 1 -- 172.21.15.50:0/2627054389 >> v1:172.21.15.50:6789/0 conn(0x7f8ab80c98d0 legacy=0x7f8ab80c9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:54.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.582+0000 7f8abd3fe640 1 --2- 172.21.15.50:0/2627054389 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8ab806ea80 0x7f8aa40039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:54.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.582+0000 7f8abd3fe640 1 --2- 172.21.15.50:0/2627054389 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8aa4003f70 0x7f8aa4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:54.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.582+0000 7f8abd3fe640 1 --2- 172.21.15.50:0/2627054389 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8aa4004d50 0x7f8aa40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:54.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.582+0000 7f8abd3fe640 1 -- 172.21.15.50:0/2627054389 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8aa400bb10 con 0x7f8aa4004d50 2024-04-01T01:55:54.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.582+0000 7f8abd3fe640 1 -- 172.21.15.50:0/2627054389 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f8aa400bcc0 con 0x7f8aa4003f70 2024-04-01T01:55:54.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.582+0000 7f8abd3fe640 1 -- 172.21.15.50:0/2627054389 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f8aa400bec0 con 0x7f8ab806ea80 2024-04-01T01:55:54.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.582+0000 7f8abec01640 1 --2- 172.21.15.50:0/2627054389 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8aa4004d50 0x7f8aa40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:54.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.582+0000 7f8abe400640 1 --2- 172.21.15.50:0/2627054389 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8ab806ea80 0x7f8aa40039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:54.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.582+0000 7f8abdbff640 1 --2- 172.21.15.50:0/2627054389 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8aa4003f70 0x7f8aa4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:54.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.582+0000 7f8abec01640 1 -- 172.21.15.50:0/2627054389 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8ab806ea80 msgr2=0x7f8aa40039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:55:54.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.582+0000 7f8abec01640 1 --2- 172.21.15.50:0/2627054389 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8ab806ea80 0x7f8aa40039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:54.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.582+0000 7f8abec01640 1 -- 172.21.15.50:0/2627054389 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8aa4003f70 msgr2=0x7f8aa4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:55:54.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.582+0000 7f8abec01640 1 --2- 172.21.15.50:0/2627054389 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8aa4003f70 0x7f8aa4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:54.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.582+0000 7f8abec01640 1 -- 172.21.15.50:0/2627054389 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8aa4003530 con 0x7f8aa4004d50 2024-04-01T01:55:54.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.586+0000 7f8abec01640 1 --2- 172.21.15.50:0/2627054389 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8aa4004d50 0x7f8aa40051d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8ab0009fa0 tx=0x7f8ab001cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac2a322b5be1c29 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:54.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.586+0000 7f8abd3fe640 1 -- 172.21.15.50:0/2627054389 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ab00b2070 con 0x7f8aa4004d50 2024-04-01T01:55:54.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.586+0000 7f8abd3fe640 1 -- 172.21.15.50:0/2627054389 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ab00a5d10 con 0x7f8aa4004d50 2024-04-01T01:55:54.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.586+0000 7f8abd3fe640 1 -- 172.21.15.50:0/2627054389 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ab0009bf0 con 0x7f8aa4004d50 2024-04-01T01:55:54.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.586+0000 7f8ac0664640 1 -- 172.21.15.50:0/2627054389 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8aa4004d50 msgr2=0x7f8aa40051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:54.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.586+0000 7f8ac0664640 1 --2- 172.21.15.50:0/2627054389 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8aa4004d50 0x7f8aa40051d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8ab0009fa0 tx=0x7f8ab001cc40 comp rx=0 tx=0).stop 2024-04-01T01:55:54.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.586+0000 7f8abec01640 1 -- 172.21.15.50:0/2627054389 reap_dead start 2024-04-01T01:55:54.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.586+0000 7f8ac0664640 1 -- 172.21.15.50:0/2627054389 shutdown_connections 2024-04-01T01:55:54.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.586+0000 7f8ac0664640 1 -- 172.21.15.50:0/2627054389 >> 172.21.15.50:0/2627054389 conn(0x7f8ab806b820 msgr2=0x7f8ab8070fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:55:54.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.586+0000 7f8ac0664640 1 -- 172.21.15.50:0/2627054389 shutdown_connections 2024-04-01T01:55:54.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.586+0000 7f8ac0664640 1 -- 172.21.15.50:0/2627054389 wait complete. 2024-04-01T01:55:54.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.586+0000 7f8ac0664640 1 Processor -- start 2024-04-01T01:55:54.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.586+0000 7f8ac0664640 1 -- start start 2024-04-01T01:55:54.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.586+0000 7f8ac0664640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8aa4004d50 0x7f8ab8152850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:54.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.586+0000 7f8ac0664640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ab80c6a50 0x7f8ab8150960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:54.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.586+0000 7f8ac0664640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8ab8153090 0x7f8ab81f20a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:54.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.586+0000 7f8ac0664640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8ab8152150 con 0x7f8ab80c6a50 2024-04-01T01:55:54.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.586+0000 7f8ac0664640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f8ab815b960 con 0x7f8aa4004d50 2024-04-01T01:55:54.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.586+0000 7f8ac0664640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f8ab80c2f80 con 0x7f8ab8153090 2024-04-01T01:55:54.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.586+0000 7f8abdbff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ab80c6a50 0x7f8ab8150960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:54.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.586+0000 7f8abdbff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ab80c6a50 0x7f8ab8150960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55502/0 (socket says 172.21.15.50:55502) 2024-04-01T01:55:54.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.586+0000 7f8abdbff640 1 -- 172.21.15.50:0/3865186 learned_addr learned my addr 172.21.15.50:0/3865186 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T01:55:54.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.586+0000 7f8abe400640 1 --2- 172.21.15.50:0/3865186 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8aa4004d50 0x7f8ab8152850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:54.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.590+0000 7f8abec01640 1 --2- 172.21.15.50:0/3865186 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8ab8153090 0x7f8ab81f20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:54.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.590+0000 7f8abdbff640 1 -- 172.21.15.50:0/3865186 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8ab8153090 msgr2=0x7f8ab81f20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:54.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.590+0000 7f8abdbff640 1 --2- 172.21.15.50:0/3865186 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8ab8153090 0x7f8ab81f20a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:54.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.590+0000 7f8abdbff640 1 -- 172.21.15.50:0/3865186 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8aa4004d50 msgr2=0x7f8ab8152850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:54.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.590+0000 7f8abdbff640 1 --2- 172.21.15.50:0/3865186 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8aa4004d50 0x7f8ab8152850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:54.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.590+0000 7f8abdbff640 1 -- 172.21.15.50:0/3865186 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ab8154f50 con 0x7f8ab80c6a50 2024-04-01T01:55:54.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.590+0000 7f8abdbff640 1 --2- 172.21.15.50:0/3865186 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ab80c6a50 0x7f8ab8150960 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8aac00e8f0 tx=0x7f8aac00edb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:54.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.590+0000 7f8aaaffd640 1 -- 172.21.15.50:0/3865186 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aac00c8d0 con 0x7f8ab80c6a50 2024-04-01T01:55:54.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.590+0000 7f8aaaffd640 1 -- 172.21.15.50:0/3865186 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8aac018070 con 0x7f8ab80c6a50 2024-04-01T01:55:54.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.590+0000 7f8ac0664640 1 -- 172.21.15.50:0/3865186 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ab81e38a0 con 0x7f8ab80c6a50 2024-04-01T01:55:54.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.590+0000 7f8aaaffd640 1 -- 172.21.15.50:0/3865186 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aac00ccd0 con 0x7f8ab80c6a50 2024-04-01T01:55:54.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.590+0000 7f8ac0664640 1 -- 172.21.15.50:0/3865186 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ab81e3b80 con 0x7f8ab80c6a50 2024-04-01T01:55:54.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.590+0000 7f8ac0664640 1 -- 172.21.15.50:0/3865186 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ab81f1a00 con 0x7f8ab80c6a50 2024-04-01T01:55:54.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.590+0000 7f8aaaffd640 1 -- 172.21.15.50:0/3865186 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 87103+0+0 (secure 0 0 0) 0x7f8aac013420 con 0x7f8ab80c6a50 2024-04-01T01:55:54.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.590+0000 7f8aaaffd640 1 --2- 172.21.15.50:0/3865186 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f8a9c067450 0x7f8a9c069910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:54.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.590+0000 7f8aaaffd640 1 -- 172.21.15.50:0/3865186 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f8aac0852e0 con 0x7f8ab80c6a50 2024-04-01T01:55:54.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.590+0000 7f8abe400640 1 --2- 172.21.15.50:0/3865186 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f8a9c067450 0x7f8a9c069910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:54.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.590+0000 7f8abe400640 1 --2- 172.21.15.50:0/3865186 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f8a9c067450 0x7f8a9c069910 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8ab4005510 tx=0x7f8ab4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:54.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.594+0000 7f8aaaffd640 1 -- 172.21.15.50:0/3865186 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+176632 (secure 0 0 0) 0x7f8aac056110 con 0x7f8ab80c6a50 2024-04-01T01:55:54.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.750+0000 7f8ac0664640 1 -- 172.21.15.50:0/3865186 --> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8ab8068230 con 0x7f8a9c067450 2024-04-01T01:55:54.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.770+0000 7f8aaaffd640 1 -- 172.21.15.50:0/3865186 <== mgr.4103 v2:172.21.15.97:6832/1677467570 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252021 (secure 0 0 0) 0x7f8ab8068230 con 0x7f8a9c067450 2024-04-01T01:55:54.774 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-01T01:55:54.775 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-04-01T01:55:54.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.774+0000 7f8ac0664640 1 -- 172.21.15.50:0/3865186 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f8a9c067450 msgr2=0x7f8a9c069910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:54.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.774+0000 7f8ac0664640 1 --2- 172.21.15.50:0/3865186 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f8a9c067450 0x7f8a9c069910 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8ab4005510 tx=0x7f8ab4009040 comp rx=0 tx=0).stop 2024-04-01T01:55:54.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.774+0000 7f8ac0664640 1 -- 172.21.15.50:0/3865186 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ab80c6a50 msgr2=0x7f8ab8150960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:54.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.774+0000 7f8ac0664640 1 --2- 172.21.15.50:0/3865186 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ab80c6a50 0x7f8ab8150960 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8aac00e8f0 tx=0x7f8aac00edb0 comp rx=0 tx=0).stop 2024-04-01T01:55:54.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.774+0000 7f8ac0664640 1 -- 172.21.15.50:0/3865186 shutdown_connections 2024-04-01T01:55:54.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.774+0000 7f8ac0664640 1 --2- 172.21.15.50:0/3865186 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f8a9c067450 0x7f8a9c069910 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:54.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.774+0000 7f8ac0664640 1 --2- 172.21.15.50:0/3865186 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8ab8153090 0x7f8ab81f20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:54.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.774+0000 7f8ac0664640 1 --2- 172.21.15.50:0/3865186 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ab80c6a50 0x7f8ab8150960 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:54.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.774+0000 7f8ac0664640 1 --2- 172.21.15.50:0/3865186 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8aa4004d50 0x7f8ab8152850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:54.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.774+0000 7f8ac0664640 1 -- 172.21.15.50:0/3865186 >> 172.21.15.50:0/3865186 conn(0x7f8ab806b820 msgr2=0x7f8ab815a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:55:54.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.774+0000 7f8ac0664640 1 -- 172.21.15.50:0/3865186 shutdown_connections 2024-04-01T01:55:54.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:54.774+0000 7f8ac0664640 1 -- 172.21.15.50:0/3865186 wait complete. 2024-04-01T01:55:54.792 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-04-01T01:55:54.064022+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":234636,"kb_used_data":1824,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754740084,"statfs":{"total":773094113280,"available":772853846016,"internally_reserved":0,"allocated":1867776,"data_stored":1762940,"data_compressed":66838,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.885862"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.485783+0000","last_change":"2024-04-01T01:55:49.279342+0000","last_active":"2024-04-01T01:55:50.485783+0000","last_peered":"2024-04-01T01:55:50.485783+0000","last_clean":"2024-04-01T01:55:50.485783+0000","last_became_active":"2024-04-01T01:55:49.279011+0000","last_became_peered":"2024-04-01T01:55:49.279011+0000","last_unstale":"2024-04-01T01:55:50.485783+0000","last_undegraded":"2024-04-01T01:55:50.485783+0000","last_fullsized":"2024-04-01T01:55:50.485783+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:56:11.350186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.227142+0000","last_change":"2024-04-01T01:55:49.247181+0000","last_active":"2024-04-01T01:55:50.227142+0000","last_peered":"2024-04-01T01:55:50.227142+0000","last_clean":"2024-04-01T01:55:50.227142+0000","last_became_active":"2024-04-01T01:55:49.246660+0000","last_became_peered":"2024-04-01T01:55:49.246660+0000","last_unstale":"2024-04-01T01:55:50.227142+0000","last_undegraded":"2024-04-01T01:55:50.227142+0000","last_fullsized":"2024-04-01T01:55:50.227142+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:27:12.089520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.226983+0000","last_change":"2024-04-01T01:55:49.240347+0000","last_active":"2024-04-01T01:55:50.226983+0000","last_peered":"2024-04-01T01:55:50.226983+0000","last_clean":"2024-04-01T01:55:50.226983+0000","last_became_active":"2024-04-01T01:55:49.239904+0000","last_became_peered":"2024-04-01T01:55:49.239904+0000","last_unstale":"2024-04-01T01:55:50.226983+0000","last_undegraded":"2024-04-01T01:55:50.226983+0000","last_fullsized":"2024-04-01T01:55:50.226983+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:37:43.280869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.667159+0000","last_change":"2024-04-01T01:55:49.279352+0000","last_active":"2024-04-01T01:55:50.667159+0000","last_peered":"2024-04-01T01:55:50.667159+0000","last_clean":"2024-04-01T01:55:50.667159+0000","last_became_active":"2024-04-01T01:55:49.279041+0000","last_became_peered":"2024-04-01T01:55:49.279041+0000","last_unstale":"2024-04-01T01:55:50.667159+0000","last_undegraded":"2024-04-01T01:55:50.667159+0000","last_fullsized":"2024-04-01T01:55:50.667159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:13:13.114168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.485298+0000","last_change":"2024-04-01T01:55:49.246874+0000","last_active":"2024-04-01T01:55:50.485298+0000","last_peered":"2024-04-01T01:55:50.485298+0000","last_clean":"2024-04-01T01:55:50.485298+0000","last_became_active":"2024-04-01T01:55:49.246152+0000","last_became_peered":"2024-04-01T01:55:49.246152+0000","last_unstale":"2024-04-01T01:55:50.485298+0000","last_undegraded":"2024-04-01T01:55:50.485298+0000","last_fullsized":"2024-04-01T01:55:50.485298+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:49:04.049108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.665855+0000","last_change":"2024-04-01T01:55:49.254029+0000","last_active":"2024-04-01T01:55:50.665855+0000","last_peered":"2024-04-01T01:55:50.665855+0000","last_clean":"2024-04-01T01:55:50.665855+0000","last_became_active":"2024-04-01T01:55:49.253348+0000","last_became_peered":"2024-04-01T01:55:49.253348+0000","last_unstale":"2024-04-01T01:55:50.665855+0000","last_undegraded":"2024-04-01T01:55:50.665855+0000","last_fullsized":"2024-04-01T01:55:50.665855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:33:56.754206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.484926+0000","last_change":"2024-04-01T01:55:49.247604+0000","last_active":"2024-04-01T01:55:50.484926+0000","last_peered":"2024-04-01T01:55:50.484926+0000","last_clean":"2024-04-01T01:55:50.484926+0000","last_became_active":"2024-04-01T01:55:49.247373+0000","last_became_peered":"2024-04-01T01:55:49.247373+0000","last_unstale":"2024-04-01T01:55:50.484926+0000","last_undegraded":"2024-04-01T01:55:50.484926+0000","last_fullsized":"2024-04-01T01:55:50.484926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:13:16.513095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.226492+0000","last_change":"2024-04-01T01:55:49.262994+0000","last_active":"2024-04-01T01:55:50.226492+0000","last_peered":"2024-04-01T01:55:50.226492+0000","last_clean":"2024-04-01T01:55:50.226492+0000","last_became_active":"2024-04-01T01:55:49.262736+0000","last_became_peered":"2024-04-01T01:55:49.262736+0000","last_unstale":"2024-04-01T01:55:50.226492+0000","last_undegraded":"2024-04-01T01:55:50.226492+0000","last_fullsized":"2024-04-01T01:55:50.226492+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:35:14.625545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.224583+0000","last_change":"2024-04-01T01:55:49.260244+0000","last_active":"2024-04-01T01:55:50.224583+0000","last_peered":"2024-04-01T01:55:50.224583+0000","last_clean":"2024-04-01T01:55:50.224583+0000","last_became_active":"2024-04-01T01:55:49.259745+0000","last_became_peered":"2024-04-01T01:55:49.259745+0000","last_unstale":"2024-04-01T01:55:50.224583+0000","last_undegraded":"2024-04-01T01:55:50.224583+0000","last_fullsized":"2024-04-01T01:55:50.224583+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:00:34.607980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.486080+0000","last_change":"2024-04-01T01:55:49.255260+0000","last_active":"2024-04-01T01:55:50.486080+0000","last_peered":"2024-04-01T01:55:50.486080+0000","last_clean":"2024-04-01T01:55:50.486080+0000","last_became_active":"2024-04-01T01:55:49.254408+0000","last_became_peered":"2024-04-01T01:55:49.254408+0000","last_unstale":"2024-04-01T01:55:50.486080+0000","last_undegraded":"2024-04-01T01:55:50.486080+0000","last_fullsized":"2024-04-01T01:55:50.486080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:02:41.829474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.485581+0000","last_change":"2024-04-01T01:55:49.271392+0000","last_active":"2024-04-01T01:55:50.485581+0000","last_peered":"2024-04-01T01:55:50.485581+0000","last_clean":"2024-04-01T01:55:50.485581+0000","last_became_active":"2024-04-01T01:55:49.270877+0000","last_became_peered":"2024-04-01T01:55:49.270877+0000","last_unstale":"2024-04-01T01:55:50.485581+0000","last_undegraded":"2024-04-01T01:55:50.485581+0000","last_fullsized":"2024-04-01T01:55:50.485581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:44:29.950624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.485029+0000","last_change":"2024-04-01T01:55:49.259816+0000","last_active":"2024-04-01T01:55:50.485029+0000","last_peered":"2024-04-01T01:55:50.485029+0000","last_clean":"2024-04-01T01:55:50.485029+0000","last_became_active":"2024-04-01T01:55:49.259193+0000","last_became_peered":"2024-04-01T01:55:49.259193+0000","last_unstale":"2024-04-01T01:55:50.485029+0000","last_undegraded":"2024-04-01T01:55:50.485029+0000","last_fullsized":"2024-04-01T01:55:50.485029+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:48:10.828398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.635725+0000","last_change":"2024-04-01T01:55:49.247878+0000","last_active":"2024-04-01T01:55:50.635725+0000","last_peered":"2024-04-01T01:55:50.635725+0000","last_clean":"2024-04-01T01:55:50.635725+0000","last_became_active":"2024-04-01T01:55:49.247436+0000","last_became_peered":"2024-04-01T01:55:49.247436+0000","last_unstale":"2024-04-01T01:55:50.635725+0000","last_undegraded":"2024-04-01T01:55:50.635725+0000","last_fullsized":"2024-04-01T01:55:50.635725+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:26:09.632757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.635921+0000","last_change":"2024-04-01T01:55:49.246266+0000","last_active":"2024-04-01T01:55:50.635921+0000","last_peered":"2024-04-01T01:55:50.635921+0000","last_clean":"2024-04-01T01:55:50.635921+0000","last_became_active":"2024-04-01T01:55:49.245650+0000","last_became_peered":"2024-04-01T01:55:49.245650+0000","last_unstale":"2024-04-01T01:55:50.635921+0000","last_undegraded":"2024-04-01T01:55:50.635921+0000","last_fullsized":"2024-04-01T01:55:50.635921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:14:32.577522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.225923+0000","last_change":"2024-04-01T01:55:49.248046+0000","last_active":"2024-04-01T01:55:50.225923+0000","last_peered":"2024-04-01T01:55:50.225923+0000","last_clean":"2024-04-01T01:55:50.225923+0000","last_became_active":"2024-04-01T01:55:49.247662+0000","last_became_peered":"2024-04-01T01:55:49.247662+0000","last_unstale":"2024-04-01T01:55:50.225923+0000","last_undegraded":"2024-04-01T01:55:50.225923+0000","last_fullsized":"2024-04-01T01:55:50.225923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:59:26.879090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.665743+0000","last_change":"2024-04-01T01:55:49.269484+0000","last_active":"2024-04-01T01:55:50.665743+0000","last_peered":"2024-04-01T01:55:50.665743+0000","last_clean":"2024-04-01T01:55:50.665743+0000","last_became_active":"2024-04-01T01:55:49.261839+0000","last_became_peered":"2024-04-01T01:55:49.261839+0000","last_unstale":"2024-04-01T01:55:50.665743+0000","last_undegraded":"2024-04-01T01:55:50.665743+0000","last_fullsized":"2024-04-01T01:55:50.665743+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:44:29.950624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.668406+0000","last_change":"2024-04-01T01:55:49.276113+0000","last_active":"2024-04-01T01:55:50.668406+0000","last_peered":"2024-04-01T01:55:50.668406+0000","last_clean":"2024-04-01T01:55:50.668406+0000","last_became_active":"2024-04-01T01:55:49.275727+0000","last_became_peered":"2024-04-01T01:55:49.275727+0000","last_unstale":"2024-04-01T01:55:50.668406+0000","last_undegraded":"2024-04-01T01:55:50.668406+0000","last_fullsized":"2024-04-01T01:55:50.668406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:50:59.209071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.665402+0000","last_change":"2024-04-01T01:55:49.252859+0000","last_active":"2024-04-01T01:55:50.665402+0000","last_peered":"2024-04-01T01:55:50.665402+0000","last_clean":"2024-04-01T01:55:50.665402+0000","last_became_active":"2024-04-01T01:55:49.252553+0000","last_became_peered":"2024-04-01T01:55:49.252553+0000","last_unstale":"2024-04-01T01:55:50.665402+0000","last_undegraded":"2024-04-01T01:55:50.665402+0000","last_fullsized":"2024-04-01T01:55:50.665402+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:13:13.114168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.667833+0000","last_change":"2024-04-01T01:55:49.260274+0000","last_active":"2024-04-01T01:55:50.667833+0000","last_peered":"2024-04-01T01:55:50.667833+0000","last_clean":"2024-04-01T01:55:50.667833+0000","last_became_active":"2024-04-01T01:55:49.259935+0000","last_became_peered":"2024-04-01T01:55:49.259935+0000","last_unstale":"2024-04-01T01:55:50.667833+0000","last_undegraded":"2024-04-01T01:55:50.667833+0000","last_fullsized":"2024-04-01T01:55:50.667833+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:24:55.348340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.485181+0000","last_change":"2024-04-01T01:55:49.259523+0000","last_active":"2024-04-01T01:55:50.485181+0000","last_peered":"2024-04-01T01:55:50.485181+0000","last_clean":"2024-04-01T01:55:50.485181+0000","last_became_active":"2024-04-01T01:55:49.258670+0000","last_became_peered":"2024-04-01T01:55:49.258670+0000","last_unstale":"2024-04-01T01:55:50.485181+0000","last_undegraded":"2024-04-01T01:55:50.485181+0000","last_fullsized":"2024-04-01T01:55:50.485181+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:08:54.832554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.226632+0000","last_change":"2024-04-01T01:55:49.243824+0000","last_active":"2024-04-01T01:55:50.226632+0000","last_peered":"2024-04-01T01:55:50.226632+0000","last_clean":"2024-04-01T01:55:50.226632+0000","last_became_active":"2024-04-01T01:55:49.243518+0000","last_became_peered":"2024-04-01T01:55:49.243518+0000","last_unstale":"2024-04-01T01:55:50.226632+0000","last_undegraded":"2024-04-01T01:55:50.226632+0000","last_fullsized":"2024-04-01T01:55:50.226632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:24:42.777720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.223859+0000","last_change":"2024-04-01T01:55:49.258207+0000","last_active":"2024-04-01T01:55:50.223859+0000","last_peered":"2024-04-01T01:55:50.223859+0000","last_clean":"2024-04-01T01:55:50.223859+0000","last_became_active":"2024-04-01T01:55:49.257576+0000","last_became_peered":"2024-04-01T01:55:49.257576+0000","last_unstale":"2024-04-01T01:55:50.223859+0000","last_undegraded":"2024-04-01T01:55:50.223859+0000","last_fullsized":"2024-04-01T01:55:50.223859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:13:13.114168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.226214+0000","last_change":"2024-04-01T01:55:49.250832+0000","last_active":"2024-04-01T01:55:50.226214+0000","last_peered":"2024-04-01T01:55:50.226214+0000","last_clean":"2024-04-01T01:55:50.226214+0000","last_became_active":"2024-04-01T01:55:49.250522+0000","last_became_peered":"2024-04-01T01:55:49.250522+0000","last_unstale":"2024-04-01T01:55:50.226214+0000","last_undegraded":"2024-04-01T01:55:50.226214+0000","last_fullsized":"2024-04-01T01:55:50.226214+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:47:04.592262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.665958+0000","last_change":"2024-04-01T01:55:49.270067+0000","last_active":"2024-04-01T01:55:50.665958+0000","last_peered":"2024-04-01T01:55:50.665958+0000","last_clean":"2024-04-01T01:55:50.665958+0000","last_became_active":"2024-04-01T01:55:49.269694+0000","last_became_peered":"2024-04-01T01:55:49.269694+0000","last_unstale":"2024-04-01T01:55:50.665958+0000","last_undegraded":"2024-04-01T01:55:50.665958+0000","last_fullsized":"2024-04-01T01:55:50.665958+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:21:46.367144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.227645+0000","last_change":"2024-04-01T01:55:49.243460+0000","last_active":"2024-04-01T01:55:50.227645+0000","last_peered":"2024-04-01T01:55:50.227645+0000","last_clean":"2024-04-01T01:55:50.227645+0000","last_became_active":"2024-04-01T01:55:49.243017+0000","last_became_peered":"2024-04-01T01:55:49.243017+0000","last_unstale":"2024-04-01T01:55:50.227645+0000","last_undegraded":"2024-04-01T01:55:50.227645+0000","last_fullsized":"2024-04-01T01:55:50.227645+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:20:18.156798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.667300+0000","last_change":"2024-04-01T01:55:49.280226+0000","last_active":"2024-04-01T01:55:50.667300+0000","last_peered":"2024-04-01T01:55:50.667300+0000","last_clean":"2024-04-01T01:55:50.667300+0000","last_became_active":"2024-04-01T01:55:49.279882+0000","last_became_peered":"2024-04-01T01:55:49.279882+0000","last_unstale":"2024-04-01T01:55:50.667300+0000","last_undegraded":"2024-04-01T01:55:50.667300+0000","last_fullsized":"2024-04-01T01:55:50.667300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:06:48.999905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.636174+0000","last_change":"2024-04-01T01:55:49.249890+0000","last_active":"2024-04-01T01:55:50.636174+0000","last_peered":"2024-04-01T01:55:50.636174+0000","last_clean":"2024-04-01T01:55:50.636174+0000","last_became_active":"2024-04-01T01:55:49.249588+0000","last_became_peered":"2024-04-01T01:55:49.249588+0000","last_unstale":"2024-04-01T01:55:50.636174+0000","last_undegraded":"2024-04-01T01:55:50.636174+0000","last_fullsized":"2024-04-01T01:55:50.636174+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:02:25.180455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.635657+0000","last_change":"2024-04-01T01:55:49.254529+0000","last_active":"2024-04-01T01:55:50.635657+0000","last_peered":"2024-04-01T01:55:50.635657+0000","last_clean":"2024-04-01T01:55:50.635657+0000","last_became_active":"2024-04-01T01:55:49.253726+0000","last_became_peered":"2024-04-01T01:55:49.253726+0000","last_unstale":"2024-04-01T01:55:50.635657+0000","last_undegraded":"2024-04-01T01:55:50.635657+0000","last_fullsized":"2024-04-01T01:55:50.635657+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:55:44.175129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.227405+0000","last_change":"2024-04-01T01:55:49.252043+0000","last_active":"2024-04-01T01:55:50.227405+0000","last_peered":"2024-04-01T01:55:50.227405+0000","last_clean":"2024-04-01T01:55:50.227405+0000","last_became_active":"2024-04-01T01:55:49.251760+0000","last_became_peered":"2024-04-01T01:55:49.251760+0000","last_unstale":"2024-04-01T01:55:50.227405+0000","last_undegraded":"2024-04-01T01:55:50.227405+0000","last_fullsized":"2024-04-01T01:55:50.227405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:12:25.325040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.666628+0000","last_change":"2024-04-01T01:55:49.270451+0000","last_active":"2024-04-01T01:55:50.666628+0000","last_peered":"2024-04-01T01:55:50.666628+0000","last_clean":"2024-04-01T01:55:50.666628+0000","last_became_active":"2024-04-01T01:55:49.269636+0000","last_became_peered":"2024-04-01T01:55:49.269636+0000","last_unstale":"2024-04-01T01:55:50.666628+0000","last_undegraded":"2024-04-01T01:55:50.666628+0000","last_fullsized":"2024-04-01T01:55:50.666628+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:11:14.234867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.664845+0000","last_change":"2024-04-01T01:55:49.266187+0000","last_active":"2024-04-01T01:55:50.664845+0000","last_peered":"2024-04-01T01:55:50.664845+0000","last_clean":"2024-04-01T01:55:50.664845+0000","last_became_active":"2024-04-01T01:55:49.265946+0000","last_became_peered":"2024-04-01T01:55:49.265946+0000","last_unstale":"2024-04-01T01:55:50.664845+0000","last_undegraded":"2024-04-01T01:55:50.664845+0000","last_fullsized":"2024-04-01T01:55:50.664845+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:37:46.890765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.665336+0000","last_change":"2024-04-01T01:55:49.273104+0000","last_active":"2024-04-01T01:55:50.665336+0000","last_peered":"2024-04-01T01:55:50.665336+0000","last_clean":"2024-04-01T01:55:50.665336+0000","last_became_active":"2024-04-01T01:55:49.272742+0000","last_became_peered":"2024-04-01T01:55:49.272742+0000","last_unstale":"2024-04-01T01:55:50.665336+0000","last_undegraded":"2024-04-01T01:55:50.665336+0000","last_fullsized":"2024-04-01T01:55:50.665336+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:37:46.890765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.224162+0000","last_change":"2024-04-01T01:55:49.241595+0000","last_active":"2024-04-01T01:55:50.224162+0000","last_peered":"2024-04-01T01:55:50.224162+0000","last_clean":"2024-04-01T01:55:50.224162+0000","last_became_active":"2024-04-01T01:55:49.238286+0000","last_became_peered":"2024-04-01T01:55:49.238286+0000","last_unstale":"2024-04-01T01:55:50.224162+0000","last_undegraded":"2024-04-01T01:55:50.224162+0000","last_fullsized":"2024-04-01T01:55:50.224162+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:06:48.999905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.226757+0000","last_change":"2024-04-01T01:55:48.225145+0000","last_active":"2024-04-01T01:55:50.226757+0000","last_peered":"2024-04-01T01:55:50.226757+0000","last_clean":"2024-04-01T01:55:50.226757+0000","last_became_active":"2024-04-01T01:55:48.224408+0000","last_became_peered":"2024-04-01T01:55:48.224408+0000","last_unstale":"2024-04-01T01:55:50.226757+0000","last_undegraded":"2024-04-01T01:55:50.226757+0000","last_fullsized":"2024-04-01T01:55:50.226757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:41:59.465915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.227045+0000","last_change":"2024-04-01T01:55:49.247771+0000","last_active":"2024-04-01T01:55:50.227045+0000","last_peered":"2024-04-01T01:55:50.227045+0000","last_clean":"2024-04-01T01:55:50.227045+0000","last_became_active":"2024-04-01T01:55:49.247496+0000","last_became_peered":"2024-04-01T01:55:49.247496+0000","last_unstale":"2024-04-01T01:55:50.227045+0000","last_undegraded":"2024-04-01T01:55:50.227045+0000","last_fullsized":"2024-04-01T01:55:50.227045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:02:25.180455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.666773+0000","last_change":"2024-04-01T01:55:48.221934+0000","last_active":"2024-04-01T01:55:50.666773+0000","last_peered":"2024-04-01T01:55:50.666773+0000","last_clean":"2024-04-01T01:55:50.666773+0000","last_became_active":"2024-04-01T01:55:48.221614+0000","last_became_peered":"2024-04-01T01:55:48.221614+0000","last_unstale":"2024-04-01T01:55:50.666773+0000","last_undegraded":"2024-04-01T01:55:50.666773+0000","last_fullsized":"2024-04-01T01:55:50.666773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:06:47.990123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.635306+0000","last_change":"2024-04-01T01:55:48.217879+0000","last_active":"2024-04-01T01:55:50.635306+0000","last_peered":"2024-04-01T01:55:50.635306+0000","last_clean":"2024-04-01T01:55:50.635306+0000","last_became_active":"2024-04-01T01:55:48.216141+0000","last_became_peered":"2024-04-01T01:55:48.216141+0000","last_unstale":"2024-04-01T01:55:50.635306+0000","last_undegraded":"2024-04-01T01:55:50.635306+0000","last_fullsized":"2024-04-01T01:55:50.635306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:36:42.625449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.227275+0000","last_change":"2024-04-01T01:55:49.246424+0000","last_active":"2024-04-01T01:55:50.227275+0000","last_peered":"2024-04-01T01:55:50.227275+0000","last_clean":"2024-04-01T01:55:50.227275+0000","last_became_active":"2024-04-01T01:55:49.243823+0000","last_became_peered":"2024-04-01T01:55:49.243823+0000","last_unstale":"2024-04-01T01:55:50.227275+0000","last_undegraded":"2024-04-01T01:55:50.227275+0000","last_fullsized":"2024-04-01T01:55:50.227275+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:27:45.663474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.665864+0000","last_change":"2024-04-01T01:55:48.222831+0000","last_active":"2024-04-01T01:55:50.665864+0000","last_peered":"2024-04-01T01:55:50.665864+0000","last_clean":"2024-04-01T01:55:50.665864+0000","last_became_active":"2024-04-01T01:55:48.222535+0000","last_became_peered":"2024-04-01T01:55:48.222535+0000","last_unstale":"2024-04-01T01:55:50.665864+0000","last_undegraded":"2024-04-01T01:55:50.665864+0000","last_fullsized":"2024-04-01T01:55:50.665864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:49:34.960786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.227957+0000","last_change":"2024-04-01T01:55:49.231967+0000","last_active":"2024-04-01T01:55:50.227957+0000","last_peered":"2024-04-01T01:55:50.227957+0000","last_clean":"2024-04-01T01:55:50.227957+0000","last_became_active":"2024-04-01T01:55:49.230659+0000","last_became_peered":"2024-04-01T01:55:49.230659+0000","last_unstale":"2024-04-01T01:55:50.227957+0000","last_undegraded":"2024-04-01T01:55:50.227957+0000","last_fullsized":"2024-04-01T01:55:50.227957+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:57:31.843504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.224697+0000","last_change":"2024-04-01T01:55:48.216724+0000","last_active":"2024-04-01T01:55:50.224697+0000","last_peered":"2024-04-01T01:55:50.224697+0000","last_clean":"2024-04-01T01:55:50.224697+0000","last_became_active":"2024-04-01T01:55:48.216318+0000","last_became_peered":"2024-04-01T01:55:48.216318+0000","last_unstale":"2024-04-01T01:55:50.224697+0000","last_undegraded":"2024-04-01T01:55:50.224697+0000","last_fullsized":"2024-04-01T01:55:50.224697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:25:51.219789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.667408+0000","last_change":"2024-04-01T01:55:49.280230+0000","last_active":"2024-04-01T01:55:50.667408+0000","last_peered":"2024-04-01T01:55:50.667408+0000","last_clean":"2024-04-01T01:55:50.667408+0000","last_became_active":"2024-04-01T01:55:49.279866+0000","last_became_peered":"2024-04-01T01:55:49.279866+0000","last_unstale":"2024-04-01T01:55:50.667408+0000","last_undegraded":"2024-04-01T01:55:50.667408+0000","last_fullsized":"2024-04-01T01:55:50.667408+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:00:34.607980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.485507+0000","last_change":"2024-04-01T01:55:48.213879+0000","last_active":"2024-04-01T01:55:50.485507+0000","last_peered":"2024-04-01T01:55:50.485507+0000","last_clean":"2024-04-01T01:55:50.485507+0000","last_became_active":"2024-04-01T01:55:48.213610+0000","last_became_peered":"2024-04-01T01:55:48.213610+0000","last_unstale":"2024-04-01T01:55:50.485507+0000","last_undegraded":"2024-04-01T01:55:50.485507+0000","last_fullsized":"2024-04-01T01:55:50.485507+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:33:55.744424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.228364+0000","last_change":"2024-04-01T01:55:49.261532+0000","last_active":"2024-04-01T01:55:50.228364+0000","last_peered":"2024-04-01T01:55:50.228364+0000","last_clean":"2024-04-01T01:55:50.228364+0000","last_became_active":"2024-04-01T01:55:49.261260+0000","last_became_peered":"2024-04-01T01:55:49.261260+0000","last_unstale":"2024-04-01T01:55:50.228364+0000","last_undegraded":"2024-04-01T01:55:50.228364+0000","last_fullsized":"2024-04-01T01:55:50.228364+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:30:02.149564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.665057+0000","last_change":"2024-04-01T01:55:48.227054+0000","last_active":"2024-04-01T01:55:50.665057+0000","last_peered":"2024-04-01T01:55:50.665057+0000","last_clean":"2024-04-01T01:55:50.665057+0000","last_became_active":"2024-04-01T01:55:48.226061+0000","last_became_peered":"2024-04-01T01:55:48.226061+0000","last_unstale":"2024-04-01T01:55:50.665057+0000","last_undegraded":"2024-04-01T01:55:50.665057+0000","last_fullsized":"2024-04-01T01:55:50.665057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:18:27.840431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.666111+0000","last_change":"2024-04-01T01:55:49.261662+0000","last_active":"2024-04-01T01:55:50.666111+0000","last_peered":"2024-04-01T01:55:50.666111+0000","last_clean":"2024-04-01T01:55:50.666111+0000","last_became_active":"2024-04-01T01:55:49.261286+0000","last_became_peered":"2024-04-01T01:55:49.261286+0000","last_unstale":"2024-04-01T01:55:50.666111+0000","last_undegraded":"2024-04-01T01:55:50.666111+0000","last_fullsized":"2024-04-01T01:55:50.666111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:56:11.350186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.667035+0000","last_change":"2024-04-01T01:55:48.219739+0000","last_active":"2024-04-01T01:55:50.667035+0000","last_peered":"2024-04-01T01:55:50.667035+0000","last_clean":"2024-04-01T01:55:50.667035+0000","last_became_active":"2024-04-01T01:55:48.219107+0000","last_became_peered":"2024-04-01T01:55:48.219107+0000","last_unstale":"2024-04-01T01:55:50.667035+0000","last_undegraded":"2024-04-01T01:55:50.667035+0000","last_fullsized":"2024-04-01T01:55:50.667035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:14:12.790111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.485917+0000","last_change":"2024-04-01T01:55:49.255056+0000","last_active":"2024-04-01T01:55:50.485917+0000","last_peered":"2024-04-01T01:55:50.485917+0000","last_clean":"2024-04-01T01:55:50.485917+0000","last_became_active":"2024-04-01T01:55:49.247910+0000","last_became_peered":"2024-04-01T01:55:49.247910+0000","last_unstale":"2024-04-01T01:55:50.485917+0000","last_undegraded":"2024-04-01T01:55:50.485917+0000","last_fullsized":"2024-04-01T01:55:50.485917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T13:02:55.577616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.665142+0000","last_change":"2024-04-01T01:55:48.215613+0000","last_active":"2024-04-01T01:55:50.665142+0000","last_peered":"2024-04-01T01:55:50.665142+0000","last_clean":"2024-04-01T01:55:50.665142+0000","last_became_active":"2024-04-01T01:55:48.214669+0000","last_became_peered":"2024-04-01T01:55:48.214669+0000","last_unstale":"2024-04-01T01:55:50.665142+0000","last_undegraded":"2024-04-01T01:55:50.665142+0000","last_fullsized":"2024-04-01T01:55:50.665142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:25:51.219789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.635349+0000","last_change":"2024-04-01T01:55:49.270153+0000","last_active":"2024-04-01T01:55:50.635349+0000","last_peered":"2024-04-01T01:55:50.635349+0000","last_clean":"2024-04-01T01:55:50.635349+0000","last_became_active":"2024-04-01T01:55:49.269840+0000","last_became_peered":"2024-04-01T01:55:49.269840+0000","last_unstale":"2024-04-01T01:55:50.635349+0000","last_undegraded":"2024-04-01T01:55:50.635349+0000","last_fullsized":"2024-04-01T01:55:50.635349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:00:34.607980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.667049+0000","last_change":"2024-04-01T01:55:48.214783+0000","last_active":"2024-04-01T01:55:50.667049+0000","last_peered":"2024-04-01T01:55:50.667049+0000","last_clean":"2024-04-01T01:55:50.667049+0000","last_became_active":"2024-04-01T01:55:48.213463+0000","last_became_peered":"2024-04-01T01:55:48.213463+0000","last_unstale":"2024-04-01T01:55:50.667049+0000","last_undegraded":"2024-04-01T01:55:50.667049+0000","last_fullsized":"2024-04-01T01:55:50.667049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:00:33.598198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.666568+0000","last_change":"2024-04-01T01:55:49.274841+0000","last_active":"2024-04-01T01:55:50.666568+0000","last_peered":"2024-04-01T01:55:50.666568+0000","last_clean":"2024-04-01T01:55:50.666568+0000","last_became_active":"2024-04-01T01:55:49.274430+0000","last_became_peered":"2024-04-01T01:55:49.274430+0000","last_unstale":"2024-04-01T01:55:50.666568+0000","last_undegraded":"2024-04-01T01:55:50.666568+0000","last_fullsized":"2024-04-01T01:55:50.666568+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T13:25:36.254927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.484812+0000","last_change":"2024-04-01T01:55:48.210944+0000","last_active":"2024-04-01T01:55:50.484812+0000","last_peered":"2024-04-01T01:55:50.484812+0000","last_clean":"2024-04-01T01:55:50.484812+0000","last_became_active":"2024-04-01T01:55:48.210616+0000","last_became_peered":"2024-04-01T01:55:48.210616+0000","last_unstale":"2024-04-01T01:55:50.484812+0000","last_undegraded":"2024-04-01T01:55:50.484812+0000","last_fullsized":"2024-04-01T01:55:50.484812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:38:32.247471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.223513+0000","last_change":"2024-04-01T01:55:49.239528+0000","last_active":"2024-04-01T01:55:50.223513+0000","last_peered":"2024-04-01T01:55:50.223513+0000","last_clean":"2024-04-01T01:55:50.223513+0000","last_became_active":"2024-04-01T01:55:49.238805+0000","last_became_peered":"2024-04-01T01:55:49.238805+0000","last_unstale":"2024-04-01T01:55:50.223513+0000","last_undegraded":"2024-04-01T01:55:50.223513+0000","last_fullsized":"2024-04-01T01:55:50.223513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:37:46.890765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.226599+0000","last_change":"2024-04-01T01:55:48.211677+0000","last_active":"2024-04-01T01:55:50.226599+0000","last_peered":"2024-04-01T01:55:50.226599+0000","last_clean":"2024-04-01T01:55:50.226599+0000","last_became_active":"2024-04-01T01:55:48.210893+0000","last_became_peered":"2024-04-01T01:55:48.210893+0000","last_unstale":"2024-04-01T01:55:50.226599+0000","last_undegraded":"2024-04-01T01:55:50.226599+0000","last_fullsized":"2024-04-01T01:55:50.226599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:04:19.568533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.666123+0000","last_change":"2024-04-01T01:55:49.261872+0000","last_active":"2024-04-01T01:55:50.666123+0000","last_peered":"2024-04-01T01:55:50.666123+0000","last_clean":"2024-04-01T01:55:50.666123+0000","last_became_active":"2024-04-01T01:55:49.261517+0000","last_became_peered":"2024-04-01T01:55:49.261517+0000","last_unstale":"2024-04-01T01:55:50.666123+0000","last_undegraded":"2024-04-01T01:55:50.666123+0000","last_fullsized":"2024-04-01T01:55:50.666123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T13:02:55.577616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.485838+0000","last_change":"2024-04-01T01:55:48.198687+0000","last_active":"2024-04-01T01:55:50.485838+0000","last_peered":"2024-04-01T01:55:50.485838+0000","last_clean":"2024-04-01T01:55:50.485838+0000","last_became_active":"2024-04-01T01:55:48.198319+0000","last_became_peered":"2024-04-01T01:55:48.198319+0000","last_unstale":"2024-04-01T01:55:50.485838+0000","last_undegraded":"2024-04-01T01:55:50.485838+0000","last_fullsized":"2024-04-01T01:55:50.485838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:37:45.880984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.667742+0000","last_change":"2024-04-01T01:55:49.272424+0000","last_active":"2024-04-01T01:55:50.667742+0000","last_peered":"2024-04-01T01:55:50.667742+0000","last_clean":"2024-04-01T01:55:50.667742+0000","last_became_active":"2024-04-01T01:55:49.265670+0000","last_became_peered":"2024-04-01T01:55:49.265670+0000","last_unstale":"2024-04-01T01:55:50.667742+0000","last_undegraded":"2024-04-01T01:55:50.667742+0000","last_fullsized":"2024-04-01T01:55:50.667742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:26:09.632757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.227729+0000","last_change":"2024-04-01T01:55:48.219312+0000","last_active":"2024-04-01T01:55:50.227729+0000","last_peered":"2024-04-01T01:55:50.227729+0000","last_clean":"2024-04-01T01:55:50.227729+0000","last_became_active":"2024-04-01T01:55:48.218562+0000","last_became_peered":"2024-04-01T01:55:48.218562+0000","last_unstale":"2024-04-01T01:55:50.227729+0000","last_undegraded":"2024-04-01T01:55:50.227729+0000","last_fullsized":"2024-04-01T01:55:50.227729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:38:32.247471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.485763+0000","last_change":"2024-04-01T01:55:49.268041+0000","last_active":"2024-04-01T01:55:50.485763+0000","last_peered":"2024-04-01T01:55:50.485763+0000","last_clean":"2024-04-01T01:55:50.485763+0000","last_became_active":"2024-04-01T01:55:49.267502+0000","last_became_peered":"2024-04-01T01:55:49.267502+0000","last_unstale":"2024-04-01T01:55:50.485763+0000","last_undegraded":"2024-04-01T01:55:50.485763+0000","last_fullsized":"2024-04-01T01:55:50.485763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:21:46.367144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.227260+0000","last_change":"2024-04-01T01:55:48.216662+0000","last_active":"2024-04-01T01:55:50.227260+0000","last_peered":"2024-04-01T01:55:50.227260+0000","last_clean":"2024-04-01T01:55:50.227260+0000","last_became_active":"2024-04-01T01:55:48.215852+0000","last_became_peered":"2024-04-01T01:55:48.215852+0000","last_unstale":"2024-04-01T01:55:50.227260+0000","last_undegraded":"2024-04-01T01:55:50.227260+0000","last_fullsized":"2024-04-01T01:55:50.227260+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:25:39.713293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.485456+0000","last_change":"2024-04-01T01:55:49.256142+0000","last_active":"2024-04-01T01:55:50.485456+0000","last_peered":"2024-04-01T01:55:50.485456+0000","last_clean":"2024-04-01T01:55:50.485456+0000","last_became_active":"2024-04-01T01:55:49.255781+0000","last_became_peered":"2024-04-01T01:55:49.255781+0000","last_unstale":"2024-04-01T01:55:50.485456+0000","last_undegraded":"2024-04-01T01:55:50.485456+0000","last_fullsized":"2024-04-01T01:55:50.485456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:10:23.571126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.635926+0000","last_change":"2024-04-01T01:55:48.219851+0000","last_active":"2024-04-01T01:55:50.635926+0000","last_peered":"2024-04-01T01:55:50.635926+0000","last_clean":"2024-04-01T01:55:50.635926+0000","last_became_active":"2024-04-01T01:55:48.215898+0000","last_became_peered":"2024-04-01T01:55:48.215898+0000","last_unstale":"2024-04-01T01:55:50.635926+0000","last_undegraded":"2024-04-01T01:55:50.635926+0000","last_fullsized":"2024-04-01T01:55:50.635926+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:18:27.840431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.667778+0000","last_change":"2024-04-01T01:55:49.275452+0000","last_active":"2024-04-01T01:55:50.667778+0000","last_peered":"2024-04-01T01:55:50.667778+0000","last_clean":"2024-04-01T01:55:50.667778+0000","last_became_active":"2024-04-01T01:55:49.274600+0000","last_became_peered":"2024-04-01T01:55:49.274600+0000","last_unstale":"2024-04-01T01:55:50.667778+0000","last_undegraded":"2024-04-01T01:55:50.667778+0000","last_fullsized":"2024-04-01T01:55:50.667778+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:19:24.052574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.223321+0000","last_change":"2024-04-01T01:55:43.145201+0000","last_active":"2024-04-01T01:55:50.223321+0000","last_peered":"2024-04-01T01:55:50.223321+0000","last_clean":"2024-04-01T01:55:50.223321+0000","last_became_active":"2024-04-01T01:55:43.144882+0000","last_became_peered":"2024-04-01T01:55:43.144882+0000","last_unstale":"2024-04-01T01:55:50.223321+0000","last_undegraded":"2024-04-01T01:55:50.223321+0000","last_fullsized":"2024-04-01T01:55:50.223321+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:42.134502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:42.134502+0000","last_clean_scrub_stamp":"2024-04-01T01:55:42.134502+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:02:26.589535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.666696+0000","last_change":"2024-04-01T01:55:48.207222+0000","last_active":"2024-04-01T01:55:50.666696+0000","last_peered":"2024-04-01T01:55:50.666696+0000","last_clean":"2024-04-01T01:55:50.666696+0000","last_became_active":"2024-04-01T01:55:48.206293+0000","last_became_peered":"2024-04-01T01:55:48.206293+0000","last_unstale":"2024-04-01T01:55:50.666696+0000","last_undegraded":"2024-04-01T01:55:50.666696+0000","last_fullsized":"2024-04-01T01:55:50.666696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:37:45.880984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.226523+0000","last_change":"2024-04-01T01:55:49.273517+0000","last_active":"2024-04-01T01:55:50.226523+0000","last_peered":"2024-04-01T01:55:50.226523+0000","last_clean":"2024-04-01T01:55:50.226523+0000","last_became_active":"2024-04-01T01:55:49.273197+0000","last_became_peered":"2024-04-01T01:55:49.273197+0000","last_unstale":"2024-04-01T01:55:50.226523+0000","last_undegraded":"2024-04-01T01:55:50.226523+0000","last_fullsized":"2024-04-01T01:55:50.226523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:14:32.577522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.666134+0000","last_change":"2024-04-01T01:55:48.214341+0000","last_active":"2024-04-01T01:55:50.666134+0000","last_peered":"2024-04-01T01:55:50.666134+0000","last_clean":"2024-04-01T01:55:50.666134+0000","last_became_active":"2024-04-01T01:55:48.213914+0000","last_became_peered":"2024-04-01T01:55:48.213914+0000","last_unstale":"2024-04-01T01:55:50.666134+0000","last_undegraded":"2024-04-01T01:55:50.666134+0000","last_fullsized":"2024-04-01T01:55:50.666134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:09:28.276592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.636256+0000","last_change":"2024-04-01T01:55:49.272106+0000","last_active":"2024-04-01T01:55:50.636256+0000","last_peered":"2024-04-01T01:55:50.636256+0000","last_clean":"2024-04-01T01:55:50.636256+0000","last_became_active":"2024-04-01T01:55:49.271821+0000","last_became_peered":"2024-04-01T01:55:49.271821+0000","last_unstale":"2024-04-01T01:55:50.636256+0000","last_undegraded":"2024-04-01T01:55:50.636256+0000","last_fullsized":"2024-04-01T01:55:50.636256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T13:22:31.821166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.664742+0000","last_change":"2024-04-01T01:55:48.218296+0000","last_active":"2024-04-01T01:55:50.664742+0000","last_peered":"2024-04-01T01:55:50.664742+0000","last_clean":"2024-04-01T01:55:50.664742+0000","last_became_active":"2024-04-01T01:55:48.217516+0000","last_became_peered":"2024-04-01T01:55:48.217516+0000","last_unstale":"2024-04-01T01:55:50.664742+0000","last_undegraded":"2024-04-01T01:55:50.664742+0000","last_fullsized":"2024-04-01T01:55:50.664742+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:36:42.625449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.226891+0000","last_change":"2024-04-01T01:55:49.246734+0000","last_active":"2024-04-01T01:55:50.226891+0000","last_peered":"2024-04-01T01:55:50.226891+0000","last_clean":"2024-04-01T01:55:50.226891+0000","last_became_active":"2024-04-01T01:55:49.246152+0000","last_became_peered":"2024-04-01T01:55:49.246152+0000","last_unstale":"2024-04-01T01:55:50.226891+0000","last_undegraded":"2024-04-01T01:55:50.226891+0000","last_fullsized":"2024-04-01T01:55:50.226891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:52:34.992185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.667221+0000","last_change":"2024-04-01T01:55:48.222956+0000","last_active":"2024-04-01T01:55:50.667221+0000","last_peered":"2024-04-01T01:55:50.667221+0000","last_clean":"2024-04-01T01:55:50.667221+0000","last_became_active":"2024-04-01T01:55:48.222414+0000","last_became_peered":"2024-04-01T01:55:48.222414+0000","last_unstale":"2024-04-01T01:55:50.667221+0000","last_undegraded":"2024-04-01T01:55:50.667221+0000","last_fullsized":"2024-04-01T01:55:50.667221+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:26:08.622975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.485388+0000","last_change":"2024-04-01T01:55:49.247633+0000","last_active":"2024-04-01T01:55:50.485388+0000","last_peered":"2024-04-01T01:55:50.485388+0000","last_clean":"2024-04-01T01:55:50.485388+0000","last_became_active":"2024-04-01T01:55:49.247285+0000","last_became_peered":"2024-04-01T01:55:49.247285+0000","last_unstale":"2024-04-01T01:55:50.485388+0000","last_undegraded":"2024-04-01T01:55:50.485388+0000","last_fullsized":"2024-04-01T01:55:50.485388+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:15:01.912111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.226200+0000","last_change":"2024-04-01T01:55:48.226323+0000","last_active":"2024-04-01T01:55:50.226200+0000","last_peered":"2024-04-01T01:55:50.226200+0000","last_clean":"2024-04-01T01:55:50.226200+0000","last_became_active":"2024-04-01T01:55:48.225487+0000","last_became_peered":"2024-04-01T01:55:48.225487+0000","last_unstale":"2024-04-01T01:55:50.226200+0000","last_undegraded":"2024-04-01T01:55:50.226200+0000","last_fullsized":"2024-04-01T01:55:50.226200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:13:17.832963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.667602+0000","last_change":"2024-04-01T01:55:49.265542+0000","last_active":"2024-04-01T01:55:50.667602+0000","last_peered":"2024-04-01T01:55:50.667602+0000","last_clean":"2024-04-01T01:55:50.667602+0000","last_became_active":"2024-04-01T01:55:49.264914+0000","last_became_peered":"2024-04-01T01:55:49.264914+0000","last_unstale":"2024-04-01T01:55:50.667602+0000","last_undegraded":"2024-04-01T01:55:50.667602+0000","last_fullsized":"2024-04-01T01:55:50.667602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:55:44.175129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.667910+0000","last_change":"2024-04-01T01:55:48.227292+0000","last_active":"2024-04-01T01:55:50.667910+0000","last_peered":"2024-04-01T01:55:50.667910+0000","last_clean":"2024-04-01T01:55:50.667910+0000","last_became_active":"2024-04-01T01:55:48.226948+0000","last_became_peered":"2024-04-01T01:55:48.226948+0000","last_unstale":"2024-04-01T01:55:50.667910+0000","last_undegraded":"2024-04-01T01:55:50.667910+0000","last_fullsized":"2024-04-01T01:55:50.667910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:55:43.165347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.636006+0000","last_change":"2024-04-01T01:55:49.244171+0000","last_active":"2024-04-01T01:55:50.636006+0000","last_peered":"2024-04-01T01:55:50.636006+0000","last_clean":"2024-04-01T01:55:50.636006+0000","last_became_active":"2024-04-01T01:55:49.241632+0000","last_became_peered":"2024-04-01T01:55:49.241632+0000","last_unstale":"2024-04-01T01:55:50.636006+0000","last_undegraded":"2024-04-01T01:55:50.636006+0000","last_fullsized":"2024-04-01T01:55:50.636006+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:24:42.777720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.228150+0000","last_change":"2024-04-01T01:55:48.204432+0000","last_active":"2024-04-01T01:55:50.228150+0000","last_peered":"2024-04-01T01:55:50.228150+0000","last_clean":"2024-04-01T01:55:50.228150+0000","last_became_active":"2024-04-01T01:55:48.203576+0000","last_became_peered":"2024-04-01T01:55:48.203576+0000","last_unstale":"2024-04-01T01:55:50.228150+0000","last_undegraded":"2024-04-01T01:55:50.228150+0000","last_fullsized":"2024-04-01T01:55:50.228150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:49:34.960786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.227962+0000","last_change":"2024-04-01T01:55:49.244993+0000","last_active":"2024-04-01T01:55:50.227962+0000","last_peered":"2024-04-01T01:55:50.227962+0000","last_clean":"2024-04-01T01:55:50.227962+0000","last_became_active":"2024-04-01T01:55:49.244632+0000","last_became_peered":"2024-04-01T01:55:49.244632+0000","last_unstale":"2024-04-01T01:55:50.227962+0000","last_undegraded":"2024-04-01T01:55:50.227962+0000","last_fullsized":"2024-04-01T01:55:50.227962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:30:26.148968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.668315+0000","last_change":"2024-04-01T01:55:48.221282+0000","last_active":"2024-04-01T01:55:50.668315+0000","last_peered":"2024-04-01T01:55:50.668315+0000","last_clean":"2024-04-01T01:55:50.668315+0000","last_became_active":"2024-04-01T01:55:48.220889+0000","last_became_peered":"2024-04-01T01:55:48.220889+0000","last_unstale":"2024-04-01T01:55:50.668315+0000","last_undegraded":"2024-04-01T01:55:50.668315+0000","last_fullsized":"2024-04-01T01:55:50.668315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:13:12.104386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.227472+0000","last_change":"2024-04-01T01:55:49.251927+0000","last_active":"2024-04-01T01:55:50.227472+0000","last_peered":"2024-04-01T01:55:50.227472+0000","last_clean":"2024-04-01T01:55:50.227472+0000","last_became_active":"2024-04-01T01:55:49.251641+0000","last_became_peered":"2024-04-01T01:55:49.251641+0000","last_unstale":"2024-04-01T01:55:50.227472+0000","last_undegraded":"2024-04-01T01:55:50.227472+0000","last_fullsized":"2024-04-01T01:55:50.227472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T13:22:31.821166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.484332+0000","last_change":"2024-04-01T01:55:48.204161+0000","last_active":"2024-04-01T01:55:50.484332+0000","last_peered":"2024-04-01T01:55:50.484332+0000","last_clean":"2024-04-01T01:55:50.484332+0000","last_became_active":"2024-04-01T01:55:48.203828+0000","last_became_peered":"2024-04-01T01:55:48.203828+0000","last_unstale":"2024-04-01T01:55:50.484332+0000","last_undegraded":"2024-04-01T01:55:50.484332+0000","last_fullsized":"2024-04-01T01:55:50.484332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:04:19.568533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.666187+0000","last_change":"2024-04-01T01:55:49.259699+0000","last_active":"2024-04-01T01:55:50.666187+0000","last_peered":"2024-04-01T01:55:50.666187+0000","last_clean":"2024-04-01T01:55:50.666187+0000","last_became_active":"2024-04-01T01:55:49.259332+0000","last_became_peered":"2024-04-01T01:55:49.259332+0000","last_unstale":"2024-04-01T01:55:50.666187+0000","last_undegraded":"2024-04-01T01:55:50.666187+0000","last_fullsized":"2024-04-01T01:55:50.666187+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:02:41.829474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.227810+0000","last_change":"2024-04-01T01:55:48.206742+0000","last_active":"2024-04-01T01:55:50.227810+0000","last_peered":"2024-04-01T01:55:50.227810+0000","last_clean":"2024-04-01T01:55:50.227810+0000","last_became_active":"2024-04-01T01:55:48.206027+0000","last_became_peered":"2024-04-01T01:55:48.206027+0000","last_unstale":"2024-04-01T01:55:50.227810+0000","last_undegraded":"2024-04-01T01:55:50.227810+0000","last_fullsized":"2024-04-01T01:55:50.227810+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:18:27.840431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.228142+0000","last_change":"2024-04-01T01:55:49.246379+0000","last_active":"2024-04-01T01:55:50.228142+0000","last_peered":"2024-04-01T01:55:50.228142+0000","last_clean":"2024-04-01T01:55:50.228142+0000","last_became_active":"2024-04-01T01:55:49.245774+0000","last_became_peered":"2024-04-01T01:55:49.245774+0000","last_unstale":"2024-04-01T01:55:50.228142+0000","last_undegraded":"2024-04-01T01:55:50.228142+0000","last_fullsized":"2024-04-01T01:55:50.228142+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:25:48.896071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.635697+0000","last_change":"2024-04-01T01:55:48.222218+0000","last_active":"2024-04-01T01:55:50.635697+0000","last_peered":"2024-04-01T01:55:50.635697+0000","last_clean":"2024-04-01T01:55:50.635697+0000","last_became_active":"2024-04-01T01:55:48.221148+0000","last_became_peered":"2024-04-01T01:55:48.221148+0000","last_unstale":"2024-04-01T01:55:50.635697+0000","last_undegraded":"2024-04-01T01:55:50.635697+0000","last_fullsized":"2024-04-01T01:55:50.635697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:25:51.219789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.665026+0000","last_change":"2024-04-01T01:55:49.249648+0000","last_active":"2024-04-01T01:55:50.665026+0000","last_peered":"2024-04-01T01:55:50.665026+0000","last_clean":"2024-04-01T01:55:50.665026+0000","last_became_active":"2024-04-01T01:55:49.248925+0000","last_became_peered":"2024-04-01T01:55:49.248925+0000","last_unstale":"2024-04-01T01:55:50.665026+0000","last_undegraded":"2024-04-01T01:55:50.665026+0000","last_fullsized":"2024-04-01T01:55:50.665026+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:33:56.754206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.666488+0000","last_change":"2024-04-01T01:55:48.207522+0000","last_active":"2024-04-01T01:55:50.666488+0000","last_peered":"2024-04-01T01:55:50.666488+0000","last_clean":"2024-04-01T01:55:50.666488+0000","last_became_active":"2024-04-01T01:55:48.206856+0000","last_became_peered":"2024-04-01T01:55:48.206856+0000","last_unstale":"2024-04-01T01:55:50.666488+0000","last_undegraded":"2024-04-01T01:55:50.666488+0000","last_fullsized":"2024-04-01T01:55:50.666488+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:33:55.744424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.667078+0000","last_change":"2024-04-01T01:55:49.274489+0000","last_active":"2024-04-01T01:55:50.667078+0000","last_peered":"2024-04-01T01:55:50.667078+0000","last_clean":"2024-04-01T01:55:50.667078+0000","last_became_active":"2024-04-01T01:55:49.270254+0000","last_became_peered":"2024-04-01T01:55:49.270254+0000","last_unstale":"2024-04-01T01:55:50.667078+0000","last_undegraded":"2024-04-01T01:55:50.667078+0000","last_fullsized":"2024-04-01T01:55:50.667078+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T13:09:00.491227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.666309+0000","last_change":"2024-04-01T01:55:49.275782+0000","last_active":"2024-04-01T01:55:50.666309+0000","last_peered":"2024-04-01T01:55:50.666309+0000","last_clean":"2024-04-01T01:55:50.666309+0000","last_became_active":"2024-04-01T01:55:49.275050+0000","last_became_peered":"2024-04-01T01:55:49.275050+0000","last_unstale":"2024-04-01T01:55:50.666309+0000","last_undegraded":"2024-04-01T01:55:50.666309+0000","last_fullsized":"2024-04-01T01:55:50.666309+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:26:15.406856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.485245+0000","last_change":"2024-04-01T01:55:48.223704+0000","last_active":"2024-04-01T01:55:50.485245+0000","last_peered":"2024-04-01T01:55:50.485245+0000","last_clean":"2024-04-01T01:55:50.485245+0000","last_became_active":"2024-04-01T01:55:48.223220+0000","last_became_peered":"2024-04-01T01:55:48.223220+0000","last_unstale":"2024-04-01T01:55:50.485245+0000","last_undegraded":"2024-04-01T01:55:50.485245+0000","last_fullsized":"2024-04-01T01:55:50.485245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:49:34.960786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.223741+0000","last_change":"2024-04-01T01:55:49.264857+0000","last_active":"2024-04-01T01:55:50.223741+0000","last_peered":"2024-04-01T01:55:50.223741+0000","last_clean":"2024-04-01T01:55:50.223741+0000","last_became_active":"2024-04-01T01:55:49.258478+0000","last_became_peered":"2024-04-01T01:55:49.258478+0000","last_unstale":"2024-04-01T01:55:50.223741+0000","last_undegraded":"2024-04-01T01:55:50.223741+0000","last_fullsized":"2024-04-01T01:55:50.223741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:33:56.754206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.485995+0000","last_change":"2024-04-01T01:55:48.218370+0000","last_active":"2024-04-01T01:55:50.485995+0000","last_peered":"2024-04-01T01:55:50.485995+0000","last_clean":"2024-04-01T01:55:50.485995+0000","last_became_active":"2024-04-01T01:55:48.217755+0000","last_became_peered":"2024-04-01T01:55:48.217755+0000","last_unstale":"2024-04-01T01:55:50.485995+0000","last_undegraded":"2024-04-01T01:55:50.485995+0000","last_fullsized":"2024-04-01T01:55:50.485995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:09:28.276592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.228017+0000","last_change":"2024-04-01T01:55:49.243377+0000","last_active":"2024-04-01T01:55:50.228017+0000","last_peered":"2024-04-01T01:55:50.228017+0000","last_clean":"2024-04-01T01:55:50.228017+0000","last_became_active":"2024-04-01T01:55:49.242851+0000","last_became_peered":"2024-04-01T01:55:49.242851+0000","last_unstale":"2024-04-01T01:55:50.228017+0000","last_undegraded":"2024-04-01T01:55:50.228017+0000","last_fullsized":"2024-04-01T01:55:50.228017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:48:38.596647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.227487+0000","last_change":"2024-04-01T01:55:48.213862+0000","last_active":"2024-04-01T01:55:50.227487+0000","last_peered":"2024-04-01T01:55:50.227487+0000","last_clean":"2024-04-01T01:55:50.227487+0000","last_became_active":"2024-04-01T01:55:48.213122+0000","last_became_peered":"2024-04-01T01:55:48.213122+0000","last_unstale":"2024-04-01T01:55:50.227487+0000","last_undegraded":"2024-04-01T01:55:50.227487+0000","last_fullsized":"2024-04-01T01:55:50.227487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:59:23.563864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.227575+0000","last_change":"2024-04-01T01:55:49.252273+0000","last_active":"2024-04-01T01:55:50.227575+0000","last_peered":"2024-04-01T01:55:50.227575+0000","last_clean":"2024-04-01T01:55:50.227575+0000","last_became_active":"2024-04-01T01:55:49.251963+0000","last_became_peered":"2024-04-01T01:55:49.251963+0000","last_unstale":"2024-04-01T01:55:50.227575+0000","last_undegraded":"2024-04-01T01:55:50.227575+0000","last_fullsized":"2024-04-01T01:55:50.227575+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:56:18.086766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.227756+0000","last_change":"2024-04-01T01:55:48.225858+0000","last_active":"2024-04-01T01:55:50.227756+0000","last_peered":"2024-04-01T01:55:50.227756+0000","last_clean":"2024-04-01T01:55:50.227756+0000","last_became_active":"2024-04-01T01:55:48.224494+0000","last_became_peered":"2024-04-01T01:55:48.224494+0000","last_unstale":"2024-04-01T01:55:50.227756+0000","last_undegraded":"2024-04-01T01:55:50.227756+0000","last_fullsized":"2024-04-01T01:55:50.227756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:09:28.276592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66838,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509446,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":74457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509444,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31388,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340452,"statfs":{"total":96636764160,"available":96604622848,"internally_reserved":0,"allocated":212992,"data_stored":72755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":221184,"data_stored":73785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31456,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340384,"statfs":{"total":96636764160,"available":96604553216,"internally_reserved":0,"allocated":278528,"data_stored":662611,"data_compressed":33419,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509444,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":217088,"data_stored":72229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542148,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":72173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":282624,"data_stored":662633,"data_compressed":33419,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33419,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33419,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-01T01:55:57.797 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-01T01:55:57.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:57.926+0000 7f2a1aefe640 1 Processor -- start 2024-04-01T01:55:57.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:57.930+0000 7f2a1aefe640 1 -- start start 2024-04-01T01:55:57.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:57.930+0000 7f2a1aefe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2a14151de0 0x7f2a14157be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:57.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:57.930+0000 7f2a1aefe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2a140c2900 0x7f2a140c5f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:57.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:57.930+0000 7f2a1aefe640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a140c30d0 con 0x7f2a14158120 2024-04-01T01:55:57.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:57.930+0000 7f2a1aefe640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f2a1415b370 con 0x7f2a140c2900 2024-04-01T01:55:57.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:57.930+0000 7f2a1aefe640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f2a1415c0f0 con 0x7f2a14151de0 2024-04-01T01:55:57.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:57.930+0000 7f2a13fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2a140c2900 0x7f2a140c5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:57.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:57.930+0000 7f2a13fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2a140c2900 0x7f2a140c5f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50420/0 (socket says 172.21.15.50:50420) 2024-04-01T01:55:57.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:57.930+0000 7f2a13fff640 1 -- 172.21.15.50:0/1991397659 learned_addr learned my addr 172.21.15.50:0/1991397659 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T01:55:57.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:57.930+0000 7f2a18c9a640 1 --2- 172.21.15.50:0/1991397659 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2a14151de0 0x7f2a14157be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:57.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:57.930+0000 7f2a13fff640 1 -- 172.21.15.50:0/1991397659 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2a14151de0 msgr2=0x7f2a14157be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:55:57.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:57.930+0000 7f2a13fff640 1 --2- 172.21.15.50:0/1991397659 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2a14151de0 0x7f2a14157be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:57.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:57.930+0000 7f2a13fff640 1 -- 172.21.15.50:0/1991397659 >> v1:172.21.15.97:6789/0 conn(0x7f2a14158120 legacy=0x7f2a1406ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:55:57.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:57.930+0000 7f2a13fff640 1 -- 172.21.15.50:0/1991397659 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a140c2df0 con 0x7f2a140c2900 2024-04-01T01:55:57.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:57.930+0000 7f2a13fff640 1 --2- 172.21.15.50:0/1991397659 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a140c2900 0x7f2a140c5f20 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2a08009870 tx=0x7f2a0801ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afe8b82e6f87ca92 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:57.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:57.930+0000 7f2a137fe640 1 -- 172.21.15.50:0/1991397659 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a080b5070 con 0x7f2a140c2900 2024-04-01T01:55:57.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:57.934+0000 7f2a137fe640 1 -- 172.21.15.50:0/1991397659 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a080a89d0 con 0x7f2a140c2900 2024-04-01T01:55:57.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:57.934+0000 7f2a137fe640 1 -- 172.21.15.50:0/1991397659 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a080a8da0 con 0x7f2a140c2900 2024-04-01T01:55:57.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:57.934+0000 7f2a1aefe640 1 -- 172.21.15.50:0/1991397659 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a140c2900 msgr2=0x7f2a140c5f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:57.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:57.934+0000 7f2a1aefe640 1 --2- 172.21.15.50:0/1991397659 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a140c2900 0x7f2a140c5f20 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2a08009870 tx=0x7f2a0801ed10 comp rx=0 tx=0).stop 2024-04-01T01:55:57.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:57.934+0000 7f2a1aefe640 1 -- 172.21.15.50:0/1991397659 shutdown_connections 2024-04-01T01:55:57.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:57.934+0000 7f2a1aefe640 1 --2- 172.21.15.50:0/1991397659 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a140c2900 0x7f2a140c5f20 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:57.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:57.934+0000 7f2a1aefe640 1 --2- 172.21.15.50:0/1991397659 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2a14151de0 0x7f2a14157be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:57.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:57.934+0000 7f2a1aefe640 1 -- 172.21.15.50:0/1991397659 >> 172.21.15.50:0/1991397659 conn(0x7f2a14067560 msgr2=0x7f2a1406b220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:55:57.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:57.934+0000 7f2a1aefe640 1 -- 172.21.15.50:0/1991397659 shutdown_connections 2024-04-01T01:55:57.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:57.934+0000 7f2a1aefe640 1 -- 172.21.15.50:0/1991397659 wait complete. 2024-04-01T01:55:57.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:57.934+0000 7f2a1aefe640 1 Processor -- start 2024-04-01T01:55:57.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:57.934+0000 7f2a1aefe640 1 -- start start 2024-04-01T01:55:57.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:57.934+0000 7f2a1aefe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2a140c2900 0x7f2a140cb1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:57.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:57.934+0000 7f2a1aefe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2a14151de0 0x7f2a1406ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:57.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:57.934+0000 7f2a1aefe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a14158120 0x7f2a141ee0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:57.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:57.934+0000 7f2a1aefe640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f2a1415bbd0 con 0x7f2a14158120 2024-04-01T01:55:57.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:57.934+0000 7f2a1aefe640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f2a1415b8f0 con 0x7f2a14151de0 2024-04-01T01:55:57.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:57.934+0000 7f2a1aefe640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f2a140c88a0 con 0x7f2a140c2900 2024-04-01T01:55:57.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:57.934+0000 7f2a1949b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a14158120 0x7f2a141ee0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:57.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:57.934+0000 7f2a1949b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a14158120 0x7f2a141ee0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50422/0 (socket says 172.21.15.50:50422) 2024-04-01T01:55:57.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:57.934+0000 7f2a1949b640 1 -- 172.21.15.50:0/2421577624 learned_addr learned my addr 172.21.15.50:0/2421577624 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T01:55:57.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:57.934+0000 7f2a18c9a640 1 --2- 172.21.15.50:0/2421577624 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2a140c2900 0x7f2a140cb1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:57.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:57.934+0000 7f2a13fff640 1 --2- 172.21.15.50:0/2421577624 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2a14151de0 0x7f2a1406ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:57.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:57.934+0000 7f2a1949b640 1 -- 172.21.15.50:0/2421577624 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2a140c2900 msgr2=0x7f2a140cb1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:57.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:57.934+0000 7f2a1949b640 1 --2- 172.21.15.50:0/2421577624 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2a140c2900 0x7f2a140cb1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:57.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:57.934+0000 7f2a1949b640 1 -- 172.21.15.50:0/2421577624 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2a14151de0 msgr2=0x7f2a1406ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:57.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:57.934+0000 7f2a1949b640 1 --2- 172.21.15.50:0/2421577624 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2a14151de0 0x7f2a1406ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:57.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:57.934+0000 7f2a1949b640 1 -- 172.21.15.50:0/2421577624 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a141f1320 con 0x7f2a14158120 2024-04-01T01:55:57.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:57.934+0000 7f2a1949b640 1 --2- 172.21.15.50:0/2421577624 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a14158120 0x7f2a141ee0c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2a0c00b9e0 tx=0x7f2a0c00bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:57.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:57.934+0000 7f2a117fa640 1 -- 172.21.15.50:0/2421577624 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a0c003b80 con 0x7f2a14158120 2024-04-01T01:55:57.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:57.934+0000 7f2a117fa640 1 -- 172.21.15.50:0/2421577624 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a0c003d20 con 0x7f2a14158120 2024-04-01T01:55:57.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:57.934+0000 7f2a1aefe640 1 -- 172.21.15.50:0/2421577624 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a141f1600 con 0x7f2a14158120 2024-04-01T01:55:57.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:57.934+0000 7f2a117fa640 1 -- 172.21.15.50:0/2421577624 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a0c00cb60 con 0x7f2a14158120 2024-04-01T01:55:57.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:57.934+0000 7f2a1aefe640 1 -- 172.21.15.50:0/2421577624 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a141f1bc0 con 0x7f2a14158120 2024-04-01T01:55:57.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:57.938+0000 7f2a1aefe640 1 -- 172.21.15.50:0/2421577624 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a140c7660 con 0x7f2a14158120 2024-04-01T01:55:57.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:57.938+0000 7f2a117fa640 1 -- 172.21.15.50:0/2421577624 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 87103+0+0 (secure 0 0 0) 0x7f2a0c006d10 con 0x7f2a14158120 2024-04-01T01:55:57.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:57.938+0000 7f2a117fa640 1 --2- 172.21.15.50:0/2421577624 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f2a00067420 0x7f2a000698e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:57.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:57.938+0000 7f2a117fa640 1 -- 172.21.15.50:0/2421577624 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f2a0c0851d0 con 0x7f2a14158120 2024-04-01T01:55:57.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:57.938+0000 7f2a18c9a640 1 --2- 172.21.15.50:0/2421577624 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f2a00067420 0x7f2a000698e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:57.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:57.938+0000 7f2a18c9a640 1 --2- 172.21.15.50:0/2421577624 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f2a00067420 0x7f2a000698e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2a0400b9d0 tx=0x7f2a04008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:57.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:57.942+0000 7f2a117fa640 1 -- 172.21.15.50:0/2421577624 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+176632 (secure 0 0 0) 0x7f2a0c055f70 con 0x7f2a14158120 2024-04-01T01:55:58.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.098+0000 7f2a1aefe640 1 -- 172.21.15.50:0/2421577624 --> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2a14068230 con 0x7f2a00067420 2024-04-01T01:55:58.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.118+0000 7f2a117fa640 1 -- 172.21.15.50:0/2421577624 <== mgr.4103 v2:172.21.15.97:6832/1677467570 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251997 (secure 0 0 0) 0x7f2a14068230 con 0x7f2a00067420 2024-04-01T01:55:58.269 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-01T01:55:58.270 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-04-01T01:55:58.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.122+0000 7f2a1aefe640 1 -- 172.21.15.50:0/2421577624 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f2a00067420 msgr2=0x7f2a000698e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:58.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.122+0000 7f2a1aefe640 1 --2- 172.21.15.50:0/2421577624 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f2a00067420 0x7f2a000698e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2a0400b9d0 tx=0x7f2a04008040 comp rx=0 tx=0).stop 2024-04-01T01:55:58.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.122+0000 7f2a1aefe640 1 -- 172.21.15.50:0/2421577624 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a14158120 msgr2=0x7f2a141ee0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:58.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.122+0000 7f2a1aefe640 1 --2- 172.21.15.50:0/2421577624 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a14158120 0x7f2a141ee0c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2a0c00b9e0 tx=0x7f2a0c00bea0 comp rx=0 tx=0).stop 2024-04-01T01:55:58.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.122+0000 7f2a1aefe640 1 -- 172.21.15.50:0/2421577624 shutdown_connections 2024-04-01T01:55:58.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.122+0000 7f2a1aefe640 1 --2- 172.21.15.50:0/2421577624 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f2a00067420 0x7f2a000698e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:58.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.122+0000 7f2a1aefe640 1 --2- 172.21.15.50:0/2421577624 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a14158120 0x7f2a141ee0c0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:58.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.122+0000 7f2a1aefe640 1 --2- 172.21.15.50:0/2421577624 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2a14151de0 0x7f2a1406ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:58.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.122+0000 7f2a1aefe640 1 --2- 172.21.15.50:0/2421577624 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2a140c2900 0x7f2a140cb1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:58.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.122+0000 7f2a1aefe640 1 -- 172.21.15.50:0/2421577624 >> 172.21.15.50:0/2421577624 conn(0x7f2a14067560 msgr2=0x7f2a1414f5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:55:58.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.122+0000 7f2a1aefe640 1 -- 172.21.15.50:0/2421577624 shutdown_connections 2024-04-01T01:55:58.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.122+0000 7f2a1aefe640 1 -- 172.21.15.50:0/2421577624 wait complete. 2024-04-01T01:55:58.273 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-04-01T01:55:58.065371+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":234636,"kb_used_data":1824,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754740084,"statfs":{"total":773094113280,"available":772853846016,"internally_reserved":0,"allocated":1867776,"data_stored":1762940,"data_compressed":66838,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.846837"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.485783+0000","last_change":"2024-04-01T01:55:49.279342+0000","last_active":"2024-04-01T01:55:50.485783+0000","last_peered":"2024-04-01T01:55:50.485783+0000","last_clean":"2024-04-01T01:55:50.485783+0000","last_became_active":"2024-04-01T01:55:49.279011+0000","last_became_peered":"2024-04-01T01:55:49.279011+0000","last_unstale":"2024-04-01T01:55:50.485783+0000","last_undegraded":"2024-04-01T01:55:50.485783+0000","last_fullsized":"2024-04-01T01:55:50.485783+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:56:11.350186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.227142+0000","last_change":"2024-04-01T01:55:49.247181+0000","last_active":"2024-04-01T01:55:50.227142+0000","last_peered":"2024-04-01T01:55:50.227142+0000","last_clean":"2024-04-01T01:55:50.227142+0000","last_became_active":"2024-04-01T01:55:49.246660+0000","last_became_peered":"2024-04-01T01:55:49.246660+0000","last_unstale":"2024-04-01T01:55:50.227142+0000","last_undegraded":"2024-04-01T01:55:50.227142+0000","last_fullsized":"2024-04-01T01:55:50.227142+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:27:12.089520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.226983+0000","last_change":"2024-04-01T01:55:49.240347+0000","last_active":"2024-04-01T01:55:50.226983+0000","last_peered":"2024-04-01T01:55:50.226983+0000","last_clean":"2024-04-01T01:55:50.226983+0000","last_became_active":"2024-04-01T01:55:49.239904+0000","last_became_peered":"2024-04-01T01:55:49.239904+0000","last_unstale":"2024-04-01T01:55:50.226983+0000","last_undegraded":"2024-04-01T01:55:50.226983+0000","last_fullsized":"2024-04-01T01:55:50.226983+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:37:43.280869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.667159+0000","last_change":"2024-04-01T01:55:49.279352+0000","last_active":"2024-04-01T01:55:50.667159+0000","last_peered":"2024-04-01T01:55:50.667159+0000","last_clean":"2024-04-01T01:55:50.667159+0000","last_became_active":"2024-04-01T01:55:49.279041+0000","last_became_peered":"2024-04-01T01:55:49.279041+0000","last_unstale":"2024-04-01T01:55:50.667159+0000","last_undegraded":"2024-04-01T01:55:50.667159+0000","last_fullsized":"2024-04-01T01:55:50.667159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:13:13.114168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.485298+0000","last_change":"2024-04-01T01:55:49.246874+0000","last_active":"2024-04-01T01:55:50.485298+0000","last_peered":"2024-04-01T01:55:50.485298+0000","last_clean":"2024-04-01T01:55:50.485298+0000","last_became_active":"2024-04-01T01:55:49.246152+0000","last_became_peered":"2024-04-01T01:55:49.246152+0000","last_unstale":"2024-04-01T01:55:50.485298+0000","last_undegraded":"2024-04-01T01:55:50.485298+0000","last_fullsized":"2024-04-01T01:55:50.485298+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:49:04.049108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.665855+0000","last_change":"2024-04-01T01:55:49.254029+0000","last_active":"2024-04-01T01:55:50.665855+0000","last_peered":"2024-04-01T01:55:50.665855+0000","last_clean":"2024-04-01T01:55:50.665855+0000","last_became_active":"2024-04-01T01:55:49.253348+0000","last_became_peered":"2024-04-01T01:55:49.253348+0000","last_unstale":"2024-04-01T01:55:50.665855+0000","last_undegraded":"2024-04-01T01:55:50.665855+0000","last_fullsized":"2024-04-01T01:55:50.665855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:33:56.754206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.484926+0000","last_change":"2024-04-01T01:55:49.247604+0000","last_active":"2024-04-01T01:55:50.484926+0000","last_peered":"2024-04-01T01:55:50.484926+0000","last_clean":"2024-04-01T01:55:50.484926+0000","last_became_active":"2024-04-01T01:55:49.247373+0000","last_became_peered":"2024-04-01T01:55:49.247373+0000","last_unstale":"2024-04-01T01:55:50.484926+0000","last_undegraded":"2024-04-01T01:55:50.484926+0000","last_fullsized":"2024-04-01T01:55:50.484926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:13:16.513095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.226492+0000","last_change":"2024-04-01T01:55:49.262994+0000","last_active":"2024-04-01T01:55:50.226492+0000","last_peered":"2024-04-01T01:55:50.226492+0000","last_clean":"2024-04-01T01:55:50.226492+0000","last_became_active":"2024-04-01T01:55:49.262736+0000","last_became_peered":"2024-04-01T01:55:49.262736+0000","last_unstale":"2024-04-01T01:55:50.226492+0000","last_undegraded":"2024-04-01T01:55:50.226492+0000","last_fullsized":"2024-04-01T01:55:50.226492+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:35:14.625545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.224583+0000","last_change":"2024-04-01T01:55:49.260244+0000","last_active":"2024-04-01T01:55:50.224583+0000","last_peered":"2024-04-01T01:55:50.224583+0000","last_clean":"2024-04-01T01:55:50.224583+0000","last_became_active":"2024-04-01T01:55:49.259745+0000","last_became_peered":"2024-04-01T01:55:49.259745+0000","last_unstale":"2024-04-01T01:55:50.224583+0000","last_undegraded":"2024-04-01T01:55:50.224583+0000","last_fullsized":"2024-04-01T01:55:50.224583+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:00:34.607980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.486080+0000","last_change":"2024-04-01T01:55:49.255260+0000","last_active":"2024-04-01T01:55:50.486080+0000","last_peered":"2024-04-01T01:55:50.486080+0000","last_clean":"2024-04-01T01:55:50.486080+0000","last_became_active":"2024-04-01T01:55:49.254408+0000","last_became_peered":"2024-04-01T01:55:49.254408+0000","last_unstale":"2024-04-01T01:55:50.486080+0000","last_undegraded":"2024-04-01T01:55:50.486080+0000","last_fullsized":"2024-04-01T01:55:50.486080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:02:41.829474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.485581+0000","last_change":"2024-04-01T01:55:49.271392+0000","last_active":"2024-04-01T01:55:50.485581+0000","last_peered":"2024-04-01T01:55:50.485581+0000","last_clean":"2024-04-01T01:55:50.485581+0000","last_became_active":"2024-04-01T01:55:49.270877+0000","last_became_peered":"2024-04-01T01:55:49.270877+0000","last_unstale":"2024-04-01T01:55:50.485581+0000","last_undegraded":"2024-04-01T01:55:50.485581+0000","last_fullsized":"2024-04-01T01:55:50.485581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:44:29.950624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.485029+0000","last_change":"2024-04-01T01:55:49.259816+0000","last_active":"2024-04-01T01:55:50.485029+0000","last_peered":"2024-04-01T01:55:50.485029+0000","last_clean":"2024-04-01T01:55:50.485029+0000","last_became_active":"2024-04-01T01:55:49.259193+0000","last_became_peered":"2024-04-01T01:55:49.259193+0000","last_unstale":"2024-04-01T01:55:50.485029+0000","last_undegraded":"2024-04-01T01:55:50.485029+0000","last_fullsized":"2024-04-01T01:55:50.485029+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:48:10.828398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.635725+0000","last_change":"2024-04-01T01:55:49.247878+0000","last_active":"2024-04-01T01:55:50.635725+0000","last_peered":"2024-04-01T01:55:50.635725+0000","last_clean":"2024-04-01T01:55:50.635725+0000","last_became_active":"2024-04-01T01:55:49.247436+0000","last_became_peered":"2024-04-01T01:55:49.247436+0000","last_unstale":"2024-04-01T01:55:50.635725+0000","last_undegraded":"2024-04-01T01:55:50.635725+0000","last_fullsized":"2024-04-01T01:55:50.635725+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:26:09.632757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.635921+0000","last_change":"2024-04-01T01:55:49.246266+0000","last_active":"2024-04-01T01:55:50.635921+0000","last_peered":"2024-04-01T01:55:50.635921+0000","last_clean":"2024-04-01T01:55:50.635921+0000","last_became_active":"2024-04-01T01:55:49.245650+0000","last_became_peered":"2024-04-01T01:55:49.245650+0000","last_unstale":"2024-04-01T01:55:50.635921+0000","last_undegraded":"2024-04-01T01:55:50.635921+0000","last_fullsized":"2024-04-01T01:55:50.635921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:14:32.577522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.225923+0000","last_change":"2024-04-01T01:55:49.248046+0000","last_active":"2024-04-01T01:55:50.225923+0000","last_peered":"2024-04-01T01:55:50.225923+0000","last_clean":"2024-04-01T01:55:50.225923+0000","last_became_active":"2024-04-01T01:55:49.247662+0000","last_became_peered":"2024-04-01T01:55:49.247662+0000","last_unstale":"2024-04-01T01:55:50.225923+0000","last_undegraded":"2024-04-01T01:55:50.225923+0000","last_fullsized":"2024-04-01T01:55:50.225923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:59:26.879090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.665743+0000","last_change":"2024-04-01T01:55:49.269484+0000","last_active":"2024-04-01T01:55:50.665743+0000","last_peered":"2024-04-01T01:55:50.665743+0000","last_clean":"2024-04-01T01:55:50.665743+0000","last_became_active":"2024-04-01T01:55:49.261839+0000","last_became_peered":"2024-04-01T01:55:49.261839+0000","last_unstale":"2024-04-01T01:55:50.665743+0000","last_undegraded":"2024-04-01T01:55:50.665743+0000","last_fullsized":"2024-04-01T01:55:50.665743+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:44:29.950624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.668406+0000","last_change":"2024-04-01T01:55:49.276113+0000","last_active":"2024-04-01T01:55:50.668406+0000","last_peered":"2024-04-01T01:55:50.668406+0000","last_clean":"2024-04-01T01:55:50.668406+0000","last_became_active":"2024-04-01T01:55:49.275727+0000","last_became_peered":"2024-04-01T01:55:49.275727+0000","last_unstale":"2024-04-01T01:55:50.668406+0000","last_undegraded":"2024-04-01T01:55:50.668406+0000","last_fullsized":"2024-04-01T01:55:50.668406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:50:59.209071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.665402+0000","last_change":"2024-04-01T01:55:49.252859+0000","last_active":"2024-04-01T01:55:50.665402+0000","last_peered":"2024-04-01T01:55:50.665402+0000","last_clean":"2024-04-01T01:55:50.665402+0000","last_became_active":"2024-04-01T01:55:49.252553+0000","last_became_peered":"2024-04-01T01:55:49.252553+0000","last_unstale":"2024-04-01T01:55:50.665402+0000","last_undegraded":"2024-04-01T01:55:50.665402+0000","last_fullsized":"2024-04-01T01:55:50.665402+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:13:13.114168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.667833+0000","last_change":"2024-04-01T01:55:49.260274+0000","last_active":"2024-04-01T01:55:50.667833+0000","last_peered":"2024-04-01T01:55:50.667833+0000","last_clean":"2024-04-01T01:55:50.667833+0000","last_became_active":"2024-04-01T01:55:49.259935+0000","last_became_peered":"2024-04-01T01:55:49.259935+0000","last_unstale":"2024-04-01T01:55:50.667833+0000","last_undegraded":"2024-04-01T01:55:50.667833+0000","last_fullsized":"2024-04-01T01:55:50.667833+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:24:55.348340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.485181+0000","last_change":"2024-04-01T01:55:49.259523+0000","last_active":"2024-04-01T01:55:50.485181+0000","last_peered":"2024-04-01T01:55:50.485181+0000","last_clean":"2024-04-01T01:55:50.485181+0000","last_became_active":"2024-04-01T01:55:49.258670+0000","last_became_peered":"2024-04-01T01:55:49.258670+0000","last_unstale":"2024-04-01T01:55:50.485181+0000","last_undegraded":"2024-04-01T01:55:50.485181+0000","last_fullsized":"2024-04-01T01:55:50.485181+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:08:54.832554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.226632+0000","last_change":"2024-04-01T01:55:49.243824+0000","last_active":"2024-04-01T01:55:50.226632+0000","last_peered":"2024-04-01T01:55:50.226632+0000","last_clean":"2024-04-01T01:55:50.226632+0000","last_became_active":"2024-04-01T01:55:49.243518+0000","last_became_peered":"2024-04-01T01:55:49.243518+0000","last_unstale":"2024-04-01T01:55:50.226632+0000","last_undegraded":"2024-04-01T01:55:50.226632+0000","last_fullsized":"2024-04-01T01:55:50.226632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:24:42.777720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.223859+0000","last_change":"2024-04-01T01:55:49.258207+0000","last_active":"2024-04-01T01:55:50.223859+0000","last_peered":"2024-04-01T01:55:50.223859+0000","last_clean":"2024-04-01T01:55:50.223859+0000","last_became_active":"2024-04-01T01:55:49.257576+0000","last_became_peered":"2024-04-01T01:55:49.257576+0000","last_unstale":"2024-04-01T01:55:50.223859+0000","last_undegraded":"2024-04-01T01:55:50.223859+0000","last_fullsized":"2024-04-01T01:55:50.223859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:13:13.114168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.226214+0000","last_change":"2024-04-01T01:55:49.250832+0000","last_active":"2024-04-01T01:55:50.226214+0000","last_peered":"2024-04-01T01:55:50.226214+0000","last_clean":"2024-04-01T01:55:50.226214+0000","last_became_active":"2024-04-01T01:55:49.250522+0000","last_became_peered":"2024-04-01T01:55:49.250522+0000","last_unstale":"2024-04-01T01:55:50.226214+0000","last_undegraded":"2024-04-01T01:55:50.226214+0000","last_fullsized":"2024-04-01T01:55:50.226214+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:47:04.592262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.665958+0000","last_change":"2024-04-01T01:55:49.270067+0000","last_active":"2024-04-01T01:55:50.665958+0000","last_peered":"2024-04-01T01:55:50.665958+0000","last_clean":"2024-04-01T01:55:50.665958+0000","last_became_active":"2024-04-01T01:55:49.269694+0000","last_became_peered":"2024-04-01T01:55:49.269694+0000","last_unstale":"2024-04-01T01:55:50.665958+0000","last_undegraded":"2024-04-01T01:55:50.665958+0000","last_fullsized":"2024-04-01T01:55:50.665958+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:21:46.367144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.227645+0000","last_change":"2024-04-01T01:55:49.243460+0000","last_active":"2024-04-01T01:55:50.227645+0000","last_peered":"2024-04-01T01:55:50.227645+0000","last_clean":"2024-04-01T01:55:50.227645+0000","last_became_active":"2024-04-01T01:55:49.243017+0000","last_became_peered":"2024-04-01T01:55:49.243017+0000","last_unstale":"2024-04-01T01:55:50.227645+0000","last_undegraded":"2024-04-01T01:55:50.227645+0000","last_fullsized":"2024-04-01T01:55:50.227645+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:20:18.156798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.667300+0000","last_change":"2024-04-01T01:55:49.280226+0000","last_active":"2024-04-01T01:55:50.667300+0000","last_peered":"2024-04-01T01:55:50.667300+0000","last_clean":"2024-04-01T01:55:50.667300+0000","last_became_active":"2024-04-01T01:55:49.279882+0000","last_became_peered":"2024-04-01T01:55:49.279882+0000","last_unstale":"2024-04-01T01:55:50.667300+0000","last_undegraded":"2024-04-01T01:55:50.667300+0000","last_fullsized":"2024-04-01T01:55:50.667300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:06:48.999905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.636174+0000","last_change":"2024-04-01T01:55:49.249890+0000","last_active":"2024-04-01T01:55:50.636174+0000","last_peered":"2024-04-01T01:55:50.636174+0000","last_clean":"2024-04-01T01:55:50.636174+0000","last_became_active":"2024-04-01T01:55:49.249588+0000","last_became_peered":"2024-04-01T01:55:49.249588+0000","last_unstale":"2024-04-01T01:55:50.636174+0000","last_undegraded":"2024-04-01T01:55:50.636174+0000","last_fullsized":"2024-04-01T01:55:50.636174+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:02:25.180455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.635657+0000","last_change":"2024-04-01T01:55:49.254529+0000","last_active":"2024-04-01T01:55:50.635657+0000","last_peered":"2024-04-01T01:55:50.635657+0000","last_clean":"2024-04-01T01:55:50.635657+0000","last_became_active":"2024-04-01T01:55:49.253726+0000","last_became_peered":"2024-04-01T01:55:49.253726+0000","last_unstale":"2024-04-01T01:55:50.635657+0000","last_undegraded":"2024-04-01T01:55:50.635657+0000","last_fullsized":"2024-04-01T01:55:50.635657+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:55:44.175129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.227405+0000","last_change":"2024-04-01T01:55:49.252043+0000","last_active":"2024-04-01T01:55:50.227405+0000","last_peered":"2024-04-01T01:55:50.227405+0000","last_clean":"2024-04-01T01:55:50.227405+0000","last_became_active":"2024-04-01T01:55:49.251760+0000","last_became_peered":"2024-04-01T01:55:49.251760+0000","last_unstale":"2024-04-01T01:55:50.227405+0000","last_undegraded":"2024-04-01T01:55:50.227405+0000","last_fullsized":"2024-04-01T01:55:50.227405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:12:25.325040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.666628+0000","last_change":"2024-04-01T01:55:49.270451+0000","last_active":"2024-04-01T01:55:50.666628+0000","last_peered":"2024-04-01T01:55:50.666628+0000","last_clean":"2024-04-01T01:55:50.666628+0000","last_became_active":"2024-04-01T01:55:49.269636+0000","last_became_peered":"2024-04-01T01:55:49.269636+0000","last_unstale":"2024-04-01T01:55:50.666628+0000","last_undegraded":"2024-04-01T01:55:50.666628+0000","last_fullsized":"2024-04-01T01:55:50.666628+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:11:14.234867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.664845+0000","last_change":"2024-04-01T01:55:49.266187+0000","last_active":"2024-04-01T01:55:50.664845+0000","last_peered":"2024-04-01T01:55:50.664845+0000","last_clean":"2024-04-01T01:55:50.664845+0000","last_became_active":"2024-04-01T01:55:49.265946+0000","last_became_peered":"2024-04-01T01:55:49.265946+0000","last_unstale":"2024-04-01T01:55:50.664845+0000","last_undegraded":"2024-04-01T01:55:50.664845+0000","last_fullsized":"2024-04-01T01:55:50.664845+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:37:46.890765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.665336+0000","last_change":"2024-04-01T01:55:49.273104+0000","last_active":"2024-04-01T01:55:50.665336+0000","last_peered":"2024-04-01T01:55:50.665336+0000","last_clean":"2024-04-01T01:55:50.665336+0000","last_became_active":"2024-04-01T01:55:49.272742+0000","last_became_peered":"2024-04-01T01:55:49.272742+0000","last_unstale":"2024-04-01T01:55:50.665336+0000","last_undegraded":"2024-04-01T01:55:50.665336+0000","last_fullsized":"2024-04-01T01:55:50.665336+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:37:46.890765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.224162+0000","last_change":"2024-04-01T01:55:49.241595+0000","last_active":"2024-04-01T01:55:50.224162+0000","last_peered":"2024-04-01T01:55:50.224162+0000","last_clean":"2024-04-01T01:55:50.224162+0000","last_became_active":"2024-04-01T01:55:49.238286+0000","last_became_peered":"2024-04-01T01:55:49.238286+0000","last_unstale":"2024-04-01T01:55:50.224162+0000","last_undegraded":"2024-04-01T01:55:50.224162+0000","last_fullsized":"2024-04-01T01:55:50.224162+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:06:48.999905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.226757+0000","last_change":"2024-04-01T01:55:48.225145+0000","last_active":"2024-04-01T01:55:50.226757+0000","last_peered":"2024-04-01T01:55:50.226757+0000","last_clean":"2024-04-01T01:55:50.226757+0000","last_became_active":"2024-04-01T01:55:48.224408+0000","last_became_peered":"2024-04-01T01:55:48.224408+0000","last_unstale":"2024-04-01T01:55:50.226757+0000","last_undegraded":"2024-04-01T01:55:50.226757+0000","last_fullsized":"2024-04-01T01:55:50.226757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:41:59.465915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.227045+0000","last_change":"2024-04-01T01:55:49.247771+0000","last_active":"2024-04-01T01:55:50.227045+0000","last_peered":"2024-04-01T01:55:50.227045+0000","last_clean":"2024-04-01T01:55:50.227045+0000","last_became_active":"2024-04-01T01:55:49.247496+0000","last_became_peered":"2024-04-01T01:55:49.247496+0000","last_unstale":"2024-04-01T01:55:50.227045+0000","last_undegraded":"2024-04-01T01:55:50.227045+0000","last_fullsized":"2024-04-01T01:55:50.227045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:02:25.180455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.666773+0000","last_change":"2024-04-01T01:55:48.221934+0000","last_active":"2024-04-01T01:55:50.666773+0000","last_peered":"2024-04-01T01:55:50.666773+0000","last_clean":"2024-04-01T01:55:50.666773+0000","last_became_active":"2024-04-01T01:55:48.221614+0000","last_became_peered":"2024-04-01T01:55:48.221614+0000","last_unstale":"2024-04-01T01:55:50.666773+0000","last_undegraded":"2024-04-01T01:55:50.666773+0000","last_fullsized":"2024-04-01T01:55:50.666773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:06:47.990123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.635306+0000","last_change":"2024-04-01T01:55:48.217879+0000","last_active":"2024-04-01T01:55:50.635306+0000","last_peered":"2024-04-01T01:55:50.635306+0000","last_clean":"2024-04-01T01:55:50.635306+0000","last_became_active":"2024-04-01T01:55:48.216141+0000","last_became_peered":"2024-04-01T01:55:48.216141+0000","last_unstale":"2024-04-01T01:55:50.635306+0000","last_undegraded":"2024-04-01T01:55:50.635306+0000","last_fullsized":"2024-04-01T01:55:50.635306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:36:42.625449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.227275+0000","last_change":"2024-04-01T01:55:49.246424+0000","last_active":"2024-04-01T01:55:50.227275+0000","last_peered":"2024-04-01T01:55:50.227275+0000","last_clean":"2024-04-01T01:55:50.227275+0000","last_became_active":"2024-04-01T01:55:49.243823+0000","last_became_peered":"2024-04-01T01:55:49.243823+0000","last_unstale":"2024-04-01T01:55:50.227275+0000","last_undegraded":"2024-04-01T01:55:50.227275+0000","last_fullsized":"2024-04-01T01:55:50.227275+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:27:45.663474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.665864+0000","last_change":"2024-04-01T01:55:48.222831+0000","last_active":"2024-04-01T01:55:50.665864+0000","last_peered":"2024-04-01T01:55:50.665864+0000","last_clean":"2024-04-01T01:55:50.665864+0000","last_became_active":"2024-04-01T01:55:48.222535+0000","last_became_peered":"2024-04-01T01:55:48.222535+0000","last_unstale":"2024-04-01T01:55:50.665864+0000","last_undegraded":"2024-04-01T01:55:50.665864+0000","last_fullsized":"2024-04-01T01:55:50.665864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:49:34.960786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.227957+0000","last_change":"2024-04-01T01:55:49.231967+0000","last_active":"2024-04-01T01:55:50.227957+0000","last_peered":"2024-04-01T01:55:50.227957+0000","last_clean":"2024-04-01T01:55:50.227957+0000","last_became_active":"2024-04-01T01:55:49.230659+0000","last_became_peered":"2024-04-01T01:55:49.230659+0000","last_unstale":"2024-04-01T01:55:50.227957+0000","last_undegraded":"2024-04-01T01:55:50.227957+0000","last_fullsized":"2024-04-01T01:55:50.227957+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:57:31.843504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.224697+0000","last_change":"2024-04-01T01:55:48.216724+0000","last_active":"2024-04-01T01:55:50.224697+0000","last_peered":"2024-04-01T01:55:50.224697+0000","last_clean":"2024-04-01T01:55:50.224697+0000","last_became_active":"2024-04-01T01:55:48.216318+0000","last_became_peered":"2024-04-01T01:55:48.216318+0000","last_unstale":"2024-04-01T01:55:50.224697+0000","last_undegraded":"2024-04-01T01:55:50.224697+0000","last_fullsized":"2024-04-01T01:55:50.224697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:25:51.219789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.667408+0000","last_change":"2024-04-01T01:55:49.280230+0000","last_active":"2024-04-01T01:55:50.667408+0000","last_peered":"2024-04-01T01:55:50.667408+0000","last_clean":"2024-04-01T01:55:50.667408+0000","last_became_active":"2024-04-01T01:55:49.279866+0000","last_became_peered":"2024-04-01T01:55:49.279866+0000","last_unstale":"2024-04-01T01:55:50.667408+0000","last_undegraded":"2024-04-01T01:55:50.667408+0000","last_fullsized":"2024-04-01T01:55:50.667408+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:00:34.607980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.485507+0000","last_change":"2024-04-01T01:55:48.213879+0000","last_active":"2024-04-01T01:55:50.485507+0000","last_peered":"2024-04-01T01:55:50.485507+0000","last_clean":"2024-04-01T01:55:50.485507+0000","last_became_active":"2024-04-01T01:55:48.213610+0000","last_became_peered":"2024-04-01T01:55:48.213610+0000","last_unstale":"2024-04-01T01:55:50.485507+0000","last_undegraded":"2024-04-01T01:55:50.485507+0000","last_fullsized":"2024-04-01T01:55:50.485507+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:33:55.744424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.228364+0000","last_change":"2024-04-01T01:55:49.261532+0000","last_active":"2024-04-01T01:55:50.228364+0000","last_peered":"2024-04-01T01:55:50.228364+0000","last_clean":"2024-04-01T01:55:50.228364+0000","last_became_active":"2024-04-01T01:55:49.261260+0000","last_became_peered":"2024-04-01T01:55:49.261260+0000","last_unstale":"2024-04-01T01:55:50.228364+0000","last_undegraded":"2024-04-01T01:55:50.228364+0000","last_fullsized":"2024-04-01T01:55:50.228364+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:30:02.149564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.665057+0000","last_change":"2024-04-01T01:55:48.227054+0000","last_active":"2024-04-01T01:55:50.665057+0000","last_peered":"2024-04-01T01:55:50.665057+0000","last_clean":"2024-04-01T01:55:50.665057+0000","last_became_active":"2024-04-01T01:55:48.226061+0000","last_became_peered":"2024-04-01T01:55:48.226061+0000","last_unstale":"2024-04-01T01:55:50.665057+0000","last_undegraded":"2024-04-01T01:55:50.665057+0000","last_fullsized":"2024-04-01T01:55:50.665057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:18:27.840431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.666111+0000","last_change":"2024-04-01T01:55:49.261662+0000","last_active":"2024-04-01T01:55:50.666111+0000","last_peered":"2024-04-01T01:55:50.666111+0000","last_clean":"2024-04-01T01:55:50.666111+0000","last_became_active":"2024-04-01T01:55:49.261286+0000","last_became_peered":"2024-04-01T01:55:49.261286+0000","last_unstale":"2024-04-01T01:55:50.666111+0000","last_undegraded":"2024-04-01T01:55:50.666111+0000","last_fullsized":"2024-04-01T01:55:50.666111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:56:11.350186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.667035+0000","last_change":"2024-04-01T01:55:48.219739+0000","last_active":"2024-04-01T01:55:50.667035+0000","last_peered":"2024-04-01T01:55:50.667035+0000","last_clean":"2024-04-01T01:55:50.667035+0000","last_became_active":"2024-04-01T01:55:48.219107+0000","last_became_peered":"2024-04-01T01:55:48.219107+0000","last_unstale":"2024-04-01T01:55:50.667035+0000","last_undegraded":"2024-04-01T01:55:50.667035+0000","last_fullsized":"2024-04-01T01:55:50.667035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:14:12.790111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.485917+0000","last_change":"2024-04-01T01:55:49.255056+0000","last_active":"2024-04-01T01:55:50.485917+0000","last_peered":"2024-04-01T01:55:50.485917+0000","last_clean":"2024-04-01T01:55:50.485917+0000","last_became_active":"2024-04-01T01:55:49.247910+0000","last_became_peered":"2024-04-01T01:55:49.247910+0000","last_unstale":"2024-04-01T01:55:50.485917+0000","last_undegraded":"2024-04-01T01:55:50.485917+0000","last_fullsized":"2024-04-01T01:55:50.485917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T13:02:55.577616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.665142+0000","last_change":"2024-04-01T01:55:48.215613+0000","last_active":"2024-04-01T01:55:50.665142+0000","last_peered":"2024-04-01T01:55:50.665142+0000","last_clean":"2024-04-01T01:55:50.665142+0000","last_became_active":"2024-04-01T01:55:48.214669+0000","last_became_peered":"2024-04-01T01:55:48.214669+0000","last_unstale":"2024-04-01T01:55:50.665142+0000","last_undegraded":"2024-04-01T01:55:50.665142+0000","last_fullsized":"2024-04-01T01:55:50.665142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:25:51.219789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.635349+0000","last_change":"2024-04-01T01:55:49.270153+0000","last_active":"2024-04-01T01:55:50.635349+0000","last_peered":"2024-04-01T01:55:50.635349+0000","last_clean":"2024-04-01T01:55:50.635349+0000","last_became_active":"2024-04-01T01:55:49.269840+0000","last_became_peered":"2024-04-01T01:55:49.269840+0000","last_unstale":"2024-04-01T01:55:50.635349+0000","last_undegraded":"2024-04-01T01:55:50.635349+0000","last_fullsized":"2024-04-01T01:55:50.635349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:00:34.607980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.667049+0000","last_change":"2024-04-01T01:55:48.214783+0000","last_active":"2024-04-01T01:55:50.667049+0000","last_peered":"2024-04-01T01:55:50.667049+0000","last_clean":"2024-04-01T01:55:50.667049+0000","last_became_active":"2024-04-01T01:55:48.213463+0000","last_became_peered":"2024-04-01T01:55:48.213463+0000","last_unstale":"2024-04-01T01:55:50.667049+0000","last_undegraded":"2024-04-01T01:55:50.667049+0000","last_fullsized":"2024-04-01T01:55:50.667049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:00:33.598198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.666568+0000","last_change":"2024-04-01T01:55:49.274841+0000","last_active":"2024-04-01T01:55:50.666568+0000","last_peered":"2024-04-01T01:55:50.666568+0000","last_clean":"2024-04-01T01:55:50.666568+0000","last_became_active":"2024-04-01T01:55:49.274430+0000","last_became_peered":"2024-04-01T01:55:49.274430+0000","last_unstale":"2024-04-01T01:55:50.666568+0000","last_undegraded":"2024-04-01T01:55:50.666568+0000","last_fullsized":"2024-04-01T01:55:50.666568+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T13:25:36.254927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.484812+0000","last_change":"2024-04-01T01:55:48.210944+0000","last_active":"2024-04-01T01:55:50.484812+0000","last_peered":"2024-04-01T01:55:50.484812+0000","last_clean":"2024-04-01T01:55:50.484812+0000","last_became_active":"2024-04-01T01:55:48.210616+0000","last_became_peered":"2024-04-01T01:55:48.210616+0000","last_unstale":"2024-04-01T01:55:50.484812+0000","last_undegraded":"2024-04-01T01:55:50.484812+0000","last_fullsized":"2024-04-01T01:55:50.484812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:38:32.247471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.223513+0000","last_change":"2024-04-01T01:55:49.239528+0000","last_active":"2024-04-01T01:55:50.223513+0000","last_peered":"2024-04-01T01:55:50.223513+0000","last_clean":"2024-04-01T01:55:50.223513+0000","last_became_active":"2024-04-01T01:55:49.238805+0000","last_became_peered":"2024-04-01T01:55:49.238805+0000","last_unstale":"2024-04-01T01:55:50.223513+0000","last_undegraded":"2024-04-01T01:55:50.223513+0000","last_fullsized":"2024-04-01T01:55:50.223513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:37:46.890765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.226599+0000","last_change":"2024-04-01T01:55:48.211677+0000","last_active":"2024-04-01T01:55:50.226599+0000","last_peered":"2024-04-01T01:55:50.226599+0000","last_clean":"2024-04-01T01:55:50.226599+0000","last_became_active":"2024-04-01T01:55:48.210893+0000","last_became_peered":"2024-04-01T01:55:48.210893+0000","last_unstale":"2024-04-01T01:55:50.226599+0000","last_undegraded":"2024-04-01T01:55:50.226599+0000","last_fullsized":"2024-04-01T01:55:50.226599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:04:19.568533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.666123+0000","last_change":"2024-04-01T01:55:49.261872+0000","last_active":"2024-04-01T01:55:50.666123+0000","last_peered":"2024-04-01T01:55:50.666123+0000","last_clean":"2024-04-01T01:55:50.666123+0000","last_became_active":"2024-04-01T01:55:49.261517+0000","last_became_peered":"2024-04-01T01:55:49.261517+0000","last_unstale":"2024-04-01T01:55:50.666123+0000","last_undegraded":"2024-04-01T01:55:50.666123+0000","last_fullsized":"2024-04-01T01:55:50.666123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T13:02:55.577616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.485838+0000","last_change":"2024-04-01T01:55:48.198687+0000","last_active":"2024-04-01T01:55:50.485838+0000","last_peered":"2024-04-01T01:55:50.485838+0000","last_clean":"2024-04-01T01:55:50.485838+0000","last_became_active":"2024-04-01T01:55:48.198319+0000","last_became_peered":"2024-04-01T01:55:48.198319+0000","last_unstale":"2024-04-01T01:55:50.485838+0000","last_undegraded":"2024-04-01T01:55:50.485838+0000","last_fullsized":"2024-04-01T01:55:50.485838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:37:45.880984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.667742+0000","last_change":"2024-04-01T01:55:49.272424+0000","last_active":"2024-04-01T01:55:50.667742+0000","last_peered":"2024-04-01T01:55:50.667742+0000","last_clean":"2024-04-01T01:55:50.667742+0000","last_became_active":"2024-04-01T01:55:49.265670+0000","last_became_peered":"2024-04-01T01:55:49.265670+0000","last_unstale":"2024-04-01T01:55:50.667742+0000","last_undegraded":"2024-04-01T01:55:50.667742+0000","last_fullsized":"2024-04-01T01:55:50.667742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:26:09.632757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.227729+0000","last_change":"2024-04-01T01:55:48.219312+0000","last_active":"2024-04-01T01:55:50.227729+0000","last_peered":"2024-04-01T01:55:50.227729+0000","last_clean":"2024-04-01T01:55:50.227729+0000","last_became_active":"2024-04-01T01:55:48.218562+0000","last_became_peered":"2024-04-01T01:55:48.218562+0000","last_unstale":"2024-04-01T01:55:50.227729+0000","last_undegraded":"2024-04-01T01:55:50.227729+0000","last_fullsized":"2024-04-01T01:55:50.227729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:38:32.247471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.485763+0000","last_change":"2024-04-01T01:55:49.268041+0000","last_active":"2024-04-01T01:55:50.485763+0000","last_peered":"2024-04-01T01:55:50.485763+0000","last_clean":"2024-04-01T01:55:50.485763+0000","last_became_active":"2024-04-01T01:55:49.267502+0000","last_became_peered":"2024-04-01T01:55:49.267502+0000","last_unstale":"2024-04-01T01:55:50.485763+0000","last_undegraded":"2024-04-01T01:55:50.485763+0000","last_fullsized":"2024-04-01T01:55:50.485763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:21:46.367144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.227260+0000","last_change":"2024-04-01T01:55:48.216662+0000","last_active":"2024-04-01T01:55:50.227260+0000","last_peered":"2024-04-01T01:55:50.227260+0000","last_clean":"2024-04-01T01:55:50.227260+0000","last_became_active":"2024-04-01T01:55:48.215852+0000","last_became_peered":"2024-04-01T01:55:48.215852+0000","last_unstale":"2024-04-01T01:55:50.227260+0000","last_undegraded":"2024-04-01T01:55:50.227260+0000","last_fullsized":"2024-04-01T01:55:50.227260+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:25:39.713293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.485456+0000","last_change":"2024-04-01T01:55:49.256142+0000","last_active":"2024-04-01T01:55:50.485456+0000","last_peered":"2024-04-01T01:55:50.485456+0000","last_clean":"2024-04-01T01:55:50.485456+0000","last_became_active":"2024-04-01T01:55:49.255781+0000","last_became_peered":"2024-04-01T01:55:49.255781+0000","last_unstale":"2024-04-01T01:55:50.485456+0000","last_undegraded":"2024-04-01T01:55:50.485456+0000","last_fullsized":"2024-04-01T01:55:50.485456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:10:23.571126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.635926+0000","last_change":"2024-04-01T01:55:48.219851+0000","last_active":"2024-04-01T01:55:50.635926+0000","last_peered":"2024-04-01T01:55:50.635926+0000","last_clean":"2024-04-01T01:55:50.635926+0000","last_became_active":"2024-04-01T01:55:48.215898+0000","last_became_peered":"2024-04-01T01:55:48.215898+0000","last_unstale":"2024-04-01T01:55:50.635926+0000","last_undegraded":"2024-04-01T01:55:50.635926+0000","last_fullsized":"2024-04-01T01:55:50.635926+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:18:27.840431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.667778+0000","last_change":"2024-04-01T01:55:49.275452+0000","last_active":"2024-04-01T01:55:50.667778+0000","last_peered":"2024-04-01T01:55:50.667778+0000","last_clean":"2024-04-01T01:55:50.667778+0000","last_became_active":"2024-04-01T01:55:49.274600+0000","last_became_peered":"2024-04-01T01:55:49.274600+0000","last_unstale":"2024-04-01T01:55:50.667778+0000","last_undegraded":"2024-04-01T01:55:50.667778+0000","last_fullsized":"2024-04-01T01:55:50.667778+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:19:24.052574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.223321+0000","last_change":"2024-04-01T01:55:43.145201+0000","last_active":"2024-04-01T01:55:50.223321+0000","last_peered":"2024-04-01T01:55:50.223321+0000","last_clean":"2024-04-01T01:55:50.223321+0000","last_became_active":"2024-04-01T01:55:43.144882+0000","last_became_peered":"2024-04-01T01:55:43.144882+0000","last_unstale":"2024-04-01T01:55:50.223321+0000","last_undegraded":"2024-04-01T01:55:50.223321+0000","last_fullsized":"2024-04-01T01:55:50.223321+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:42.134502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:42.134502+0000","last_clean_scrub_stamp":"2024-04-01T01:55:42.134502+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:02:26.589535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.666696+0000","last_change":"2024-04-01T01:55:48.207222+0000","last_active":"2024-04-01T01:55:50.666696+0000","last_peered":"2024-04-01T01:55:50.666696+0000","last_clean":"2024-04-01T01:55:50.666696+0000","last_became_active":"2024-04-01T01:55:48.206293+0000","last_became_peered":"2024-04-01T01:55:48.206293+0000","last_unstale":"2024-04-01T01:55:50.666696+0000","last_undegraded":"2024-04-01T01:55:50.666696+0000","last_fullsized":"2024-04-01T01:55:50.666696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:37:45.880984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.226523+0000","last_change":"2024-04-01T01:55:49.273517+0000","last_active":"2024-04-01T01:55:50.226523+0000","last_peered":"2024-04-01T01:55:50.226523+0000","last_clean":"2024-04-01T01:55:50.226523+0000","last_became_active":"2024-04-01T01:55:49.273197+0000","last_became_peered":"2024-04-01T01:55:49.273197+0000","last_unstale":"2024-04-01T01:55:50.226523+0000","last_undegraded":"2024-04-01T01:55:50.226523+0000","last_fullsized":"2024-04-01T01:55:50.226523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:14:32.577522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.666134+0000","last_change":"2024-04-01T01:55:48.214341+0000","last_active":"2024-04-01T01:55:50.666134+0000","last_peered":"2024-04-01T01:55:50.666134+0000","last_clean":"2024-04-01T01:55:50.666134+0000","last_became_active":"2024-04-01T01:55:48.213914+0000","last_became_peered":"2024-04-01T01:55:48.213914+0000","last_unstale":"2024-04-01T01:55:50.666134+0000","last_undegraded":"2024-04-01T01:55:50.666134+0000","last_fullsized":"2024-04-01T01:55:50.666134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:09:28.276592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.636256+0000","last_change":"2024-04-01T01:55:49.272106+0000","last_active":"2024-04-01T01:55:50.636256+0000","last_peered":"2024-04-01T01:55:50.636256+0000","last_clean":"2024-04-01T01:55:50.636256+0000","last_became_active":"2024-04-01T01:55:49.271821+0000","last_became_peered":"2024-04-01T01:55:49.271821+0000","last_unstale":"2024-04-01T01:55:50.636256+0000","last_undegraded":"2024-04-01T01:55:50.636256+0000","last_fullsized":"2024-04-01T01:55:50.636256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T13:22:31.821166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.664742+0000","last_change":"2024-04-01T01:55:48.218296+0000","last_active":"2024-04-01T01:55:50.664742+0000","last_peered":"2024-04-01T01:55:50.664742+0000","last_clean":"2024-04-01T01:55:50.664742+0000","last_became_active":"2024-04-01T01:55:48.217516+0000","last_became_peered":"2024-04-01T01:55:48.217516+0000","last_unstale":"2024-04-01T01:55:50.664742+0000","last_undegraded":"2024-04-01T01:55:50.664742+0000","last_fullsized":"2024-04-01T01:55:50.664742+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:36:42.625449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.226891+0000","last_change":"2024-04-01T01:55:49.246734+0000","last_active":"2024-04-01T01:55:50.226891+0000","last_peered":"2024-04-01T01:55:50.226891+0000","last_clean":"2024-04-01T01:55:50.226891+0000","last_became_active":"2024-04-01T01:55:49.246152+0000","last_became_peered":"2024-04-01T01:55:49.246152+0000","last_unstale":"2024-04-01T01:55:50.226891+0000","last_undegraded":"2024-04-01T01:55:50.226891+0000","last_fullsized":"2024-04-01T01:55:50.226891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:52:34.992185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.667221+0000","last_change":"2024-04-01T01:55:48.222956+0000","last_active":"2024-04-01T01:55:50.667221+0000","last_peered":"2024-04-01T01:55:50.667221+0000","last_clean":"2024-04-01T01:55:50.667221+0000","last_became_active":"2024-04-01T01:55:48.222414+0000","last_became_peered":"2024-04-01T01:55:48.222414+0000","last_unstale":"2024-04-01T01:55:50.667221+0000","last_undegraded":"2024-04-01T01:55:50.667221+0000","last_fullsized":"2024-04-01T01:55:50.667221+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:26:08.622975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.485388+0000","last_change":"2024-04-01T01:55:49.247633+0000","last_active":"2024-04-01T01:55:50.485388+0000","last_peered":"2024-04-01T01:55:50.485388+0000","last_clean":"2024-04-01T01:55:50.485388+0000","last_became_active":"2024-04-01T01:55:49.247285+0000","last_became_peered":"2024-04-01T01:55:49.247285+0000","last_unstale":"2024-04-01T01:55:50.485388+0000","last_undegraded":"2024-04-01T01:55:50.485388+0000","last_fullsized":"2024-04-01T01:55:50.485388+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:15:01.912111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.226200+0000","last_change":"2024-04-01T01:55:48.226323+0000","last_active":"2024-04-01T01:55:50.226200+0000","last_peered":"2024-04-01T01:55:50.226200+0000","last_clean":"2024-04-01T01:55:50.226200+0000","last_became_active":"2024-04-01T01:55:48.225487+0000","last_became_peered":"2024-04-01T01:55:48.225487+0000","last_unstale":"2024-04-01T01:55:50.226200+0000","last_undegraded":"2024-04-01T01:55:50.226200+0000","last_fullsized":"2024-04-01T01:55:50.226200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:13:17.832963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.667602+0000","last_change":"2024-04-01T01:55:49.265542+0000","last_active":"2024-04-01T01:55:50.667602+0000","last_peered":"2024-04-01T01:55:50.667602+0000","last_clean":"2024-04-01T01:55:50.667602+0000","last_became_active":"2024-04-01T01:55:49.264914+0000","last_became_peered":"2024-04-01T01:55:49.264914+0000","last_unstale":"2024-04-01T01:55:50.667602+0000","last_undegraded":"2024-04-01T01:55:50.667602+0000","last_fullsized":"2024-04-01T01:55:50.667602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:55:44.175129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.667910+0000","last_change":"2024-04-01T01:55:48.227292+0000","last_active":"2024-04-01T01:55:50.667910+0000","last_peered":"2024-04-01T01:55:50.667910+0000","last_clean":"2024-04-01T01:55:50.667910+0000","last_became_active":"2024-04-01T01:55:48.226948+0000","last_became_peered":"2024-04-01T01:55:48.226948+0000","last_unstale":"2024-04-01T01:55:50.667910+0000","last_undegraded":"2024-04-01T01:55:50.667910+0000","last_fullsized":"2024-04-01T01:55:50.667910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:55:43.165347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.636006+0000","last_change":"2024-04-01T01:55:49.244171+0000","last_active":"2024-04-01T01:55:50.636006+0000","last_peered":"2024-04-01T01:55:50.636006+0000","last_clean":"2024-04-01T01:55:50.636006+0000","last_became_active":"2024-04-01T01:55:49.241632+0000","last_became_peered":"2024-04-01T01:55:49.241632+0000","last_unstale":"2024-04-01T01:55:50.636006+0000","last_undegraded":"2024-04-01T01:55:50.636006+0000","last_fullsized":"2024-04-01T01:55:50.636006+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:24:42.777720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.228150+0000","last_change":"2024-04-01T01:55:48.204432+0000","last_active":"2024-04-01T01:55:50.228150+0000","last_peered":"2024-04-01T01:55:50.228150+0000","last_clean":"2024-04-01T01:55:50.228150+0000","last_became_active":"2024-04-01T01:55:48.203576+0000","last_became_peered":"2024-04-01T01:55:48.203576+0000","last_unstale":"2024-04-01T01:55:50.228150+0000","last_undegraded":"2024-04-01T01:55:50.228150+0000","last_fullsized":"2024-04-01T01:55:50.228150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:49:34.960786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.227962+0000","last_change":"2024-04-01T01:55:49.244993+0000","last_active":"2024-04-01T01:55:50.227962+0000","last_peered":"2024-04-01T01:55:50.227962+0000","last_clean":"2024-04-01T01:55:50.227962+0000","last_became_active":"2024-04-01T01:55:49.244632+0000","last_became_peered":"2024-04-01T01:55:49.244632+0000","last_unstale":"2024-04-01T01:55:50.227962+0000","last_undegraded":"2024-04-01T01:55:50.227962+0000","last_fullsized":"2024-04-01T01:55:50.227962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:30:26.148968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.668315+0000","last_change":"2024-04-01T01:55:48.221282+0000","last_active":"2024-04-01T01:55:50.668315+0000","last_peered":"2024-04-01T01:55:50.668315+0000","last_clean":"2024-04-01T01:55:50.668315+0000","last_became_active":"2024-04-01T01:55:48.220889+0000","last_became_peered":"2024-04-01T01:55:48.220889+0000","last_unstale":"2024-04-01T01:55:50.668315+0000","last_undegraded":"2024-04-01T01:55:50.668315+0000","last_fullsized":"2024-04-01T01:55:50.668315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:13:12.104386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.227472+0000","last_change":"2024-04-01T01:55:49.251927+0000","last_active":"2024-04-01T01:55:50.227472+0000","last_peered":"2024-04-01T01:55:50.227472+0000","last_clean":"2024-04-01T01:55:50.227472+0000","last_became_active":"2024-04-01T01:55:49.251641+0000","last_became_peered":"2024-04-01T01:55:49.251641+0000","last_unstale":"2024-04-01T01:55:50.227472+0000","last_undegraded":"2024-04-01T01:55:50.227472+0000","last_fullsized":"2024-04-01T01:55:50.227472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T13:22:31.821166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.484332+0000","last_change":"2024-04-01T01:55:48.204161+0000","last_active":"2024-04-01T01:55:50.484332+0000","last_peered":"2024-04-01T01:55:50.484332+0000","last_clean":"2024-04-01T01:55:50.484332+0000","last_became_active":"2024-04-01T01:55:48.203828+0000","last_became_peered":"2024-04-01T01:55:48.203828+0000","last_unstale":"2024-04-01T01:55:50.484332+0000","last_undegraded":"2024-04-01T01:55:50.484332+0000","last_fullsized":"2024-04-01T01:55:50.484332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:04:19.568533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.666187+0000","last_change":"2024-04-01T01:55:49.259699+0000","last_active":"2024-04-01T01:55:50.666187+0000","last_peered":"2024-04-01T01:55:50.666187+0000","last_clean":"2024-04-01T01:55:50.666187+0000","last_became_active":"2024-04-01T01:55:49.259332+0000","last_became_peered":"2024-04-01T01:55:49.259332+0000","last_unstale":"2024-04-01T01:55:50.666187+0000","last_undegraded":"2024-04-01T01:55:50.666187+0000","last_fullsized":"2024-04-01T01:55:50.666187+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:02:41.829474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.227810+0000","last_change":"2024-04-01T01:55:48.206742+0000","last_active":"2024-04-01T01:55:50.227810+0000","last_peered":"2024-04-01T01:55:50.227810+0000","last_clean":"2024-04-01T01:55:50.227810+0000","last_became_active":"2024-04-01T01:55:48.206027+0000","last_became_peered":"2024-04-01T01:55:48.206027+0000","last_unstale":"2024-04-01T01:55:50.227810+0000","last_undegraded":"2024-04-01T01:55:50.227810+0000","last_fullsized":"2024-04-01T01:55:50.227810+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:18:27.840431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.228142+0000","last_change":"2024-04-01T01:55:49.246379+0000","last_active":"2024-04-01T01:55:50.228142+0000","last_peered":"2024-04-01T01:55:50.228142+0000","last_clean":"2024-04-01T01:55:50.228142+0000","last_became_active":"2024-04-01T01:55:49.245774+0000","last_became_peered":"2024-04-01T01:55:49.245774+0000","last_unstale":"2024-04-01T01:55:50.228142+0000","last_undegraded":"2024-04-01T01:55:50.228142+0000","last_fullsized":"2024-04-01T01:55:50.228142+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:25:48.896071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.635697+0000","last_change":"2024-04-01T01:55:48.222218+0000","last_active":"2024-04-01T01:55:50.635697+0000","last_peered":"2024-04-01T01:55:50.635697+0000","last_clean":"2024-04-01T01:55:50.635697+0000","last_became_active":"2024-04-01T01:55:48.221148+0000","last_became_peered":"2024-04-01T01:55:48.221148+0000","last_unstale":"2024-04-01T01:55:50.635697+0000","last_undegraded":"2024-04-01T01:55:50.635697+0000","last_fullsized":"2024-04-01T01:55:50.635697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:25:51.219789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.665026+0000","last_change":"2024-04-01T01:55:49.249648+0000","last_active":"2024-04-01T01:55:50.665026+0000","last_peered":"2024-04-01T01:55:50.665026+0000","last_clean":"2024-04-01T01:55:50.665026+0000","last_became_active":"2024-04-01T01:55:49.248925+0000","last_became_peered":"2024-04-01T01:55:49.248925+0000","last_unstale":"2024-04-01T01:55:50.665026+0000","last_undegraded":"2024-04-01T01:55:50.665026+0000","last_fullsized":"2024-04-01T01:55:50.665026+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:33:56.754206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.666488+0000","last_change":"2024-04-01T01:55:48.207522+0000","last_active":"2024-04-01T01:55:50.666488+0000","last_peered":"2024-04-01T01:55:50.666488+0000","last_clean":"2024-04-01T01:55:50.666488+0000","last_became_active":"2024-04-01T01:55:48.206856+0000","last_became_peered":"2024-04-01T01:55:48.206856+0000","last_unstale":"2024-04-01T01:55:50.666488+0000","last_undegraded":"2024-04-01T01:55:50.666488+0000","last_fullsized":"2024-04-01T01:55:50.666488+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:33:55.744424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.667078+0000","last_change":"2024-04-01T01:55:49.274489+0000","last_active":"2024-04-01T01:55:50.667078+0000","last_peered":"2024-04-01T01:55:50.667078+0000","last_clean":"2024-04-01T01:55:50.667078+0000","last_became_active":"2024-04-01T01:55:49.270254+0000","last_became_peered":"2024-04-01T01:55:49.270254+0000","last_unstale":"2024-04-01T01:55:50.667078+0000","last_undegraded":"2024-04-01T01:55:50.667078+0000","last_fullsized":"2024-04-01T01:55:50.667078+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T13:09:00.491227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.666309+0000","last_change":"2024-04-01T01:55:49.275782+0000","last_active":"2024-04-01T01:55:50.666309+0000","last_peered":"2024-04-01T01:55:50.666309+0000","last_clean":"2024-04-01T01:55:50.666309+0000","last_became_active":"2024-04-01T01:55:49.275050+0000","last_became_peered":"2024-04-01T01:55:49.275050+0000","last_unstale":"2024-04-01T01:55:50.666309+0000","last_undegraded":"2024-04-01T01:55:50.666309+0000","last_fullsized":"2024-04-01T01:55:50.666309+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:26:15.406856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.485245+0000","last_change":"2024-04-01T01:55:48.223704+0000","last_active":"2024-04-01T01:55:50.485245+0000","last_peered":"2024-04-01T01:55:50.485245+0000","last_clean":"2024-04-01T01:55:50.485245+0000","last_became_active":"2024-04-01T01:55:48.223220+0000","last_became_peered":"2024-04-01T01:55:48.223220+0000","last_unstale":"2024-04-01T01:55:50.485245+0000","last_undegraded":"2024-04-01T01:55:50.485245+0000","last_fullsized":"2024-04-01T01:55:50.485245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:49:34.960786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.223741+0000","last_change":"2024-04-01T01:55:49.264857+0000","last_active":"2024-04-01T01:55:50.223741+0000","last_peered":"2024-04-01T01:55:50.223741+0000","last_clean":"2024-04-01T01:55:50.223741+0000","last_became_active":"2024-04-01T01:55:49.258478+0000","last_became_peered":"2024-04-01T01:55:49.258478+0000","last_unstale":"2024-04-01T01:55:50.223741+0000","last_undegraded":"2024-04-01T01:55:50.223741+0000","last_fullsized":"2024-04-01T01:55:50.223741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:33:56.754206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.485995+0000","last_change":"2024-04-01T01:55:48.218370+0000","last_active":"2024-04-01T01:55:50.485995+0000","last_peered":"2024-04-01T01:55:50.485995+0000","last_clean":"2024-04-01T01:55:50.485995+0000","last_became_active":"2024-04-01T01:55:48.217755+0000","last_became_peered":"2024-04-01T01:55:48.217755+0000","last_unstale":"2024-04-01T01:55:50.485995+0000","last_undegraded":"2024-04-01T01:55:50.485995+0000","last_fullsized":"2024-04-01T01:55:50.485995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:09:28.276592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.228017+0000","last_change":"2024-04-01T01:55:49.243377+0000","last_active":"2024-04-01T01:55:50.228017+0000","last_peered":"2024-04-01T01:55:50.228017+0000","last_clean":"2024-04-01T01:55:50.228017+0000","last_became_active":"2024-04-01T01:55:49.242851+0000","last_became_peered":"2024-04-01T01:55:49.242851+0000","last_unstale":"2024-04-01T01:55:50.228017+0000","last_undegraded":"2024-04-01T01:55:50.228017+0000","last_fullsized":"2024-04-01T01:55:50.228017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:48:38.596647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.227487+0000","last_change":"2024-04-01T01:55:48.213862+0000","last_active":"2024-04-01T01:55:50.227487+0000","last_peered":"2024-04-01T01:55:50.227487+0000","last_clean":"2024-04-01T01:55:50.227487+0000","last_became_active":"2024-04-01T01:55:48.213122+0000","last_became_peered":"2024-04-01T01:55:48.213122+0000","last_unstale":"2024-04-01T01:55:50.227487+0000","last_undegraded":"2024-04-01T01:55:50.227487+0000","last_fullsized":"2024-04-01T01:55:50.227487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:59:23.563864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.227575+0000","last_change":"2024-04-01T01:55:49.252273+0000","last_active":"2024-04-01T01:55:50.227575+0000","last_peered":"2024-04-01T01:55:50.227575+0000","last_clean":"2024-04-01T01:55:50.227575+0000","last_became_active":"2024-04-01T01:55:49.251963+0000","last_became_peered":"2024-04-01T01:55:49.251963+0000","last_unstale":"2024-04-01T01:55:50.227575+0000","last_undegraded":"2024-04-01T01:55:50.227575+0000","last_fullsized":"2024-04-01T01:55:50.227575+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:56:18.086766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.227756+0000","last_change":"2024-04-01T01:55:48.225858+0000","last_active":"2024-04-01T01:55:50.227756+0000","last_peered":"2024-04-01T01:55:50.227756+0000","last_clean":"2024-04-01T01:55:50.227756+0000","last_became_active":"2024-04-01T01:55:48.224494+0000","last_became_peered":"2024-04-01T01:55:48.224494+0000","last_unstale":"2024-04-01T01:55:50.227756+0000","last_undegraded":"2024-04-01T01:55:50.227756+0000","last_fullsized":"2024-04-01T01:55:50.227756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:09:28.276592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66838,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509446,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":74457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509444,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31388,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340452,"statfs":{"total":96636764160,"available":96604622848,"internally_reserved":0,"allocated":212992,"data_stored":72755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":221184,"data_stored":73785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31456,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340384,"statfs":{"total":96636764160,"available":96604553216,"internally_reserved":0,"allocated":278528,"data_stored":662611,"data_compressed":33419,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509444,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":217088,"data_stored":72229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542149,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":72173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":282624,"data_stored":662633,"data_compressed":33419,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33419,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33419,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-01T01:55:58.279 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-01T01:55:58.280 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-01T01:55:58.280 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-01T01:55:58.280 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-01T01:55:58.280 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-01T01:55:58.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.406+0000 7fb7e0a0e640 1 Processor -- start 2024-04-01T01:55:58.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.406+0000 7fb7e0a0e640 1 -- start start 2024-04-01T01:55:58.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.406+0000 7fb7e0a0e640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fb7dc0c6c60 0x7fb7dc0c7850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:58.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.406+0000 7fb7e0a0e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7dc156cc0 con 0x7fb7dc1502a0 2024-04-01T01:55:58.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.406+0000 7fb7e0a0e640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7dc0c5ea0 con 0x7fb7dc0c3e70 2024-04-01T01:55:58.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.406+0000 7fb7e0a0e640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fb7dc0c7070 con 0x7fb7dc0c6c60 2024-04-01T01:55:58.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.406+0000 7fb7da59c640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fb7dc1502a0 0x7fb7dc06ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44530/0 (socket says 172.21.15.50:44530) 2024-04-01T01:55:58.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.406+0000 7fb7da59c640 1 -- 172.21.15.50:0/3121209684 learned_addr learned my addr 172.21.15.50:0/3121209684 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-04-01T01:55:58.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.406+0000 7fb7dad9d640 1 --2- 172.21.15.50:0/3121209684 >> v2:172.21.15.97:3300/0 conn(0x7fb7dc0c6c60 0x7fb7dc0c7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:58.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.406+0000 7fb7d959a640 1 -- 172.21.15.50:0/3121209684 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 515725499 0 0) 0x7fb7dc156cc0 con 0x7fb7dc1502a0 2024-04-01T01:55:58.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.406+0000 7fb7d959a640 1 -- 172.21.15.50:0/3121209684 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb7c4003530 con 0x7fb7dc1502a0 2024-04-01T01:55:58.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.406+0000 7fb7dad9d640 1 -- 172.21.15.50:0/3121209684 >> v1:172.21.15.97:6789/0 conn(0x7fb7dc0c3e70 legacy=0x7fb7dc15ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:58.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.406+0000 7fb7dad9d640 1 -- 172.21.15.50:0/3121209684 >> v1:172.21.15.50:6789/0 conn(0x7fb7dc1502a0 legacy=0x7fb7dc06ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:58.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.406+0000 7fb7d959a640 1 -- 172.21.15.50:0/3121209684 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3957514028 0 0) 0x7fb7c4003530 con 0x7fb7dc1502a0 2024-04-01T01:55:58.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.406+0000 7fb7dad9d640 1 -- 172.21.15.50:0/3121209684 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7dc0c6180 con 0x7fb7dc0c6c60 2024-04-01T01:55:58.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.410+0000 7fb7dad9d640 1 --2- 172.21.15.50:0/3121209684 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb7dc0c6c60 0x7fb7dc0c7850 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb7d4009d90 tx=0x7fb7d401f080 comp rx=0 tx=0).ready entity=mon.1 client_cookie=13ecd96475b59aa4 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:58.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.410+0000 7fb7d959a640 1 -- 172.21.15.50:0/3121209684 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7d40b5070 con 0x7fb7dc0c6c60 2024-04-01T01:55:58.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.410+0000 7fb7d959a640 1 -- 172.21.15.50:0/3121209684 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7d40a8c10 con 0x7fb7dc0c6c60 2024-04-01T01:55:58.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.410+0000 7fb7d959a640 1 -- 172.21.15.50:0/3121209684 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7d0001680 con 0x7fb7dc0c6c60 2024-04-01T01:55:58.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.410+0000 7fb7e0a0e640 1 -- 172.21.15.50:0/3121209684 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb7dc0c6c60 msgr2=0x7fb7dc0c7850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:58.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.410+0000 7fb7e0a0e640 1 --2- 172.21.15.50:0/3121209684 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb7dc0c6c60 0x7fb7dc0c7850 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb7d4009d90 tx=0x7fb7d401f080 comp rx=0 tx=0).stop 2024-04-01T01:55:58.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.410+0000 7fb7e0a0e640 1 -- 172.21.15.50:0/3121209684 shutdown_connections 2024-04-01T01:55:58.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.410+0000 7fb7e0a0e640 1 --2- 172.21.15.50:0/3121209684 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb7dc0c6c60 0x7fb7dc0c7850 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:58.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.410+0000 7fb7e0a0e640 1 -- 172.21.15.50:0/3121209684 >> 172.21.15.50:0/3121209684 conn(0x7fb7dc067560 msgr2=0x7fb7dc06b220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:55:58.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.410+0000 7fb7e0a0e640 1 -- 172.21.15.50:0/3121209684 shutdown_connections 2024-04-01T01:55:58.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.410+0000 7fb7e0a0e640 1 -- 172.21.15.50:0/3121209684 wait complete. 2024-04-01T01:55:58.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.410+0000 7fb7e0a0e640 1 Processor -- start 2024-04-01T01:55:58.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.410+0000 7fb7e0a0e640 1 -- start start 2024-04-01T01:55:58.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.414+0000 7fb7e0a0e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb7dc0c3e70 0x7fb7dc0cb300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:58.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.414+0000 7fb7e0a0e640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb7dc0c6c60 0x7fb7dc0cb840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:58.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.414+0000 7fb7e0a0e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7dc1502a0 0x7fb7dc13ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:58.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.414+0000 7fb7e0a0e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb7dc156fa0 con 0x7fb7dc1502a0 2024-04-01T01:55:58.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.414+0000 7fb7e0a0e640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fb7dc0c6740 con 0x7fb7dc0c3e70 2024-04-01T01:55:58.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.414+0000 7fb7e0a0e640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fb7dc0c8c70 con 0x7fb7dc0c6c60 2024-04-01T01:55:58.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.414+0000 7fb7dad9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7dc1502a0 0x7fb7dc13ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:58.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.414+0000 7fb7dad9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7dc1502a0 0x7fb7dc13ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50436/0 (socket says 172.21.15.50:50436) 2024-04-01T01:55:58.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.414+0000 7fb7dad9d640 1 -- 172.21.15.50:0/4012251207 learned_addr learned my addr 172.21.15.50:0/4012251207 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T01:55:58.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.414+0000 7fb7da59c640 1 --2- 172.21.15.50:0/4012251207 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb7dc0c3e70 0x7fb7dc0cb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:58.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.414+0000 7fb7d9d9b640 1 --2- 172.21.15.50:0/4012251207 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb7dc0c6c60 0x7fb7dc0cb840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:58.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.414+0000 7fb7dad9d640 1 -- 172.21.15.50:0/4012251207 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb7dc0c6c60 msgr2=0x7fb7dc0cb840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:58.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.414+0000 7fb7dad9d640 1 --2- 172.21.15.50:0/4012251207 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb7dc0c6c60 0x7fb7dc0cb840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:58.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.414+0000 7fb7dad9d640 1 -- 172.21.15.50:0/4012251207 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb7dc0c3e70 msgr2=0x7fb7dc0cb300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:58.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.414+0000 7fb7dad9d640 1 --2- 172.21.15.50:0/4012251207 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb7dc0c3e70 0x7fb7dc0cb300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:58.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.414+0000 7fb7dad9d640 1 -- 172.21.15.50:0/4012251207 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7dc1410d0 con 0x7fb7dc1502a0 2024-04-01T01:55:58.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.414+0000 7fb7d9d9b640 1 --2- 172.21.15.50:0/4012251207 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb7dc0c6c60 0x7fb7dc0cb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T01:55:58.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.414+0000 7fb7dad9d640 1 --2- 172.21.15.50:0/4012251207 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7dc1502a0 0x7fb7dc13ba00 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb7d40b3040 tx=0x7fb7d401be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:58.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.414+0000 7fb7caffd640 1 -- 172.21.15.50:0/4012251207 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7d40c0020 con 0x7fb7dc1502a0 2024-04-01T01:55:58.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.414+0000 7fb7caffd640 1 -- 172.21.15.50:0/4012251207 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7d40b0d30 con 0x7fb7dc1502a0 2024-04-01T01:55:58.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.414+0000 7fb7e0a0e640 1 -- 172.21.15.50:0/4012251207 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7dc141370 con 0x7fb7dc1502a0 2024-04-01T01:55:58.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.414+0000 7fb7caffd640 1 -- 172.21.15.50:0/4012251207 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7d40b5040 con 0x7fb7dc1502a0 2024-04-01T01:55:58.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.414+0000 7fb7e0a0e640 1 -- 172.21.15.50:0/4012251207 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7dc142850 con 0x7fb7dc1502a0 2024-04-01T01:55:58.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.414+0000 7fb7e0a0e640 1 -- 172.21.15.50:0/4012251207 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7dc068230 con 0x7fb7dc1502a0 2024-04-01T01:55:58.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.414+0000 7fb7caffd640 1 -- 172.21.15.50:0/4012251207 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 87103+0+0 (secure 0 0 0) 0x7fb7d40c3020 con 0x7fb7dc1502a0 2024-04-01T01:55:58.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.418+0000 7fb7caffd640 1 --2- 172.21.15.50:0/4012251207 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fb7bc067420 0x7fb7bc0698e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:58.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.418+0000 7fb7caffd640 1 -- 172.21.15.50:0/4012251207 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fb7d41244d0 con 0x7fb7dc1502a0 2024-04-01T01:55:58.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.418+0000 7fb7da59c640 1 --2- 172.21.15.50:0/4012251207 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fb7bc067420 0x7fb7bc0698e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:58.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.418+0000 7fb7da59c640 1 --2- 172.21.15.50:0/4012251207 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fb7bc067420 0x7fb7bc0698e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb7d0005890 tx=0x7fb7d0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:58.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.418+0000 7fb7caffd640 1 -- 172.21.15.50:0/4012251207 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+176632 (secure 0 0 0) 0x7fb7d40ca070 con 0x7fb7dc1502a0 2024-04-01T01:55:58.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.622+0000 7fb7e0a0e640 1 -- 172.21.15.50:0/4012251207 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fb7dc0c3090 con 0x7fb7dc1502a0 2024-04-01T01:55:58.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.626+0000 7fb7caffd640 1 -- 172.21.15.50:0/4012251207 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+166326 (secure 0 0 0) 0x7fb7d4018be0 con 0x7fb7dc1502a0 2024-04-01T01:55:58.629 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-01T01:55:58.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.630+0000 7fb7e0a0e640 1 -- 172.21.15.50:0/4012251207 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fb7bc067420 msgr2=0x7fb7bc0698e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:58.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.630+0000 7fb7e0a0e640 1 --2- 172.21.15.50:0/4012251207 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fb7bc067420 0x7fb7bc0698e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb7d0005890 tx=0x7fb7d0009040 comp rx=0 tx=0).stop 2024-04-01T01:55:58.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.630+0000 7fb7e0a0e640 1 -- 172.21.15.50:0/4012251207 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7dc1502a0 msgr2=0x7fb7dc13ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:58.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.630+0000 7fb7e0a0e640 1 --2- 172.21.15.50:0/4012251207 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7dc1502a0 0x7fb7dc13ba00 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb7d40b3040 tx=0x7fb7d401be20 comp rx=0 tx=0).stop 2024-04-01T01:55:58.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.630+0000 7fb7e0a0e640 1 -- 172.21.15.50:0/4012251207 shutdown_connections 2024-04-01T01:55:58.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.630+0000 7fb7e0a0e640 1 --2- 172.21.15.50:0/4012251207 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fb7bc067420 0x7fb7bc0698e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:58.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.630+0000 7fb7e0a0e640 1 --2- 172.21.15.50:0/4012251207 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7dc1502a0 0x7fb7dc13ba00 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:58.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.630+0000 7fb7e0a0e640 1 --2- 172.21.15.50:0/4012251207 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb7dc0c6c60 0x7fb7dc0cb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:58.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.630+0000 7fb7e0a0e640 1 --2- 172.21.15.50:0/4012251207 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb7dc0c3e70 0x7fb7dc0cb300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:58.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.630+0000 7fb7e0a0e640 1 -- 172.21.15.50:0/4012251207 >> 172.21.15.50:0/4012251207 conn(0x7fb7dc067560 msgr2=0x7fb7dc0c5170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:55:58.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.630+0000 7fb7e0a0e640 1 -- 172.21.15.50:0/4012251207 shutdown_connections 2024-04-01T01:55:58.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.630+0000 7fb7e0a0e640 1 -- 172.21.15.50:0/4012251207 wait complete. 2024-04-01T01:55:58.648 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":5,"flags":0,"active_gid":4103,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6832","nonce":1677467570},{"type":"v1","addr":"172.21.15.97:6833","nonce":1677467570}]},"active_addr":"172.21.15.97:6833/1677467570","active_change":"2024-04-01T01:55:36.050207+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4104,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.97:0","nonce":3386409652}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.97:0","nonce":2210548966}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.97:0","nonce":594603648}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.97:0","nonce":1374473574}]}]} 2024-04-01T01:55:58.652 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-01T01:55:58.652 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-01T01:55:58.652 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-01T01:55:58.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.778+0000 7f2cfe88f640 1 Processor -- start 2024-04-01T01:55:58.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.778+0000 7f2cfe88f640 1 -- start start 2024-04-01T01:55:58.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.778+0000 7f2cfe88f640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f2cf8151de0 0x7f2cf8157be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:58.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.778+0000 7f2cfe88f640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2cf8158120 0x7f2cf8162560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:58.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.778+0000 7f2cfe88f640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2cf80c30d0 con 0x7f2cf80c2900 2024-04-01T01:55:58.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.778+0000 7f2cfe88f640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f2cf815b370 con 0x7f2cf8151de0 2024-04-01T01:55:58.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.778+0000 7f2cfe88f640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f2cf815c0f0 con 0x7f2cf8158120 2024-04-01T01:55:58.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.778+0000 7f2cf77fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f2cf80c2900 0x7f2cf80c5f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44534/0 (socket says 172.21.15.50:44534) 2024-04-01T01:55:58.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.778+0000 7f2cf77fe640 1 -- 172.21.15.50:0/338530780 learned_addr learned my addr 172.21.15.50:0/338530780 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-04-01T01:55:58.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.778+0000 7f2cf7fff640 1 --2- 172.21.15.50:0/338530780 >> v2:172.21.15.97:3300/0 conn(0x7f2cf8151de0 0x7f2cf8157be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:58.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.778+0000 7f2cfce2c640 1 --2- 172.21.15.50:0/338530780 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2cf8158120 0x7f2cf8162560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:58.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.778+0000 7f2cf6ffd640 1 -- 172.21.15.50:0/338530780 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 393115992 0 0) 0x7f2cf80c30d0 con 0x7f2cf80c2900 2024-04-01T01:55:58.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.778+0000 7f2cf6ffd640 1 -- 172.21.15.50:0/338530780 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2ce0003530 con 0x7f2cf80c2900 2024-04-01T01:55:58.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.778+0000 7f2cf6ffd640 1 -- 172.21.15.50:0/338530780 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1893585271 0 0) 0x7f2ce0003530 con 0x7f2cf80c2900 2024-04-01T01:55:58.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.778+0000 7f2cf6ffd640 1 -- 172.21.15.50:0/338530780 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2cf8158120 msgr2=0x7f2cf8162560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:55:58.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.778+0000 7f2cf6ffd640 1 --2- 172.21.15.50:0/338530780 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2cf8158120 0x7f2cf8162560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:58.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.778+0000 7f2cf6ffd640 1 -- 172.21.15.50:0/338530780 >> v2:172.21.15.97:3300/0 conn(0x7f2cf8151de0 msgr2=0x7f2cf8157be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:55:58.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.778+0000 7f2cf6ffd640 1 --2- 172.21.15.50:0/338530780 >> v2:172.21.15.97:3300/0 conn(0x7f2cf8151de0 0x7f2cf8157be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:58.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.778+0000 7f2cf6ffd640 1 -- 172.21.15.50:0/338530780 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cf80c2df0 con 0x7f2cf80c2900 2024-04-01T01:55:58.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.778+0000 7f2cf6ffd640 1 -- 172.21.15.50:0/338530780 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2779672543 0 0) 0x7f2cec001680 con 0x7f2cf80c2900 2024-04-01T01:55:58.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.778+0000 7f2cf6ffd640 1 -- 172.21.15.50:0/338530780 >> v1:172.21.15.50:6789/0 conn(0x7f2cf80c2900 legacy=0x7f2cf80c5f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:58.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.778+0000 7f2cf6ffd640 1 --2- 172.21.15.50:0/338530780 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2ce00039c0 0x7f2ce0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:58.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.778+0000 7f2cf6ffd640 1 --2- 172.21.15.50:0/338530780 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ce0004810 0x7f2ce0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:58.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.778+0000 7f2cf6ffd640 1 --2- 172.21.15.50:0/338530780 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2cf8158120 0x7f2ce00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:58.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.778+0000 7f2cf6ffd640 1 -- 172.21.15.50:0/338530780 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f2cf815b370 con 0x7f2ce0004810 2024-04-01T01:55:58.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.778+0000 7f2cf6ffd640 1 -- 172.21.15.50:0/338530780 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f2cf815c0f0 con 0x7f2ce00039c0 2024-04-01T01:55:58.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.778+0000 7f2cf6ffd640 1 -- 172.21.15.50:0/338530780 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f2ce000b9d0 con 0x7f2cf8158120 2024-04-01T01:55:58.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.778+0000 7f2cf77fe640 1 --2- 172.21.15.50:0/338530780 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ce0004810 0x7f2ce0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:58.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.778+0000 7f2cf7fff640 1 --2- 172.21.15.50:0/338530780 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2ce00039c0 0x7f2ce0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:58.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.778+0000 7f2cfce2c640 1 --2- 172.21.15.50:0/338530780 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2cf8158120 0x7f2ce00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:58.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.778+0000 7f2cf77fe640 1 -- 172.21.15.50:0/338530780 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2cf8158120 msgr2=0x7f2ce00051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:55:58.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.778+0000 7f2cf77fe640 1 --2- 172.21.15.50:0/338530780 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2cf8158120 0x7f2ce00051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:58.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.778+0000 7f2cf77fe640 1 -- 172.21.15.50:0/338530780 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2ce00039c0 msgr2=0x7f2ce0003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:55:58.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.778+0000 7f2cf77fe640 1 --2- 172.21.15.50:0/338530780 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2ce00039c0 0x7f2ce0003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:58.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.778+0000 7f2cf77fe640 1 -- 172.21.15.50:0/338530780 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ce0003530 con 0x7f2ce0004810 2024-04-01T01:55:58.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.778+0000 7f2cfce2c640 1 --2- 172.21.15.50:0/338530780 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2cf8158120 0x7f2ce00051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T01:55:58.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.782+0000 7f2cf77fe640 1 --2- 172.21.15.50:0/338530780 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ce0004810 0x7f2ce0004c90 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2cec00c210 tx=0x7f2cec01cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e17589b051729646 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:58.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.782+0000 7f2cf6ffd640 1 -- 172.21.15.50:0/338530780 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cec007d60 con 0x7f2ce0004810 2024-04-01T01:55:58.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.782+0000 7f2cf6ffd640 1 -- 172.21.15.50:0/338530780 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cec0a9020 con 0x7f2ce0004810 2024-04-01T01:55:58.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.782+0000 7f2cf6ffd640 1 -- 172.21.15.50:0/338530780 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cec005b20 con 0x7f2ce0004810 2024-04-01T01:55:58.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.782+0000 7f2cfe88f640 1 -- 172.21.15.50:0/338530780 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ce0004810 msgr2=0x7f2ce0004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:58.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.782+0000 7f2cfe88f640 1 --2- 172.21.15.50:0/338530780 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ce0004810 0x7f2ce0004c90 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2cec00c210 tx=0x7f2cec01cca0 comp rx=0 tx=0).stop 2024-04-01T01:55:58.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.782+0000 7f2cfce2c640 1 -- 172.21.15.50:0/338530780 reap_dead start 2024-04-01T01:55:58.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.782+0000 7f2cfe88f640 1 -- 172.21.15.50:0/338530780 shutdown_connections 2024-04-01T01:55:58.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.782+0000 7f2cfe88f640 1 -- 172.21.15.50:0/338530780 >> 172.21.15.50:0/338530780 conn(0x7f2cf8067560 msgr2=0x7f2cf806b220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:55:58.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.782+0000 7f2cfe88f640 1 -- 172.21.15.50:0/338530780 shutdown_connections 2024-04-01T01:55:58.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.782+0000 7f2cfe88f640 1 -- 172.21.15.50:0/338530780 wait complete. 2024-04-01T01:55:58.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.782+0000 7f2cfe88f640 1 Processor -- start 2024-04-01T01:55:58.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.782+0000 7f2cfe88f640 1 -- start start 2024-04-01T01:55:58.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.782+0000 7f2cfe88f640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2ce0004810 0x7f2cf814e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:58.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.782+0000 7f2cfe88f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2cf81494f0 0x7f2cf8156bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:58.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.782+0000 7f2cfe88f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2cf814ac90 0x7f2cf8147850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:58.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.782+0000 7f2cfe88f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f2cf815bbd0 con 0x7f2cf81494f0 2024-04-01T01:55:58.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.782+0000 7f2cfe88f640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f2cf815b8f0 con 0x7f2cf814ac90 2024-04-01T01:55:58.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.782+0000 7f2cfe88f640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f2cf80c88a0 con 0x7f2ce0004810 2024-04-01T01:55:58.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.782+0000 7f2cf77fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2cf81494f0 0x7f2cf8156bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:58.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.782+0000 7f2cf77fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2cf81494f0 0x7f2cf8156bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50460/0 (socket says 172.21.15.50:50460) 2024-04-01T01:55:58.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.782+0000 7f2cf77fe640 1 -- 172.21.15.50:0/3813395469 learned_addr learned my addr 172.21.15.50:0/3813395469 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T01:55:58.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.782+0000 7f2cfce2c640 1 --2- 172.21.15.50:0/3813395469 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2cf814ac90 0x7f2cf8147850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:58.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.782+0000 7f2cf7fff640 1 --2- 172.21.15.50:0/3813395469 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2ce0004810 0x7f2cf814e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:58.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.786+0000 7f2cf77fe640 1 -- 172.21.15.50:0/3813395469 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2ce0004810 msgr2=0x7f2cf814e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:58.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.786+0000 7f2cf77fe640 1 --2- 172.21.15.50:0/3813395469 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2ce0004810 0x7f2cf814e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:58.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.786+0000 7f2cf77fe640 1 -- 172.21.15.50:0/3813395469 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2cf814ac90 msgr2=0x7f2cf8147850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:58.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.786+0000 7f2cf77fe640 1 --2- 172.21.15.50:0/3813395469 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2cf814ac90 0x7f2cf8147850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:58.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.786+0000 7f2cf77fe640 1 -- 172.21.15.50:0/3813395469 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cf814a990 con 0x7f2cf81494f0 2024-04-01T01:55:58.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.786+0000 7f2cf77fe640 1 --2- 172.21.15.50:0/3813395469 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2cf81494f0 0x7f2cf8156bc0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2cec007040 tx=0x7f2ce0005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:58.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.786+0000 7f2cf4ff9640 1 -- 172.21.15.50:0/3813395469 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cec001cc0 con 0x7f2cf81494f0 2024-04-01T01:55:58.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.786+0000 7f2cf4ff9640 1 -- 172.21.15.50:0/3813395469 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cec0b3070 con 0x7f2cf81494f0 2024-04-01T01:55:58.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.786+0000 7f2cfe88f640 1 -- 172.21.15.50:0/3813395469 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cf814dde0 con 0x7f2cf81494f0 2024-04-01T01:55:58.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.786+0000 7f2cf4ff9640 1 -- 172.21.15.50:0/3813395469 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cec004e40 con 0x7f2cf81494f0 2024-04-01T01:55:58.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.786+0000 7f2cfe88f640 1 -- 172.21.15.50:0/3813395469 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cf814e960 con 0x7f2cf81494f0 2024-04-01T01:55:58.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.786+0000 7f2cfe88f640 1 -- 172.21.15.50:0/3813395469 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2cf8068230 con 0x7f2cf81494f0 2024-04-01T01:55:58.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.786+0000 7f2cf4ff9640 1 -- 172.21.15.50:0/3813395469 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 87103+0+0 (secure 0 0 0) 0x7f2cec0070d0 con 0x7f2cf81494f0 2024-04-01T01:55:58.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.786+0000 7f2cf4ff9640 1 --2- 172.21.15.50:0/3813395469 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f2ce4067450 0x7f2ce4069910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:58.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.786+0000 7f2cf4ff9640 1 -- 172.21.15.50:0/3813395469 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f2cec11f9b0 con 0x7f2cf81494f0 2024-04-01T01:55:58.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.786+0000 7f2cf7fff640 1 --2- 172.21.15.50:0/3813395469 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f2ce4067450 0x7f2ce4069910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:58.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.786+0000 7f2cf7fff640 1 --2- 172.21.15.50:0/3813395469 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f2ce4067450 0x7f2ce4069910 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2ce80099b0 tx=0x7f2ce8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:58.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.790+0000 7f2cf4ff9640 1 -- 172.21.15.50:0/3813395469 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+176632 (secure 0 0 0) 0x7f2cf814a990 con 0x7f2cf81494f0 2024-04-01T01:55:58.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.950+0000 7f2cfe88f640 1 -- 172.21.15.50:0/3813395469 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2cf80c7280 con 0x7f2cf81494f0 2024-04-01T01:55:58.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.950+0000 7f2cf4ff9640 1 -- 172.21.15.50:0/3813395469 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16525 (secure 0 0 0) 0x7f2cec0169b0 con 0x7f2cf81494f0 2024-04-01T01:55:58.954 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-01T01:55:58.954 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":21,"fsid":"f67878a9-bc75-426b-962d-fa7bc2517f7d","created":"2024-04-01T01:55:31.562371+0000","modified":"2024-04-01T01:55:50.217570+0000","last_up_change":"2024-04-01T01:55:42.134502+0000","last_in_change":"2024-04-01T01:55:33.849789+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-01T01:55:42.134418+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-01T01:55:47.009880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-01T01:55:47.551516+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"81e8ca4f-bde8-419a-875f-73a1f4a641ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":4170468134},{"type":"v1","addr":"172.21.15.50:6825","nonce":4170468134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":4170468134},{"type":"v1","addr":"172.21.15.50:6827","nonce":4170468134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":4170468134},{"type":"v1","addr":"172.21.15.50:6831","nonce":4170468134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":4170468134},{"type":"v1","addr":"172.21.15.50:6829","nonce":4170468134}]},"public_addr":"172.21.15.50:6825/4170468134","cluster_addr":"172.21.15.50:6827/4170468134","heartbeat_back_addr":"172.21.15.50:6831/4170468134","heartbeat_front_addr":"172.21.15.50:6829/4170468134","state":["exists","up"]},{"osd":1,"uuid":"bd060ca0-7559-4d30-987c-62e59818431d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1794491326},{"type":"v1","addr":"172.21.15.50:6809","nonce":1794491326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1794491326},{"type":"v1","addr":"172.21.15.50:6811","nonce":1794491326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1794491326},{"type":"v1","addr":"172.21.15.50:6815","nonce":1794491326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1794491326},{"type":"v1","addr":"172.21.15.50:6813","nonce":1794491326}]},"public_addr":"172.21.15.50:6809/1794491326","cluster_addr":"172.21.15.50:6811/1794491326","heartbeat_back_addr":"172.21.15.50:6815/1794491326","heartbeat_front_addr":"172.21.15.50:6813/1794491326","state":["exists","up"]},{"osd":2,"uuid":"eac5d816-a281-4acd-aa7d-b96a8e0aa962","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":710247177},{"type":"v1","addr":"172.21.15.50:6801","nonce":710247177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":710247177},{"type":"v1","addr":"172.21.15.50:6803","nonce":710247177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":710247177},{"type":"v1","addr":"172.21.15.50:6807","nonce":710247177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":710247177},{"type":"v1","addr":"172.21.15.50:6805","nonce":710247177}]},"public_addr":"172.21.15.50:6801/710247177","cluster_addr":"172.21.15.50:6803/710247177","heartbeat_back_addr":"172.21.15.50:6807/710247177","heartbeat_front_addr":"172.21.15.50:6805/710247177","state":["exists","up"]},{"osd":3,"uuid":"12b23968-04a7-40b8-98c4-02b16ae28265","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":871680805},{"type":"v1","addr":"172.21.15.50:6817","nonce":871680805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":871680805},{"type":"v1","addr":"172.21.15.50:6819","nonce":871680805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":871680805},{"type":"v1","addr":"172.21.15.50:6823","nonce":871680805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":871680805},{"type":"v1","addr":"172.21.15.50:6821","nonce":871680805}]},"public_addr":"172.21.15.50:6817/871680805","cluster_addr":"172.21.15.50:6819/871680805","heartbeat_back_addr":"172.21.15.50:6823/871680805","heartbeat_front_addr":"172.21.15.50:6821/871680805","state":["exists","up"]},{"osd":4,"uuid":"0e6b1639-23b0-47d9-8b08-40c8ab6df818","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":1095319381},{"type":"v1","addr":"172.21.15.97:6801","nonce":1095319381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":1095319381},{"type":"v1","addr":"172.21.15.97:6803","nonce":1095319381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":1095319381},{"type":"v1","addr":"172.21.15.97:6807","nonce":1095319381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":1095319381},{"type":"v1","addr":"172.21.15.97:6805","nonce":1095319381}]},"public_addr":"172.21.15.97:6801/1095319381","cluster_addr":"172.21.15.97:6803/1095319381","heartbeat_back_addr":"172.21.15.97:6807/1095319381","heartbeat_front_addr":"172.21.15.97:6805/1095319381","state":["exists","up"]},{"osd":5,"uuid":"f0f876ef-0823-46e9-8fe4-9b7a64a94cee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":899031308},{"type":"v1","addr":"172.21.15.97:6817","nonce":899031308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":899031308},{"type":"v1","addr":"172.21.15.97:6819","nonce":899031308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":899031308},{"type":"v1","addr":"172.21.15.97:6823","nonce":899031308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":899031308},{"type":"v1","addr":"172.21.15.97:6821","nonce":899031308}]},"public_addr":"172.21.15.97:6817/899031308","cluster_addr":"172.21.15.97:6819/899031308","heartbeat_back_addr":"172.21.15.97:6823/899031308","heartbeat_front_addr":"172.21.15.97:6821/899031308","state":["exists","up"]},{"osd":6,"uuid":"d29a625e-83bf-40ef-a57e-618220b96b9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2224814961},{"type":"v1","addr":"172.21.15.97:6825","nonce":2224814961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2224814961},{"type":"v1","addr":"172.21.15.97:6827","nonce":2224814961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2224814961},{"type":"v1","addr":"172.21.15.97:6831","nonce":2224814961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2224814961},{"type":"v1","addr":"172.21.15.97:6829","nonce":2224814961}]},"public_addr":"172.21.15.97:6825/2224814961","cluster_addr":"172.21.15.97:6827/2224814961","heartbeat_back_addr":"172.21.15.97:6831/2224814961","heartbeat_front_addr":"172.21.15.97:6829/2224814961","state":["exists","up"]},{"osd":7,"uuid":"7bcfd8f1-7dc0-4013-af17-16da5a8d931d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":284968823},{"type":"v1","addr":"172.21.15.97:6809","nonce":284968823}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":284968823},{"type":"v1","addr":"172.21.15.97:6811","nonce":284968823}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6814","nonce":284968823},{"type":"v1","addr":"172.21.15.97:6815","nonce":284968823}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":284968823},{"type":"v1","addr":"172.21.15.97:6813","nonce":284968823}]},"public_addr":"172.21.15.97:6809/284968823","cluster_addr":"172.21.15.97:6811/284968823","heartbeat_back_addr":"172.21.15.97:6815/284968823","heartbeat_front_addr":"172.21.15.97:6813/284968823","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T01:55:39.369550+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T01:55:39.367285+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T01:55:39.458393+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T01:55:39.456179+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T01:55:39.463649+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T01:55:38.728924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T01:55:39.522411+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T01:55:39.432081+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-01T01:55:58.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.954+0000 7f2cfe88f640 1 -- 172.21.15.50:0/3813395469 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f2ce4067450 msgr2=0x7f2ce4069910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:58.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.954+0000 7f2cfe88f640 1 --2- 172.21.15.50:0/3813395469 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f2ce4067450 0x7f2ce4069910 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2ce80099b0 tx=0x7f2ce8008040 comp rx=0 tx=0).stop 2024-04-01T01:55:58.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.954+0000 7f2cfe88f640 1 -- 172.21.15.50:0/3813395469 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2cf81494f0 msgr2=0x7f2cf8156bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:58.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.954+0000 7f2cfe88f640 1 --2- 172.21.15.50:0/3813395469 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2cf81494f0 0x7f2cf8156bc0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2cec007040 tx=0x7f2ce0005840 comp rx=0 tx=0).stop 2024-04-01T01:55:58.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.954+0000 7f2cfe88f640 1 -- 172.21.15.50:0/3813395469 shutdown_connections 2024-04-01T01:55:58.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.954+0000 7f2cfe88f640 1 --2- 172.21.15.50:0/3813395469 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f2ce4067450 0x7f2ce4069910 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:58.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.954+0000 7f2cfe88f640 1 --2- 172.21.15.50:0/3813395469 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2cf814ac90 0x7f2cf8147850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:58.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.954+0000 7f2cfe88f640 1 --2- 172.21.15.50:0/3813395469 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2cf81494f0 0x7f2cf8156bc0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:58.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.954+0000 7f2cfe88f640 1 --2- 172.21.15.50:0/3813395469 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2ce0004810 0x7f2cf814e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:58.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.954+0000 7f2cfe88f640 1 -- 172.21.15.50:0/3813395469 >> 172.21.15.50:0/3813395469 conn(0x7f2cf8067560 msgr2=0x7f2cf80cbdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:55:58.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.954+0000 7f2cfe88f640 1 -- 172.21.15.50:0/3813395469 shutdown_connections 2024-04-01T01:55:58.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:58.954+0000 7f2cfe88f640 1 -- 172.21.15.50:0/3813395469 wait complete. 2024-04-01T01:55:58.972 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-01T01:55:58.972 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-01T01:55:59.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.082+0000 7fd6c681e640 1 Processor -- start 2024-04-01T01:55:59.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.082+0000 7fd6c681e640 1 -- start start 2024-04-01T01:55:59.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.082+0000 7fd6c681e640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd6c0150e60 0x7fd6c0072f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.082+0000 7fd6c681e640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fd6c00c77c0 0x7fd6c015a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.082+0000 7fd6c681e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6c0073470 con 0x7fd6c00c73a0 2024-04-01T01:55:59.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.082+0000 7fd6c681e640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fd6c01578f0 con 0x7fd6c00c77c0 2024-04-01T01:55:59.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.082+0000 7fd6c681e640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fd6c0156a20 con 0x7fd6c0150e60 2024-04-01T01:55:59.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.082+0000 7fd6bf7fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fd6c00c73a0 0x7fd6c00c2900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44544/0 (socket says 172.21.15.50:44544) 2024-04-01T01:55:59.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.082+0000 7fd6bf7fe640 1 -- 172.21.15.50:0/3514751872 learned_addr learned my addr 172.21.15.50:0/3514751872 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-04-01T01:55:59.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.082+0000 7fd6bffff640 1 --2- 172.21.15.50:0/3514751872 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd6c0150e60 0x7fd6c0072f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:59.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.082+0000 7fd6c4dbb640 1 --2- 172.21.15.50:0/3514751872 >> v2:172.21.15.97:3300/0 conn(0x7fd6c00c77c0 0x7fd6c015a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:59.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.082+0000 7fd6beffd640 1 -- 172.21.15.50:0/3514751872 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3216310908 0 0) 0x7fd6c0073470 con 0x7fd6c00c73a0 2024-04-01T01:55:59.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.082+0000 7fd6beffd640 1 -- 172.21.15.50:0/3514751872 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd6ac003530 con 0x7fd6c00c73a0 2024-04-01T01:55:59.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.082+0000 7fd6beffd640 1 -- 172.21.15.50:0/3514751872 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1198774643 0 0) 0x7fd6ac003530 con 0x7fd6c00c73a0 2024-04-01T01:55:59.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.082+0000 7fd6beffd640 1 -- 172.21.15.50:0/3514751872 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd6c0150e60 msgr2=0x7fd6c0072f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:55:59.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.082+0000 7fd6beffd640 1 --2- 172.21.15.50:0/3514751872 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd6c0150e60 0x7fd6c0072f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:59.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.082+0000 7fd6beffd640 1 -- 172.21.15.50:0/3514751872 >> v2:172.21.15.97:3300/0 conn(0x7fd6c00c77c0 msgr2=0x7fd6c015a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:55:59.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.082+0000 7fd6beffd640 1 --2- 172.21.15.50:0/3514751872 >> v2:172.21.15.97:3300/0 conn(0x7fd6c00c77c0 0x7fd6c015a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:59.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.082+0000 7fd6beffd640 1 -- 172.21.15.50:0/3514751872 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6c0156ce0 con 0x7fd6c00c73a0 2024-04-01T01:55:59.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.082+0000 7fd6beffd640 1 -- 172.21.15.50:0/3514751872 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2779672543 0 0) 0x7fd6a8001680 con 0x7fd6c00c73a0 2024-04-01T01:55:59.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.082+0000 7fd6beffd640 1 -- 172.21.15.50:0/3514751872 >> v1:172.21.15.50:6789/0 conn(0x7fd6c00c73a0 legacy=0x7fd6c00c2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:59.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.082+0000 7fd6beffd640 1 --2- 172.21.15.50:0/3514751872 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd6c0150e60 0x7fd6ac0039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.082+0000 7fd6beffd640 1 --2- 172.21.15.50:0/3514751872 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6ac003f40 0x7fd6ac004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.082+0000 7fd6beffd640 1 --2- 172.21.15.50:0/3514751872 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd6ac004d50 0x7fd6ac0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.082+0000 7fd6beffd640 1 -- 172.21.15.50:0/3514751872 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd6c01578f0 con 0x7fd6ac003f40 2024-04-01T01:55:59.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.082+0000 7fd6beffd640 1 -- 172.21.15.50:0/3514751872 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fd6c0156a20 con 0x7fd6ac004d50 2024-04-01T01:55:59.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.082+0000 7fd6beffd640 1 -- 172.21.15.50:0/3514751872 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fd6ac00ba00 con 0x7fd6c0150e60 2024-04-01T01:55:59.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.082+0000 7fd6bf7fe640 1 --2- 172.21.15.50:0/3514751872 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6ac003f40 0x7fd6ac004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:59.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.082+0000 7fd6bffff640 1 --2- 172.21.15.50:0/3514751872 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd6c0150e60 0x7fd6ac0039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:59.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.082+0000 7fd6c4dbb640 1 --2- 172.21.15.50:0/3514751872 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd6ac004d50 0x7fd6ac0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:59.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.082+0000 7fd6bf7fe640 1 -- 172.21.15.50:0/3514751872 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd6c0150e60 msgr2=0x7fd6ac0039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:55:59.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.082+0000 7fd6bf7fe640 1 --2- 172.21.15.50:0/3514751872 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd6c0150e60 0x7fd6ac0039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:59.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.082+0000 7fd6bf7fe640 1 -- 172.21.15.50:0/3514751872 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd6ac004d50 msgr2=0x7fd6ac0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:55:59.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.082+0000 7fd6bf7fe640 1 --2- 172.21.15.50:0/3514751872 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd6ac004d50 0x7fd6ac0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:59.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.082+0000 7fd6bf7fe640 1 -- 172.21.15.50:0/3514751872 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6ac003530 con 0x7fd6ac003f40 2024-04-01T01:55:59.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.082+0000 7fd6c4dbb640 1 --2- 172.21.15.50:0/3514751872 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd6ac004d50 0x7fd6ac0051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T01:55:59.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.082+0000 7fd6bffff640 1 --2- 172.21.15.50:0/3514751872 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd6c0150e60 0x7fd6ac0039c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T01:55:59.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.086+0000 7fd6bf7fe640 1 --2- 172.21.15.50:0/3514751872 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6ac003f40 0x7fd6ac004810 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd6a800c240 tx=0x7fd6a801ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe217e3d194bcd17 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:59.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.086+0000 7fd6beffd640 1 -- 172.21.15.50:0/3514751872 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6a8007d60 con 0x7fd6ac003f40 2024-04-01T01:55:59.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.086+0000 7fd6beffd640 1 -- 172.21.15.50:0/3514751872 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6a80a9020 con 0x7fd6ac003f40 2024-04-01T01:55:59.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.086+0000 7fd6beffd640 1 -- 172.21.15.50:0/3514751872 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6a80a5bc0 con 0x7fd6ac003f40 2024-04-01T01:55:59.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.086+0000 7fd6c681e640 1 -- 172.21.15.50:0/3514751872 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6ac003f40 msgr2=0x7fd6ac004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:59.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.086+0000 7fd6c681e640 1 --2- 172.21.15.50:0/3514751872 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6ac003f40 0x7fd6ac004810 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd6a800c240 tx=0x7fd6a801ccc0 comp rx=0 tx=0).stop 2024-04-01T01:55:59.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.086+0000 7fd6c4dbb640 1 -- 172.21.15.50:0/3514751872 reap_dead start 2024-04-01T01:55:59.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.086+0000 7fd6c681e640 1 -- 172.21.15.50:0/3514751872 shutdown_connections 2024-04-01T01:55:59.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.086+0000 7fd6c681e640 1 -- 172.21.15.50:0/3514751872 >> 172.21.15.50:0/3514751872 conn(0x7fd6c0067560 msgr2=0x7fd6c006b220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:55:59.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.086+0000 7fd6c681e640 1 -- 172.21.15.50:0/3514751872 shutdown_connections 2024-04-01T01:55:59.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.086+0000 7fd6c681e640 1 -- 172.21.15.50:0/3514751872 wait complete. 2024-04-01T01:55:59.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.086+0000 7fd6c681e640 1 Processor -- start 2024-04-01T01:55:59.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.086+0000 7fd6c681e640 1 -- start start 2024-04-01T01:55:59.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.086+0000 7fd6c681e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd6c01e3350 0x7fd6c014b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.086+0000 7fd6c681e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6c01e3730 0x7fd6c0146c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.086+0000 7fd6c681e640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd6c01e4b60 0x7fd6c01471c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.086+0000 7fd6c681e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd6c0157580 con 0x7fd6c01e3730 2024-04-01T01:55:59.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.086+0000 7fd6c681e640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fd6c01572a0 con 0x7fd6c01e3350 2024-04-01T01:55:59.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.086+0000 7fd6c681e640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fd6c00c3010 con 0x7fd6c01e4b60 2024-04-01T01:55:59.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.086+0000 7fd6bf7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6c01e3730 0x7fd6c0146c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:59.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.086+0000 7fd6bf7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6c01e3730 0x7fd6c0146c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50488/0 (socket says 172.21.15.50:50488) 2024-04-01T01:55:59.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.086+0000 7fd6bf7fe640 1 -- 172.21.15.50:0/883346394 learned_addr learned my addr 172.21.15.50:0/883346394 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T01:55:59.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.086+0000 7fd6bffff640 1 --2- 172.21.15.50:0/883346394 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd6c01e3350 0x7fd6c014b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:59.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.086+0000 7fd6c4dbb640 1 --2- 172.21.15.50:0/883346394 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd6c01e4b60 0x7fd6c01471c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:59.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.086+0000 7fd6bf7fe640 1 -- 172.21.15.50:0/883346394 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd6c01e4b60 msgr2=0x7fd6c01471c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:59.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.086+0000 7fd6bf7fe640 1 --2- 172.21.15.50:0/883346394 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd6c01e4b60 0x7fd6c01471c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:59.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.086+0000 7fd6bf7fe640 1 -- 172.21.15.50:0/883346394 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd6c01e3350 msgr2=0x7fd6c014b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:59.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.086+0000 7fd6bf7fe640 1 --2- 172.21.15.50:0/883346394 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd6c01e3350 0x7fd6c014b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:59.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.086+0000 7fd6bf7fe640 1 -- 172.21.15.50:0/883346394 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6c014ca60 con 0x7fd6c01e3730 2024-04-01T01:55:59.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.090+0000 7fd6bf7fe640 1 --2- 172.21.15.50:0/883346394 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6c01e3730 0x7fd6c0146c80 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd6a801caf0 tx=0x7fd6ac005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:59.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.090+0000 7fd6bcff9640 1 -- 172.21.15.50:0/883346394 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6a8007d60 con 0x7fd6c01e3730 2024-04-01T01:55:59.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.090+0000 7fd6bcff9640 1 -- 172.21.15.50:0/883346394 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6a80b2070 con 0x7fd6c01e3730 2024-04-01T01:55:59.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.090+0000 7fd6c681e640 1 -- 172.21.15.50:0/883346394 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6c014cd20 con 0x7fd6c01e3730 2024-04-01T01:55:59.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.090+0000 7fd6bcff9640 1 -- 172.21.15.50:0/883346394 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6a8001ca0 con 0x7fd6c01e3730 2024-04-01T01:55:59.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.090+0000 7fd6c681e640 1 -- 172.21.15.50:0/883346394 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6c0156580 con 0x7fd6c01e3730 2024-04-01T01:55:59.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.090+0000 7fd6c681e640 1 -- 172.21.15.50:0/883346394 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6c0068230 con 0x7fd6c01e3730 2024-04-01T01:55:59.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.090+0000 7fd6bcff9640 1 -- 172.21.15.50:0/883346394 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 87103+0+0 (secure 0 0 0) 0x7fd6a8004cf0 con 0x7fd6c01e3730 2024-04-01T01:55:59.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.090+0000 7fd6bcff9640 1 --2- 172.21.15.50:0/883346394 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fd6a0067420 0x7fd6a00698e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.090+0000 7fd6bcff9640 1 -- 172.21.15.50:0/883346394 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fd6a811edb0 con 0x7fd6c01e3730 2024-04-01T01:55:59.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.090+0000 7fd6bffff640 1 --2- 172.21.15.50:0/883346394 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fd6a0067420 0x7fd6a00698e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:59.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.090+0000 7fd6bffff640 1 --2- 172.21.15.50:0/883346394 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fd6a0067420 0x7fd6a00698e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd6b8009a00 tx=0x7fd6b8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:59.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.094+0000 7fd6bcff9640 1 -- 172.21.15.50:0/883346394 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+176632 (secure 0 0 0) 0x7fd6a80169d0 con 0x7fd6c01e3730 2024-04-01T01:55:59.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.250+0000 7fd6c681e640 1 -- 172.21.15.50:0/883346394 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd6c00712b0 con 0x7fd6c01e3730 2024-04-01T01:55:59.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.254+0000 7fd6bcff9640 1 -- 172.21.15.50:0/883346394 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16525 (secure 0 0 0) 0x7fd6a80ef590 con 0x7fd6c01e3730 2024-04-01T01:55:59.255 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-01T01:55:59.255 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":21,"fsid":"f67878a9-bc75-426b-962d-fa7bc2517f7d","created":"2024-04-01T01:55:31.562371+0000","modified":"2024-04-01T01:55:50.217570+0000","last_up_change":"2024-04-01T01:55:42.134502+0000","last_in_change":"2024-04-01T01:55:33.849789+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-01T01:55:42.134418+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-01T01:55:47.009880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-01T01:55:47.551516+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"81e8ca4f-bde8-419a-875f-73a1f4a641ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":4170468134},{"type":"v1","addr":"172.21.15.50:6825","nonce":4170468134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":4170468134},{"type":"v1","addr":"172.21.15.50:6827","nonce":4170468134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":4170468134},{"type":"v1","addr":"172.21.15.50:6831","nonce":4170468134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":4170468134},{"type":"v1","addr":"172.21.15.50:6829","nonce":4170468134}]},"public_addr":"172.21.15.50:6825/4170468134","cluster_addr":"172.21.15.50:6827/4170468134","heartbeat_back_addr":"172.21.15.50:6831/4170468134","heartbeat_front_addr":"172.21.15.50:6829/4170468134","state":["exists","up"]},{"osd":1,"uuid":"bd060ca0-7559-4d30-987c-62e59818431d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1794491326},{"type":"v1","addr":"172.21.15.50:6809","nonce":1794491326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1794491326},{"type":"v1","addr":"172.21.15.50:6811","nonce":1794491326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1794491326},{"type":"v1","addr":"172.21.15.50:6815","nonce":1794491326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1794491326},{"type":"v1","addr":"172.21.15.50:6813","nonce":1794491326}]},"public_addr":"172.21.15.50:6809/1794491326","cluster_addr":"172.21.15.50:6811/1794491326","heartbeat_back_addr":"172.21.15.50:6815/1794491326","heartbeat_front_addr":"172.21.15.50:6813/1794491326","state":["exists","up"]},{"osd":2,"uuid":"eac5d816-a281-4acd-aa7d-b96a8e0aa962","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":710247177},{"type":"v1","addr":"172.21.15.50:6801","nonce":710247177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":710247177},{"type":"v1","addr":"172.21.15.50:6803","nonce":710247177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":710247177},{"type":"v1","addr":"172.21.15.50:6807","nonce":710247177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":710247177},{"type":"v1","addr":"172.21.15.50:6805","nonce":710247177}]},"public_addr":"172.21.15.50:6801/710247177","cluster_addr":"172.21.15.50:6803/710247177","heartbeat_back_addr":"172.21.15.50:6807/710247177","heartbeat_front_addr":"172.21.15.50:6805/710247177","state":["exists","up"]},{"osd":3,"uuid":"12b23968-04a7-40b8-98c4-02b16ae28265","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":871680805},{"type":"v1","addr":"172.21.15.50:6817","nonce":871680805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":871680805},{"type":"v1","addr":"172.21.15.50:6819","nonce":871680805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":871680805},{"type":"v1","addr":"172.21.15.50:6823","nonce":871680805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":871680805},{"type":"v1","addr":"172.21.15.50:6821","nonce":871680805}]},"public_addr":"172.21.15.50:6817/871680805","cluster_addr":"172.21.15.50:6819/871680805","heartbeat_back_addr":"172.21.15.50:6823/871680805","heartbeat_front_addr":"172.21.15.50:6821/871680805","state":["exists","up"]},{"osd":4,"uuid":"0e6b1639-23b0-47d9-8b08-40c8ab6df818","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":1095319381},{"type":"v1","addr":"172.21.15.97:6801","nonce":1095319381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":1095319381},{"type":"v1","addr":"172.21.15.97:6803","nonce":1095319381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":1095319381},{"type":"v1","addr":"172.21.15.97:6807","nonce":1095319381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":1095319381},{"type":"v1","addr":"172.21.15.97:6805","nonce":1095319381}]},"public_addr":"172.21.15.97:6801/1095319381","cluster_addr":"172.21.15.97:6803/1095319381","heartbeat_back_addr":"172.21.15.97:6807/1095319381","heartbeat_front_addr":"172.21.15.97:6805/1095319381","state":["exists","up"]},{"osd":5,"uuid":"f0f876ef-0823-46e9-8fe4-9b7a64a94cee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":899031308},{"type":"v1","addr":"172.21.15.97:6817","nonce":899031308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":899031308},{"type":"v1","addr":"172.21.15.97:6819","nonce":899031308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":899031308},{"type":"v1","addr":"172.21.15.97:6823","nonce":899031308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":899031308},{"type":"v1","addr":"172.21.15.97:6821","nonce":899031308}]},"public_addr":"172.21.15.97:6817/899031308","cluster_addr":"172.21.15.97:6819/899031308","heartbeat_back_addr":"172.21.15.97:6823/899031308","heartbeat_front_addr":"172.21.15.97:6821/899031308","state":["exists","up"]},{"osd":6,"uuid":"d29a625e-83bf-40ef-a57e-618220b96b9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2224814961},{"type":"v1","addr":"172.21.15.97:6825","nonce":2224814961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2224814961},{"type":"v1","addr":"172.21.15.97:6827","nonce":2224814961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2224814961},{"type":"v1","addr":"172.21.15.97:6831","nonce":2224814961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2224814961},{"type":"v1","addr":"172.21.15.97:6829","nonce":2224814961}]},"public_addr":"172.21.15.97:6825/2224814961","cluster_addr":"172.21.15.97:6827/2224814961","heartbeat_back_addr":"172.21.15.97:6831/2224814961","heartbeat_front_addr":"172.21.15.97:6829/2224814961","state":["exists","up"]},{"osd":7,"uuid":"7bcfd8f1-7dc0-4013-af17-16da5a8d931d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":284968823},{"type":"v1","addr":"172.21.15.97:6809","nonce":284968823}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":284968823},{"type":"v1","addr":"172.21.15.97:6811","nonce":284968823}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6814","nonce":284968823},{"type":"v1","addr":"172.21.15.97:6815","nonce":284968823}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":284968823},{"type":"v1","addr":"172.21.15.97:6813","nonce":284968823}]},"public_addr":"172.21.15.97:6809/284968823","cluster_addr":"172.21.15.97:6811/284968823","heartbeat_back_addr":"172.21.15.97:6815/284968823","heartbeat_front_addr":"172.21.15.97:6813/284968823","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T01:55:39.369550+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T01:55:39.367285+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T01:55:39.458393+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T01:55:39.456179+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T01:55:39.463649+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T01:55:38.728924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T01:55:39.522411+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T01:55:39.432081+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-01T01:55:59.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.254+0000 7fd6c681e640 1 -- 172.21.15.50:0/883346394 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fd6a0067420 msgr2=0x7fd6a00698e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:59.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.254+0000 7fd6c681e640 1 --2- 172.21.15.50:0/883346394 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fd6a0067420 0x7fd6a00698e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd6b8009a00 tx=0x7fd6b8008040 comp rx=0 tx=0).stop 2024-04-01T01:55:59.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.254+0000 7fd6c681e640 1 -- 172.21.15.50:0/883346394 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6c01e3730 msgr2=0x7fd6c0146c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:59.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.254+0000 7fd6c681e640 1 --2- 172.21.15.50:0/883346394 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6c01e3730 0x7fd6c0146c80 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd6a801caf0 tx=0x7fd6ac005840 comp rx=0 tx=0).stop 2024-04-01T01:55:59.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.254+0000 7fd6c681e640 1 -- 172.21.15.50:0/883346394 shutdown_connections 2024-04-01T01:55:59.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.254+0000 7fd6c681e640 1 --2- 172.21.15.50:0/883346394 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fd6a0067420 0x7fd6a00698e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:59.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.254+0000 7fd6c681e640 1 --2- 172.21.15.50:0/883346394 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd6c01e4b60 0x7fd6c01471c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:59.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.254+0000 7fd6c681e640 1 --2- 172.21.15.50:0/883346394 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6c01e3730 0x7fd6c0146c80 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:59.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.254+0000 7fd6c681e640 1 --2- 172.21.15.50:0/883346394 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd6c01e3350 0x7fd6c014b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:59.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.254+0000 7fd6c681e640 1 -- 172.21.15.50:0/883346394 >> 172.21.15.50:0/883346394 conn(0x7fd6c0067560 msgr2=0x7fd6c00c7e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:55:59.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.254+0000 7fd6c681e640 1 -- 172.21.15.50:0/883346394 shutdown_connections 2024-04-01T01:55:59.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.254+0000 7fd6c681e640 1 -- 172.21.15.50:0/883346394 wait complete. 2024-04-01T01:55:59.273 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-01T01:55:59.274 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-01T01:55:59.274 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-01T01:55:59.274 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-01T01:55:59.275 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-04-01T01:55:59.275 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-04-01T01:55:59.276 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-04-01T01:55:59.276 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-04-01T01:55:59.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.454+0000 7f7c3739d640 1 Processor -- start 2024-04-01T01:55:59.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.454+0000 7f7c3739d640 1 -- start start 2024-04-01T01:55:59.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.454+0000 7f04455b7640 1 Processor -- start 2024-04-01T01:55:59.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.454+0000 7f1429f47640 1 Processor -- start 2024-04-01T01:55:59.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.454+0000 7f7c3739d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7c300c6e00 0x7f7c300c5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.454+0000 7f1429f47640 1 -- start start 2024-04-01T01:55:59.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.454+0000 7f164f52c640 1 Processor -- start 2024-04-01T01:55:59.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.454+0000 7f7c3739d640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c30161b60 con 0x7f7c300c64f0 2024-04-01T01:55:59.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.454+0000 7f7c3739d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c30161e40 con 0x7f7c30158360 2024-04-01T01:55:59.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.454+0000 7f7c3739d640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f7c301626e0 con 0x7f7c300c6e00 2024-04-01T01:55:59.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.454+0000 7f164f52c640 1 -- start start 2024-04-01T01:55:59.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.454+0000 7f7fc8b77640 1 Processor -- start 2024-04-01T01:55:59.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.454+0000 7f7fc8b77640 1 -- start start 2024-04-01T01:55:59.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.454+0000 7f8a53521640 1 Processor -- start 2024-04-01T01:55:59.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.454+0000 7f1429f47640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f14240c7e10 0x7f1424158290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.454+0000 7f1429f47640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f14240c76f0 0x7f14241587d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.454+0000 7f1429f47640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14240b31c0 con 0x7f14240b10d0 2024-04-01T01:55:59.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.454+0000 7f1429f47640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f142415bbd0 con 0x7f14240c7e10 2024-04-01T01:55:59.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.454+0000 7f1429f47640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f142415c100 con 0x7f14240c76f0 2024-04-01T01:55:59.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.458+0000 7f164f52c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f16480c5fb0 0x7f16480c63d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.458+0000 7f164f52c640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16480c8790 con 0x7f16480c7c10 2024-04-01T01:55:59.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.458+0000 7f164f52c640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f164815a150 con 0x7f1648153fc0 2024-04-01T01:55:59.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.458+0000 7f164f52c640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f1648071980 con 0x7f16480c5fb0 2024-04-01T01:55:59.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.458+0000 7f7c36b9c640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f7c300c64f0 0x7f7c3015e810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44560/0 (socket says 172.21.15.50:44560) 2024-04-01T01:55:59.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.458+0000 7f7c36b9c640 1 -- 172.21.15.50:0/1957339134 learned_addr learned my addr 172.21.15.50:0/1957339134 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-04-01T01:55:59.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.454+0000 7f04455b7640 1 -- start start 2024-04-01T01:55:59.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.458+0000 7f7c35b9a640 1 --2- 172.21.15.50:0/1957339134 >> v2:172.21.15.50:3300/0 conn(0x7f7c300c6e00 0x7f7c300c5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:59.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.458+0000 7f164e52a640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f1648153fc0 0x7f164815d9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.50:50348/0 (socket says 172.21.15.50:50348) 2024-04-01T01:55:59.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.458+0000 7f164e52a640 1 -- 172.21.15.50:0/440522808 learned_addr learned my addr 172.21.15.50:0/440522808 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-04-01T01:55:59.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.458+0000 7f1423fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f14240c7e10 0x7f1424158290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:59.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.458+0000 7f1423fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f14240c7e10 0x7f1424158290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50506/0 (socket says 172.21.15.50:50506) 2024-04-01T01:55:59.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.458+0000 7f1423fff640 1 -- 172.21.15.50:0/1455139930 learned_addr learned my addr 172.21.15.50:0/1455139930 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T01:55:59.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.458+0000 7f164dd29640 1 --2- 172.21.15.50:0/440522808 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f16480c5fb0 0x7f16480c63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:59.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.458+0000 7f7fc8b77640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7fc40c6e00 0x7f7fc40c5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.458+0000 7f7fc8b77640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f7fc40c64f0 0x7f7fc415e810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.458+0000 7f7fc8b77640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7fc4161b60 con 0x7f7fc4158360 2024-04-01T01:55:59.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.458+0000 7f7fc8b77640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f7fc41626e0 con 0x7f7fc40c64f0 2024-04-01T01:55:59.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.458+0000 7f7fc8b77640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f7fc4161e40 con 0x7f7fc40c6e00 2024-04-01T01:55:59.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.458+0000 7f1429746640 1 --2- 172.21.15.50:0/1455139930 >> v2:172.21.15.97:3300/0 conn(0x7f14240c76f0 0x7f14241587d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:59.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.458+0000 7f7c35b9a640 1 -- 172.21.15.50:0/1957339134 >> v1:172.21.15.97:6789/0 conn(0x7f7c30158360 legacy=0x7f7c300c8270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:59.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.458+0000 7f7c35b9a640 1 -- 172.21.15.50:0/1957339134 >> v1:172.21.15.50:6789/0 conn(0x7f7c300c64f0 legacy=0x7f7c3015e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:59.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.458+0000 7f7c35b9a640 1 -- 172.21.15.50:0/1957339134 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c30162120 con 0x7f7c300c6e00 2024-04-01T01:55:59.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.454+0000 7f8a53521640 1 -- start start 2024-04-01T01:55:59.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.458+0000 7f8a53521640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8a440d54d0 0x7f8a440459c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.458+0000 7f8a53521640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8a44047570 0x7f8a44006b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.458+0000 7f8a53521640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a44007070 con 0x7f8a440db160 2024-04-01T01:55:59.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.458+0000 7f8a53521640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f8a4404c300 con 0x7f8a440d54d0 2024-04-01T01:55:59.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.458+0000 7f8a53521640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f8a440470e0 con 0x7f8a44047570 2024-04-01T01:55:59.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.458+0000 7f7fc37fe640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f7fc4158360 0x7f7fc40c8270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.50:50356/0 (socket says 172.21.15.50:50356) 2024-04-01T01:55:59.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.458+0000 7f7fc37fe640 1 -- 172.21.15.50:0/4133875671 learned_addr learned my addr 172.21.15.50:0/4133875671 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-04-01T01:55:59.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.458+0000 7f164dd29640 1 -- 172.21.15.50:0/440522808 >> v1:172.21.15.97:6789/0 conn(0x7f1648153fc0 legacy=0x7f164815d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:59.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.458+0000 7f164d528640 1 -- 172.21.15.50:0/440522808 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1607828435 0 0) 0x7f164815a150 con 0x7f1648153fc0 2024-04-01T01:55:59.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.458+0000 7f10bbb4f640 1 Processor -- start 2024-04-01T01:55:59.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.458+0000 7f14237fe640 1 -- 172.21.15.50:0/1455139930 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1217686624 0 0) 0x7f14240b31c0 con 0x7f14240b10d0 2024-04-01T01:55:59.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.458+0000 7f14237fe640 1 -- 172.21.15.50:0/1455139930 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f140c003530 con 0x7f14240b10d0 2024-04-01T01:55:59.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.458+0000 7f164dd29640 1 -- 172.21.15.50:0/440522808 >> v1:172.21.15.50:6789/0 conn(0x7f16480c7c10 legacy=0x7f16480c8080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:59.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.458+0000 7f164dd29640 1 -- 172.21.15.50:0/440522808 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f164815a410 con 0x7f16480c5fb0 2024-04-01T01:55:59.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.458+0000 7f7fc3fff640 1 --2- 172.21.15.50:0/4133875671 >> v2:172.21.15.97:3300/0 conn(0x7f7fc40c64f0 0x7f7fc415e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:59.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.458+0000 7f7fbbfff640 1 --2- 172.21.15.50:0/4133875671 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7fc40c6e00 0x7f7fc40c5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:59.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.458+0000 7f14237fe640 1 -- 172.21.15.50:0/1455139930 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3854148611 0 0) 0x7f140c003530 con 0x7f14240b10d0 2024-04-01T01:55:59.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.458+0000 7f1423fff640 1 -- 172.21.15.50:0/1455139930 >> v2:172.21.15.97:3300/0 conn(0x7f14240c76f0 msgr2=0x7f14241587d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:55:59.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.458+0000 7f1423fff640 1 --2- 172.21.15.50:0/1455139930 >> v2:172.21.15.97:3300/0 conn(0x7f14240c76f0 0x7f14241587d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:59.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.458+0000 7f1423fff640 1 -- 172.21.15.50:0/1455139930 >> v1:172.21.15.50:6789/0 conn(0x7f14240b10d0 legacy=0x7f14240b14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:59.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.458+0000 7f8a5251f640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8a440d54d0 0x7f8a440459c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:59.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.458+0000 7f8a5251f640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8a440d54d0 0x7f8a440459c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50520/0 (socket says 172.21.15.50:50520) 2024-04-01T01:55:59.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.458+0000 7f8a5251f640 1 -- 172.21.15.50:0/3662131505 learned_addr learned my addr 172.21.15.50:0/3662131505 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T01:55:59.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.458+0000 7f8a51d1e640 1 --2- 172.21.15.50:0/3662131505 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8a44047570 0x7f8a44006b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:59.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.458+0000 7f10bbb4f640 1 -- start start 2024-04-01T01:55:59.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.458+0000 7f1423fff640 1 -- 172.21.15.50:0/1455139930 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14240b3430 con 0x7f14240c7e10 2024-04-01T01:55:59.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.458+0000 7f7fc2ffd640 1 -- 172.21.15.50:0/4133875671 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3442452867 0 0) 0x7f7fc4161b60 con 0x7f7fc4158360 2024-04-01T01:55:59.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.458+0000 7f7fc2ffd640 1 -- 172.21.15.50:0/4133875671 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7fb0003530 con 0x7f7fc4158360 2024-04-01T01:55:59.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.458+0000 7f04455b7640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f04380dd2c0 0x7f04380e66f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.458+0000 7f04455b7640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f04380e6c30 0x7f043804ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.458+0000 7f04455b7640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f043804c690 con 0x7f04380e71f0 2024-04-01T01:55:59.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.458+0000 7f04455b7640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f04380454e0 con 0x7f04380e6c30 2024-04-01T01:55:59.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.458+0000 7f04455b7640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f04380457c0 con 0x7f04380dd2c0 2024-04-01T01:55:59.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.458+0000 7f8a51d1e640 1 -- 172.21.15.50:0/3662131505 >> v2:172.21.15.50:3300/0 conn(0x7f8a440d54d0 msgr2=0x7f8a440459c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:55:59.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.458+0000 7f8a51d1e640 1 --2- 172.21.15.50:0/3662131505 >> v2:172.21.15.50:3300/0 conn(0x7f8a440d54d0 0x7f8a440459c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:59.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.458+0000 7f8a51d1e640 1 -- 172.21.15.50:0/3662131505 >> v1:172.21.15.97:6789/0 conn(0x7f8a440db160 legacy=0x7f8a440db5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:55:59.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.458+0000 7f8a51d1e640 1 -- 172.21.15.50:0/3662131505 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a440d58b0 con 0x7f8a44047570 2024-04-01T01:55:59.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.458+0000 7f043f7fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f04380e71f0 0x7f04380462a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44578/0 (socket says 172.21.15.50:44578) 2024-04-01T01:55:59.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.458+0000 7f043f7fe640 1 -- 172.21.15.50:0/2930566826 learned_addr learned my addr 172.21.15.50:0/2930566826 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-04-01T01:55:59.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.458+0000 7f043effd640 1 -- 172.21.15.50:0/2930566826 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 149334894 0 0) 0x7f043804c690 con 0x7f04380e71f0 2024-04-01T01:55:59.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.458+0000 7f043ffff640 1 --2- 172.21.15.50:0/2930566826 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f04380dd2c0 0x7f04380e66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:59.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.458+0000 7f043effd640 1 -- 172.21.15.50:0/2930566826 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0430003530 con 0x7f04380e71f0 2024-04-01T01:55:59.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.458+0000 7f7fc2ffd640 1 -- 172.21.15.50:0/4133875671 <== mon.1 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2530859510 0 0) 0x7f7fb0003530 con 0x7f7fc4158360 2024-04-01T01:55:59.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.458+0000 7f7fc2ffd640 1 -- 172.21.15.50:0/4133875671 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7fc40c6e00 msgr2=0x7f7fc40c5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:55:59.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.458+0000 7f7fc2ffd640 1 --2- 172.21.15.50:0/4133875671 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7fc40c6e00 0x7f7fc40c5fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:59.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.458+0000 7f7fc2ffd640 1 -- 172.21.15.50:0/4133875671 >> v2:172.21.15.97:3300/0 conn(0x7f7fc40c64f0 msgr2=0x7f7fc415e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:55:59.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.458+0000 7f7fc2ffd640 1 --2- 172.21.15.50:0/4133875671 >> v2:172.21.15.97:3300/0 conn(0x7f7fc40c64f0 0x7f7fc415e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:59.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.458+0000 7f7fc2ffd640 1 -- 172.21.15.50:0/4133875671 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fc4162120 con 0x7f7fc4158360 2024-04-01T01:55:59.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.458+0000 7f7fc2ffd640 1 -- 172.21.15.50:0/4133875671 <== mon.1 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2779672543 0 0) 0x7f7fb4001680 con 0x7f7fc4158360 2024-04-01T01:55:59.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.458+0000 7f7fc2ffd640 1 -- 172.21.15.50:0/4133875671 >> v1:172.21.15.97:6789/0 conn(0x7f7fc4158360 legacy=0x7f7fc40c8270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:59.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.458+0000 7f7fc2ffd640 1 --2- 172.21.15.50:0/4133875671 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7fb0003a30 0x7f7fb0003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.458+0000 7f7fc2ffd640 1 --2- 172.21.15.50:0/4133875671 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7fb0004810 0x7f7fb0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.458+0000 7f7fc2ffd640 1 --2- 172.21.15.50:0/4133875671 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7fb00051d0 0x7f7fb000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.458+0000 7f7fc2ffd640 1 -- 172.21.15.50:0/4133875671 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7fc41626e0 con 0x7f7fb00051d0 2024-04-01T01:55:59.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.458+0000 7f7fc2ffd640 1 -- 172.21.15.50:0/4133875671 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f7fc4161e40 con 0x7f7fb0004810 2024-04-01T01:55:59.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.458+0000 7f7fc2ffd640 1 -- 172.21.15.50:0/4133875671 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f7fb000bf10 con 0x7f7fb0003a30 2024-04-01T01:55:59.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.458+0000 7f043effd640 1 -- 172.21.15.50:0/2930566826 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2067536989 0 0) 0x7f0430003530 con 0x7f04380e71f0 2024-04-01T01:55:59.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.458+0000 7f043effd640 1 -- 172.21.15.50:0/2930566826 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f04380dd2c0 msgr2=0x7f04380e66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:55:59.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.458+0000 7f043effd640 1 --2- 172.21.15.50:0/2930566826 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f04380dd2c0 0x7f04380e66f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:59.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.458+0000 7f043effd640 1 -- 172.21.15.50:0/2930566826 >> v2:172.21.15.97:3300/0 conn(0x7f04380e6c30 msgr2=0x7f043804ba70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-01T01:55:59.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.458+0000 7f043effd640 1 --2- 172.21.15.50:0/2930566826 >> v2:172.21.15.97:3300/0 conn(0x7f04380e6c30 0x7f043804ba70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:59.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.458+0000 7f043effd640 1 -- 172.21.15.50:0/2930566826 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0438045aa0 con 0x7f04380e71f0 2024-04-01T01:55:59.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.458+0000 7f043effd640 1 -- 172.21.15.50:0/2930566826 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2779672543 0 0) 0x7f042c001680 con 0x7f04380e71f0 2024-04-01T01:55:59.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.458+0000 7f043effd640 1 -- 172.21.15.50:0/2930566826 >> v1:172.21.15.50:6789/0 conn(0x7f04380e71f0 legacy=0x7f04380462a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:59.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.458+0000 7f043effd640 1 --2- 172.21.15.50:0/2930566826 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04300039c0 0x7f0430003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.458+0000 7f043effd640 1 --2- 172.21.15.50:0/2930566826 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0430004810 0x7f0430004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.458+0000 7f043effd640 1 --2- 172.21.15.50:0/2930566826 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f04300051d0 0x7f043000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.458+0000 7f043effd640 1 -- 172.21.15.50:0/2930566826 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f04380454e0 con 0x7f04300039c0 2024-04-01T01:55:59.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.458+0000 7f043effd640 1 -- 172.21.15.50:0/2930566826 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f04380457c0 con 0x7f04300051d0 2024-04-01T01:55:59.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.458+0000 7f043effd640 1 -- 172.21.15.50:0/2930566826 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f043000c100 con 0x7f0430004810 2024-04-01T01:55:59.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.458+0000 7f043ffff640 1 --2- 172.21.15.50:0/2930566826 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f04380dd2c0 0x7f04380e66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T01:55:59.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.458+0000 7f7fc3fff640 1 --2- 172.21.15.50:0/4133875671 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7fb00051d0 0x7f7fb000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:59.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.458+0000 7f043ffff640 1 --2- 172.21.15.50:0/2930566826 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04300039c0 0x7f0430003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:59.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.458+0000 7f043f7fe640 1 --2- 172.21.15.50:0/2930566826 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0430004810 0x7f0430004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:59.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.462+0000 7f043f7fe640 1 -- 172.21.15.50:0/2930566826 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f04300051d0 msgr2=0x7f043000b9d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-01T01:55:59.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.462+0000 7f043f7fe640 1 --2- 172.21.15.50:0/2930566826 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f04300051d0 0x7f043000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:59.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.462+0000 7f043f7fe640 1 -- 172.21.15.50:0/2930566826 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04300039c0 msgr2=0x7f0430003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:55:59.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.462+0000 7f043f7fe640 1 --2- 172.21.15.50:0/2930566826 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04300039c0 0x7f0430003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:59.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.462+0000 7f043f7fe640 1 -- 172.21.15.50:0/2930566826 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0430003530 con 0x7f0430004810 2024-04-01T01:55:59.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.458+0000 7f7fc37fe640 1 --2- 172.21.15.50:0/4133875671 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7fb0003a30 0x7f7fb0003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:59.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.458+0000 7f10bbb4f640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f10ac046180 0x7f10ac0df600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.458+0000 7f10b90ea640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f10ac009120 0x7f10ac0deef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44580/0 (socket says 172.21.15.50:44580) 2024-04-01T01:55:59.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.458+0000 7f10bbb4f640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10ac051fc0 con 0x7f10ac009120 2024-04-01T01:55:59.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.458+0000 7f10b90ea640 1 -- 172.21.15.50:0/4116940321 learned_addr learned my addr 172.21.15.50:0/4116940321 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-04-01T01:55:59.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.458+0000 7f10bbb4f640 1 -- 172.21.15.50:0/4116940321 --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10ac007b20 con 0x7f10ac0d5c30 2024-04-01T01:55:59.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.458+0000 7f10bbb4f640 1 -- 172.21.15.50:0/4116940321 --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f10ac0465b0 con 0x7f10ac046180 2024-04-01T01:55:59.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.458+0000 7f10ba0ec640 1 --2- 172.21.15.50:0/4116940321 >> v2:172.21.15.50:3300/0 conn(0x7f10ac046180 0x7f10ac0df600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:59.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.462+0000 7f10b88e9640 1 -- 172.21.15.50:0/4116940321 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 863200015 0 0) 0x7f10ac051fc0 con 0x7f10ac009120 2024-04-01T01:55:59.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.462+0000 7f10b88e9640 1 -- 172.21.15.50:0/4116940321 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f10a0003530 con 0x7f10ac009120 2024-04-01T01:55:59.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.462+0000 7f10b88e9640 1 -- 172.21.15.50:0/4116940321 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3804890079 0 0) 0x7f10a0003530 con 0x7f10ac009120 2024-04-01T01:55:59.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.462+0000 7f164dd29640 1 --2- 172.21.15.50:0/440522808 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f16480c5fb0 0x7f16480c63d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f16380097f0 tx=0x7f163801c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a698fb8470f039e1 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:59.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.462+0000 7f10b88e9640 1 -- 172.21.15.50:0/4116940321 >> v2:172.21.15.50:3300/0 conn(0x7f10ac046180 msgr2=0x7f10ac0df600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:55:59.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.462+0000 7f10b88e9640 1 --2- 172.21.15.50:0/4116940321 >> v2:172.21.15.50:3300/0 conn(0x7f10ac046180 0x7f10ac0df600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:59.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.462+0000 7f10b88e9640 1 -- 172.21.15.50:0/4116940321 >> v1:172.21.15.97:6789/0 conn(0x7f10ac0d5c30 legacy=0x7f10ac04bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:59.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.462+0000 7f10b88e9640 1 -- 172.21.15.50:0/4116940321 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10ac007da0 con 0x7f10ac009120 2024-04-01T01:55:59.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.462+0000 7f164d528640 1 -- 172.21.15.50:0/440522808 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16380b0070 con 0x7f16480c5fb0 2024-04-01T01:55:59.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.462+0000 7f10b88e9640 1 -- 172.21.15.50:0/4116940321 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2779672543 0 0) 0x7f10b404fd10 con 0x7f10ac009120 2024-04-01T01:55:59.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.462+0000 7f164d528640 1 -- 172.21.15.50:0/440522808 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16380ab600 con 0x7f16480c5fb0 2024-04-01T01:55:59.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.462+0000 7f164d528640 1 -- 172.21.15.50:0/440522808 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16380ab9d0 con 0x7f16480c5fb0 2024-04-01T01:55:59.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.462+0000 7f10b88e9640 1 -- 172.21.15.50:0/4116940321 >> v1:172.21.15.50:6789/0 conn(0x7f10ac009120 legacy=0x7f10ac0deef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:59.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.462+0000 7f10b88e9640 1 --2- 172.21.15.50:0/4116940321 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10a00039c0 0x7f10a0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.462+0000 7f10b88e9640 1 --2- 172.21.15.50:0/4116940321 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f10a0004360 0x7f10a0004830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.462+0000 7f10b88e9640 1 --2- 172.21.15.50:0/4116940321 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f10a0005030 0x7f10a00141e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.462+0000 7f10b88e9640 1 -- 172.21.15.50:0/4116940321 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f10ac0465b0 con 0x7f10a00039c0 2024-04-01T01:55:59.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.462+0000 7f10b88e9640 1 -- 172.21.15.50:0/4116940321 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f10a0014780 con 0x7f10a0004360 2024-04-01T01:55:59.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.462+0000 7f10b88e9640 1 -- 172.21.15.50:0/4116940321 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f10a0014980 con 0x7f10a0005030 2024-04-01T01:55:59.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.462+0000 7f10ba0ec640 1 --2- 172.21.15.50:0/4116940321 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f10a0005030 0x7f10a00141e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:59.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.462+0000 7f10b90ea640 1 --2- 172.21.15.50:0/4116940321 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f10a0004360 0x7f10a0004830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:59.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.462+0000 7f164f52c640 1 -- 172.21.15.50:0/440522808 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f16480c5fb0 msgr2=0x7f16480c63d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:59.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.462+0000 7f10ba0ec640 1 -- 172.21.15.50:0/4116940321 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f10a0004360 msgr2=0x7f10a0004830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:55:59.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.462+0000 7f164f52c640 1 --2- 172.21.15.50:0/440522808 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f16480c5fb0 0x7f16480c63d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f16380097f0 tx=0x7f163801c4e0 comp rx=0 tx=0).stop 2024-04-01T01:55:59.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.462+0000 7f10ba0ec640 1 --2- 172.21.15.50:0/4116940321 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f10a0004360 0x7f10a0004830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:59.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.462+0000 7f10ba0ec640 1 -- 172.21.15.50:0/4116940321 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10a00039c0 msgr2=0x7f10a0003de0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-01T01:55:59.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.462+0000 7f10ba0ec640 1 --2- 172.21.15.50:0/4116940321 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10a00039c0 0x7f10a0003de0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:59.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.462+0000 7f10ba0ec640 1 -- 172.21.15.50:0/4116940321 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10a0003530 con 0x7f10a0005030 2024-04-01T01:55:59.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.462+0000 7f8a51d1e640 1 --2- 172.21.15.50:0/3662131505 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8a44047570 0x7f8a44006b30 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f8a480097c0 tx=0x7f8a4801c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac9227a6ac8c67d5 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:59.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.462+0000 7f10b90ea640 1 --2- 172.21.15.50:0/4116940321 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f10a0004360 0x7f10a0004830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T01:55:59.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.462+0000 7f043ffff640 1 --2- 172.21.15.50:0/2930566826 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04300039c0 0x7f0430003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T01:55:59.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.462+0000 7f164f52c640 1 -- 172.21.15.50:0/440522808 shutdown_connections 2024-04-01T01:55:59.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.462+0000 7f164f52c640 1 --2- 172.21.15.50:0/440522808 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f16480c5fb0 0x7f16480c63d0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:59.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.462+0000 7f164f52c640 1 -- 172.21.15.50:0/440522808 >> 172.21.15.50:0/440522808 conn(0x7f164806b220 msgr2=0x7f164806b630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:55:59.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.462+0000 7f7fc3fff640 1 -- 172.21.15.50:0/4133875671 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7fb0003a30 msgr2=0x7f7fb0003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:55:59.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.462+0000 7f7fc3fff640 1 --2- 172.21.15.50:0/4133875671 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7fb0003a30 0x7f7fb0003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:59.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.462+0000 7f7fc3fff640 1 -- 172.21.15.50:0/4133875671 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7fb0004810 msgr2=0x7f7fb0004c90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-01T01:55:59.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.462+0000 7f7fc3fff640 1 --2- 172.21.15.50:0/4133875671 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7fb0004810 0x7f7fb0004c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:59.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.462+0000 7f7fc3fff640 1 -- 172.21.15.50:0/4133875671 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fc4162120 con 0x7f7fb00051d0 2024-04-01T01:55:59.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.462+0000 7f7c35b9a640 1 --2- 172.21.15.50:0/1957339134 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c300c6e00 0x7f7c300c5fb0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7c28009d90 tx=0x7f7c2801c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec26b49d11a050c0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:59.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.462+0000 7f164f52c640 1 -- 172.21.15.50:0/440522808 shutdown_connections 2024-04-01T01:55:59.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.462+0000 7f1423fff640 1 --2- 172.21.15.50:0/1455139930 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14240c7e10 0x7f1424158290 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1424069730 tx=0x7f141c01c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29e3db5bb51de937 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:59.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.462+0000 7f164f52c640 1 -- 172.21.15.50:0/440522808 wait complete. 2024-04-01T01:55:59.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.462+0000 7f7c35399640 1 -- 172.21.15.50:0/1957339134 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c280b2070 con 0x7f7c300c6e00 2024-04-01T01:55:59.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.462+0000 7f7c35399640 1 -- 172.21.15.50:0/1957339134 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c280a5940 con 0x7f7c300c6e00 2024-04-01T01:55:59.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.462+0000 7f7c35399640 1 -- 172.21.15.50:0/1957339134 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c280a5d10 con 0x7f7c300c6e00 2024-04-01T01:55:59.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.462+0000 7f7fc3fff640 1 --2- 172.21.15.50:0/4133875671 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7fb00051d0 0x7f7fb000b9d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc009fd0 tx=0x7f7fbc01cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50f45d8e72845054 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:59.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.462+0000 7f14237fe640 1 -- 172.21.15.50:0/1455139930 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1414001680 con 0x7f14240c7e10 2024-04-01T01:55:59.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.462+0000 7f14237fe640 1 -- 172.21.15.50:0/1455139930 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f141c0090d0 con 0x7f14240c7e10 2024-04-01T01:55:59.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.462+0000 7f14237fe640 1 -- 172.21.15.50:0/1455139930 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f141c0a5960 con 0x7f14240c7e10 2024-04-01T01:55:59.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.462+0000 7f7fc2ffd640 1 -- 172.21.15.50:0/4133875671 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fbc0b2070 con 0x7f7fb00051d0 2024-04-01T01:55:59.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.462+0000 7f7fc2ffd640 1 -- 172.21.15.50:0/4133875671 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fbc0a5d50 con 0x7f7fb00051d0 2024-04-01T01:55:59.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.462+0000 7f7fc2ffd640 1 -- 172.21.15.50:0/4133875671 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fbc009bf0 con 0x7f7fb00051d0 2024-04-01T01:55:59.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.462+0000 7f043f7fe640 1 --2- 172.21.15.50:0/2930566826 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0430004810 0x7f0430004c90 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f042c00c160 tx=0x7f042c01f350 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d6074946189d6c43 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:59.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.466+0000 7f043effd640 1 -- 172.21.15.50:0/2930566826 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f042c007cb0 con 0x7f0430004810 2024-04-01T01:55:59.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.466+0000 7f043effd640 1 -- 172.21.15.50:0/2930566826 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f042c005ae0 con 0x7f0430004810 2024-04-01T01:55:59.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.466+0000 7f043effd640 1 -- 172.21.15.50:0/2930566826 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f042c007070 con 0x7f0430004810 2024-04-01T01:55:59.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.466+0000 7f7c3739d640 1 -- 172.21.15.50:0/1957339134 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c300c6e00 msgr2=0x7f7c300c5fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:59.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.466+0000 7f7c3739d640 1 --2- 172.21.15.50:0/1957339134 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c300c6e00 0x7f7c300c5fb0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7c28009d90 tx=0x7f7c2801c970 comp rx=0 tx=0).stop 2024-04-01T01:55:59.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.466+0000 7f7c3739d640 1 -- 172.21.15.50:0/1957339134 shutdown_connections 2024-04-01T01:55:59.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.466+0000 7f7c3739d640 1 --2- 172.21.15.50:0/1957339134 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c300c6e00 0x7f7c300c5fb0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:59.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.466+0000 7f7c3739d640 1 -- 172.21.15.50:0/1957339134 >> 172.21.15.50:0/1957339134 conn(0x7f7c3006b220 msgr2=0x7f7c3006b630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:55:59.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.466+0000 7f164f52c640 1 Processor -- start 2024-04-01T01:55:59.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.462+0000 7f8a5151d640 1 -- 172.21.15.50:0/3662131505 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a480b0070 con 0x7f8a44047570 2024-04-01T01:55:59.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.462+0000 7f8a5151d640 1 -- 172.21.15.50:0/3662131505 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a480ab600 con 0x7f8a44047570 2024-04-01T01:55:59.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.462+0000 7f8a5151d640 1 -- 172.21.15.50:0/3662131505 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a480ab9d0 con 0x7f8a44047570 2024-04-01T01:55:59.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.462+0000 7f8a53521640 1 -- 172.21.15.50:0/3662131505 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8a44047570 msgr2=0x7f8a44006b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:59.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.462+0000 7f8a53521640 1 --2- 172.21.15.50:0/3662131505 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8a44047570 0x7f8a44006b30 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f8a480097c0 tx=0x7f8a4801c3f0 comp rx=0 tx=0).stop 2024-04-01T01:55:59.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.466+0000 7f164f52c640 1 -- start start 2024-04-01T01:55:59.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.466+0000 7f10ba0ec640 1 -- 172.21.15.50:0/4116940321 reap_dead start 2024-04-01T01:55:59.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.466+0000 7f10ba0ec640 1 --2- 172.21.15.50:0/4116940321 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f10a0005030 0x7f10a00141e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f10b0009ac0 tx=0x7f10b001cb20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe43726f8311f9ad server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:59.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.466+0000 7f7fc8b77640 1 -- 172.21.15.50:0/4133875671 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7fb00051d0 msgr2=0x7f7fb000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:59.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.466+0000 7f7fc8b77640 1 --2- 172.21.15.50:0/4133875671 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7fb00051d0 0x7f7fb000b9d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc009fd0 tx=0x7f7fbc01cc40 comp rx=0 tx=0).stop 2024-04-01T01:55:59.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.466+0000 7f7fc3fff640 1 -- 172.21.15.50:0/4133875671 reap_dead start 2024-04-01T01:55:59.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.466+0000 7f1429f47640 1 -- 172.21.15.50:0/1455139930 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14240c7e10 msgr2=0x7f1424158290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:59.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.466+0000 7f1429f47640 1 --2- 172.21.15.50:0/1455139930 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14240c7e10 0x7f1424158290 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1424069730 tx=0x7f141c01c8e0 comp rx=0 tx=0).stop 2024-04-01T01:55:59.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.466+0000 7f10b88e9640 1 -- 172.21.15.50:0/4116940321 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10b4068230 con 0x7f10a0005030 2024-04-01T01:55:59.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.466+0000 7f7c3739d640 1 -- 172.21.15.50:0/1957339134 shutdown_connections 2024-04-01T01:55:59.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.466+0000 7f8a53521640 1 -- 172.21.15.50:0/3662131505 shutdown_connections 2024-04-01T01:55:59.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.466+0000 7f8a53521640 1 --2- 172.21.15.50:0/3662131505 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8a44047570 0x7f8a44006b30 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:59.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.466+0000 7f8a53521640 1 --2- 172.21.15.50:0/3662131505 >> v2:172.21.15.50:3300/0 conn(0x7f8a440d54d0 0x7f8a440459c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:59.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.466+0000 7f8a53521640 1 -- 172.21.15.50:0/3662131505 >> 172.21.15.50:0/3662131505 conn(0x7f8a44050a20 msgr2=0x7f8a44050e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:55:59.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.466+0000 7f7fc8b77640 1 -- 172.21.15.50:0/4133875671 shutdown_connections 2024-04-01T01:55:59.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.466+0000 7f7fc8b77640 1 -- 172.21.15.50:0/4133875671 >> 172.21.15.50:0/4133875671 conn(0x7f7fc406b220 msgr2=0x7f7fc406b630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:55:59.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.466+0000 7f04455b7640 1 -- 172.21.15.50:0/2930566826 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0430004810 msgr2=0x7f0430004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:59.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.466+0000 7f04455b7640 1 --2- 172.21.15.50:0/2930566826 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0430004810 0x7f0430004c90 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f042c00c160 tx=0x7f042c01f350 comp rx=0 tx=0).stop 2024-04-01T01:55:59.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.466+0000 7f0444db6640 1 -- 172.21.15.50:0/2930566826 reap_dead start 2024-04-01T01:55:59.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.466+0000 7f1429f47640 1 -- 172.21.15.50:0/1455139930 shutdown_connections 2024-04-01T01:55:59.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.466+0000 7f1429f47640 1 --2- 172.21.15.50:0/1455139930 >> v2:172.21.15.97:3300/0 conn(0x7f14240c76f0 0x7f14241587d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:59.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.466+0000 7f1429f47640 1 --2- 172.21.15.50:0/1455139930 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14240c7e10 0x7f1424158290 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:59.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.466+0000 7f1429f47640 1 -- 172.21.15.50:0/1455139930 >> 172.21.15.50:0/1455139930 conn(0x7f1424070ef0 msgr2=0x7f1424071300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:55:59.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.466+0000 7f1429f47640 1 -- 172.21.15.50:0/1455139930 shutdown_connections 2024-04-01T01:55:59.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.466+0000 7f1429f47640 1 -- 172.21.15.50:0/1455139930 wait complete. 2024-04-01T01:55:59.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.466+0000 7f7fc8b77640 1 -- 172.21.15.50:0/4133875671 shutdown_connections 2024-04-01T01:55:59.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.466+0000 7f8a53521640 1 -- 172.21.15.50:0/3662131505 shutdown_connections 2024-04-01T01:55:59.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.466+0000 7f8a53521640 1 -- 172.21.15.50:0/3662131505 wait complete. 2024-04-01T01:55:59.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.466+0000 7f10b88e9640 1 -- 172.21.15.50:0/4116940321 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10b00a5610 con 0x7f10a0005030 2024-04-01T01:55:59.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.466+0000 7f10b88e9640 1 -- 172.21.15.50:0/4116940321 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10b0009690 con 0x7f10a0005030 2024-04-01T01:55:59.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.466+0000 7f090e765640 1 Processor -- start 2024-04-01T01:55:59.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.466+0000 7f04455b7640 1 -- 172.21.15.50:0/2930566826 shutdown_connections 2024-04-01T01:55:59.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.466+0000 7f04455b7640 1 -- 172.21.15.50:0/2930566826 >> 172.21.15.50:0/2930566826 conn(0x7f0438050190 msgr2=0x7f04380505a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:55:59.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.466+0000 7f04455b7640 1 -- 172.21.15.50:0/2930566826 shutdown_connections 2024-04-01T01:55:59.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.466+0000 7f164f52c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16480c5fb0 0x7f16480c9aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.466+0000 7f164f52c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f16480c7c10 0x7f16481fa360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.466+0000 7f164f52c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1648153fc0 0x7f1648156d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.466+0000 7f164f52c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f164815e0f0 con 0x7f16480c5fb0 2024-04-01T01:55:59.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.466+0000 7f164f52c640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f16481543a0 con 0x7f16480c7c10 2024-04-01T01:55:59.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.466+0000 7f164f52c640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f1648159d30 con 0x7f1648153fc0 2024-04-01T01:55:59.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.466+0000 7f164dd29640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f16480c7c10 0x7f16481fa360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:59.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.466+0000 7f164dd29640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f16480c7c10 0x7f16481fa360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.50:35638/0 (socket says 172.21.15.50:35638) 2024-04-01T01:55:59.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.466+0000 7f164dd29640 1 -- 172.21.15.50:0/1636146572 learned_addr learned my addr 172.21.15.50:0/1636146572 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T01:55:59.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.466+0000 7f10bbb4f640 1 -- 172.21.15.50:0/4116940321 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f10a0005030 msgr2=0x7f10a00141e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:59.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.466+0000 7f10bbb4f640 1 --2- 172.21.15.50:0/4116940321 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f10a0005030 0x7f10a00141e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f10b0009ac0 tx=0x7f10b001cb20 comp rx=0 tx=0).stop 2024-04-01T01:55:59.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.466+0000 7f164e52a640 1 --2- 172.21.15.50:0/1636146572 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16480c5fb0 0x7f16480c9aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:59.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.466+0000 7f164dd29640 1 -- 172.21.15.50:0/1636146572 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1648153fc0 msgr2=0x7f1648156d60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-01T01:55:59.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.466+0000 7f164dd29640 1 --2- 172.21.15.50:0/1636146572 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1648153fc0 0x7f1648156d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:59.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.466+0000 7f164dd29640 1 -- 172.21.15.50:0/1636146572 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16480c5fb0 msgr2=0x7f16480c9aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:59.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.466+0000 7f164dd29640 1 --2- 172.21.15.50:0/1636146572 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16480c5fb0 0x7f16480c9aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:59.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.466+0000 7f1429f47640 1 Processor -- start 2024-04-01T01:55:59.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.466+0000 7f164dd29640 1 -- 172.21.15.50:0/1636146572 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1648072b60 con 0x7f16480c7c10 2024-04-01T01:55:59.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.466+0000 7f7c3739d640 1 -- 172.21.15.50:0/1957339134 wait complete. 2024-04-01T01:55:59.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.466+0000 7f10bbb4f640 1 -- 172.21.15.50:0/4116940321 shutdown_connections 2024-04-01T01:55:59.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.466+0000 7f10bbb4f640 1 --2- 172.21.15.50:0/4116940321 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f10a0005030 0x7f10a00141e0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:59.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.466+0000 7f10bbb4f640 1 -- 172.21.15.50:0/4116940321 >> 172.21.15.50:0/4116940321 conn(0x7f10ac0512a0 msgr2=0x7f10ac0516b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:55:59.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.466+0000 7f8a53521640 1 Processor -- start 2024-04-01T01:55:59.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.466+0000 7f10bbb4f640 1 -- 172.21.15.50:0/4116940321 shutdown_connections 2024-04-01T01:55:59.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.466+0000 7f10bbb4f640 1 -- 172.21.15.50:0/4116940321 wait complete. 2024-04-01T01:55:59.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.466+0000 7f090e765640 1 -- start start 2024-04-01T01:55:59.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.466+0000 7f090e765640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f09080c6e00 0x7f09080c5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.466+0000 7f090e765640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f09080c64f0 0x7f090815e810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.466+0000 7f090e765640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0908161b60 con 0x7f0908158360 2024-04-01T01:55:59.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.466+0000 7f090e765640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f09081626e0 con 0x7f09080c6e00 2024-04-01T01:55:59.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.466+0000 7f090e765640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f0908161e40 con 0x7f09080c64f0 2024-04-01T01:55:59.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.466+0000 7f090cf62640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f09080c6e00 0x7f09080c5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:59.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.466+0000 7f090df64640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f09080c64f0 0x7f090815e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:59.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.466+0000 7f090df64640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f09080c64f0 0x7f090815e810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.50:54146/0 (socket says 172.21.15.50:54146) 2024-04-01T01:55:59.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.466+0000 7f090cf62640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f09080c6e00 0x7f09080c5fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50548/0 (socket says 172.21.15.50:50548) 2024-04-01T01:55:59.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.466+0000 7f090df64640 1 -- 172.21.15.50:0/1135988993 learned_addr learned my addr 172.21.15.50:0/1135988993 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T01:55:59.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.466+0000 7f7c3739d640 1 Processor -- start 2024-04-01T01:55:59.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.466+0000 7f7fc8b77640 1 -- 172.21.15.50:0/4133875671 wait complete. 2024-04-01T01:55:59.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.466+0000 7f164dd29640 1 --2- 172.21.15.50:0/1636146572 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f16480c7c10 0x7f16481fa360 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f16380097f0 tx=0x7f163801ad20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:59.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.466+0000 7f090cf62640 1 -- 172.21.15.50:0/1135988993 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f09080c64f0 msgr2=0x7f090815e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:55:59.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.466+0000 7f090cf62640 1 --2- 172.21.15.50:0/1135988993 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f09080c64f0 0x7f090815e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:59.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.466+0000 7f090cf62640 1 -- 172.21.15.50:0/1135988993 >> v1:172.21.15.97:6789/0 conn(0x7f0908158360 legacy=0x7f09080c8270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:59.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.466+0000 7f090cf62640 1 -- 172.21.15.50:0/1135988993 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0908162120 con 0x7f09080c6e00 2024-04-01T01:55:59.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.466+0000 7f163effd640 1 -- 172.21.15.50:0/1636146572 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16380b0050 con 0x7f16480c7c10 2024-04-01T01:55:59.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.466+0000 7f163effd640 1 -- 172.21.15.50:0/1636146572 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16380bc070 con 0x7f16480c7c10 2024-04-01T01:55:59.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.466+0000 7f164f52c640 1 -- 172.21.15.50:0/1636146572 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16480cbb50 con 0x7f16480c7c10 2024-04-01T01:55:59.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.466+0000 7f04455b7640 1 -- 172.21.15.50:0/2930566826 wait complete. 2024-04-01T01:55:59.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.466+0000 7f04455b7640 1 Processor -- start 2024-04-01T01:55:59.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.466+0000 7f164f52c640 1 -- 172.21.15.50:0/1636146572 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16481fadc0 con 0x7f16480c7c10 2024-04-01T01:55:59.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.466+0000 7f163effd640 1 -- 172.21.15.50:0/1636146572 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16380b5a70 con 0x7f16480c7c10 2024-04-01T01:55:59.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.466+0000 7f04455b7640 1 -- start start 2024-04-01T01:55:59.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.470+0000 7f7c3739d640 1 -- start start 2024-04-01T01:55:59.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.470+0000 7f7c3739d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c300c64f0 0x7f7c30072750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.470+0000 7f7c3739d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7c300c6e00 0x7f7c30141e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.470+0000 7f7c3739d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7c30158360 0x7f7c301423a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.470+0000 7f7c3739d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7c301618c0 con 0x7f7c300c64f0 2024-04-01T01:55:59.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.470+0000 7f7c3739d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f7c30161740 con 0x7f7c30158360 2024-04-01T01:55:59.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.470+0000 7f7c3739d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f7c3015ef20 con 0x7f7c300c6e00 2024-04-01T01:55:59.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.466+0000 7f8a53521640 1 -- start start 2024-04-01T01:55:59.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.470+0000 7f04455b7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0430004810 0x7f0438047510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.470+0000 7f04455b7640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0438047a50 0x7f04380d8740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.470+0000 7f04455b7640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f04380e3b50 0x7f04380d8c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.470+0000 7f04455b7640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f04380469b0 con 0x7f0430004810 2024-04-01T01:55:59.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.470+0000 7f04455b7640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f043804c970 con 0x7f04380e3b50 2024-04-01T01:55:59.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.470+0000 7f04455b7640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f0438046b30 con 0x7f0438047a50 2024-04-01T01:55:59.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.470+0000 7f043f7fe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0438047a50 0x7f04380d8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:59.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.470+0000 7f7c3639b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c300c64f0 0x7f7c30072750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:59.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.470+0000 7f7c3639b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c300c64f0 0x7f7c30072750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50566/0 (socket says 172.21.15.50:50566) 2024-04-01T01:55:59.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.470+0000 7f7c3639b640 1 -- 172.21.15.50:0/3177860643 learned_addr learned my addr 172.21.15.50:0/3177860643 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T01:55:59.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.470+0000 7f7c36b9c640 1 --2- 172.21.15.50:0/3177860643 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7c30158360 0x7f7c301423a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:59.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.470+0000 7f10bbb4f640 1 Processor -- start 2024-04-01T01:55:59.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.470+0000 7f043ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0430004810 0x7f0438047510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:59.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.470+0000 7f043f7fe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0438047a50 0x7f04380d8740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.50:54160/0 (socket says 172.21.15.50:54160) 2024-04-01T01:55:59.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.470+0000 7f043ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0430004810 0x7f0438047510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50564/0 (socket says 172.21.15.50:50564) 2024-04-01T01:55:59.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.470+0000 7f043f7fe640 1 -- 172.21.15.50:0/1487886245 learned_addr learned my addr 172.21.15.50:0/1487886245 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T01:55:59.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.470+0000 7f0444db6640 1 --2- 172.21.15.50:0/1487886245 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f04380e3b50 0x7f04380d8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:59.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.470+0000 7f7c3639b640 1 -- 172.21.15.50:0/3177860643 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7c300c6e00 msgr2=0x7f7c30141e60 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-01T01:55:59.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.470+0000 7f7c3639b640 1 --2- 172.21.15.50:0/3177860643 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7c300c6e00 0x7f7c30141e60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:59.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.470+0000 7f7c3639b640 1 -- 172.21.15.50:0/3177860643 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7c30158360 msgr2=0x7f7c301423a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:59.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.470+0000 7f7c3639b640 1 --2- 172.21.15.50:0/3177860643 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7c30158360 0x7f7c301423a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:59.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.470+0000 7f7c3639b640 1 -- 172.21.15.50:0/3177860643 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c30149a70 con 0x7f7c300c64f0 2024-04-01T01:55:59.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.470+0000 7f7c3639b640 1 --2- 172.21.15.50:0/3177860643 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c300c64f0 0x7f7c30072750 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7c2000c370 tx=0x7f7c2000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:59.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.470+0000 7f7fc8b77640 1 Processor -- start 2024-04-01T01:55:59.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.470+0000 7f1429f47640 1 -- start start 2024-04-01T01:55:59.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.470+0000 7f1429f47640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f14240b10d0 0x7f14242028b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.470+0000 7f1429f47640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14240c76f0 0x7f1424153e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.470+0000 7f1429f47640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f14240c7e10 0x7f14241fc260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.470+0000 7f1429f47640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f1424164d70 con 0x7f14240c76f0 2024-04-01T01:55:59.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.470+0000 7f1429f47640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f142415aee0 con 0x7f14240c7e10 2024-04-01T01:55:59.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.470+0000 7f1429f47640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f1424164ef0 con 0x7f14240b10d0 2024-04-01T01:55:59.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.470+0000 7f1423fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14240c76f0 0x7f1424153e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:59.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.470+0000 7f1423fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14240c76f0 0x7f1424153e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50578/0 (socket says 172.21.15.50:50578) 2024-04-01T01:55:59.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.470+0000 7f1423fff640 1 -- 172.21.15.50:0/2341734019 learned_addr learned my addr 172.21.15.50:0/2341734019 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T01:55:59.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.470+0000 7f8a53521640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8a44047570 0x7f8a44050170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.470+0000 7f8a53521640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a440d54d0 0x7f8a4417d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.470+0000 7f8a53521640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8a440db160 0x7f8a4417da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.470+0000 7f8a53521640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8a4404d020 con 0x7f8a440d54d0 2024-04-01T01:55:59.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.470+0000 7f8a53521640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f8a4404cea0 con 0x7f8a44047570 2024-04-01T01:55:59.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.470+0000 7f8a53521640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f8a440e9dd0 con 0x7f8a440db160 2024-04-01T01:55:59.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.470+0000 7f7c26ffd640 1 -- 172.21.15.50:0/3177860643 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c200052d0 con 0x7f7c300c64f0 2024-04-01T01:55:59.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.470+0000 7f043f7fe640 1 -- 172.21.15.50:0/1487886245 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f04380e3b50 msgr2=0x7f04380d8c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:59.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.470+0000 7f043f7fe640 1 --2- 172.21.15.50:0/1487886245 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f04380e3b50 0x7f04380d8c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:59.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.470+0000 7f043f7fe640 1 -- 172.21.15.50:0/1487886245 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0430004810 msgr2=0x7f0438047510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:59.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.470+0000 7f043f7fe640 1 --2- 172.21.15.50:0/1487886245 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0430004810 0x7f0438047510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:59.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.470+0000 7f043f7fe640 1 -- 172.21.15.50:0/1487886245 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0438049ec0 con 0x7f0438047a50 2024-04-01T01:55:59.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.470+0000 7f7c26ffd640 1 -- 172.21.15.50:0/3177860643 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c20005470 con 0x7f7c300c64f0 2024-04-01T01:55:59.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.470+0000 7f7c26ffd640 1 -- 172.21.15.50:0/3177860643 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c20007220 con 0x7f7c300c64f0 2024-04-01T01:55:59.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.470+0000 7f1428f45640 1 --2- 172.21.15.50:0/2341734019 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f14240b10d0 0x7f14242028b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:59.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.470+0000 7f8a51d1e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a440d54d0 0x7f8a4417d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:59.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.470+0000 7f8a52d20640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8a440db160 0x7f8a4417da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:59.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.470+0000 7f8a51d1e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a440d54d0 0x7f8a4417d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50590/0 (socket says 172.21.15.50:50590) 2024-04-01T01:55:59.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.470+0000 7f8a51d1e640 1 -- 172.21.15.50:0/1002595018 learned_addr learned my addr 172.21.15.50:0/1002595018 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T01:55:59.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.470+0000 7f8a5251f640 1 --2- 172.21.15.50:0/1002595018 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8a44047570 0x7f8a44050170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:59.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.470+0000 7f163effd640 1 -- 172.21.15.50:0/1636146572 <== mon.1 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) ==== 87103+0+0 (secure 0 0 0) 0x7f16380ab4c0 con 0x7f16480c7c10 2024-04-01T01:55:59.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.470+0000 7f163effd640 1 --2- 172.21.15.50:0/1636146572 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f162c067450 0x7f162c069910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.470+0000 7f163effd640 1 -- 172.21.15.50:0/1636146572 <== mon.1 v2:172.21.15.97:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f163811fec0 con 0x7f16480c7c10 2024-04-01T01:55:59.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.470+0000 7f1429746640 1 --2- 172.21.15.50:0/2341734019 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f14240c7e10 0x7f14241fc260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:59.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.470+0000 7f10bbb4f640 1 -- start start 2024-04-01T01:55:59.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.470+0000 7f10bbb4f640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f10a0005030 0x7f10ac165210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.470+0000 7f10bbb4f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f10ac035250 0x7f10ac0df790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.470+0000 7f10bbb4f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10ac035e90 0x7f10ac0c4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.470+0000 7f10bbb4f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f10ac008920 con 0x7f10ac035e90 2024-04-01T01:55:59.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.470+0000 7f10bbb4f640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f10ac008640 con 0x7f10ac035250 2024-04-01T01:55:59.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.470+0000 7f10bbb4f640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f10ac008c00 con 0x7f10a0005030 2024-04-01T01:55:59.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.470+0000 7f043f7fe640 1 --2- 172.21.15.50:0/1487886245 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0438047a50 0x7f04380d8740 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f042c09baa0 tx=0x7f0430005840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:59.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.470+0000 7f10ba0ec640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10ac035e90 0x7f10ac0c4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:59.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.470+0000 7f10ba0ec640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10ac035e90 0x7f10ac0c4f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50594/0 (socket says 172.21.15.50:50594) 2024-04-01T01:55:59.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.470+0000 7f10ba0ec640 1 -- 172.21.15.50:0/2464884454 learned_addr learned my addr 172.21.15.50:0/2464884454 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T01:55:59.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.470+0000 7f7c3739d640 1 -- 172.21.15.50:0/3177860643 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c30160df0 con 0x7f7c300c64f0 2024-04-01T01:55:59.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.470+0000 7f7c3739d640 1 -- 172.21.15.50:0/3177860643 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c301f7dc0 con 0x7f7c300c64f0 2024-04-01T01:55:59.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.470+0000 7f10b90ea640 1 --2- 172.21.15.50:0/2464884454 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f10ac035250 0x7f10ac0df790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:59.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.470+0000 7f043cff9640 1 -- 172.21.15.50:0/1487886245 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f042c005940 con 0x7f0438047a50 2024-04-01T01:55:59.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.470+0000 7f7fc8b77640 1 -- start start 2024-04-01T01:55:59.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.470+0000 7f7fc8b77640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7fb00051d0 0x7f7fc40c9090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.470+0000 7f7fc8b77640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7fc41f7830 0x7f7fc40cbac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.470+0000 7f7fc8b77640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7fc4072370 0x7f7fc41525c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.470+0000 7f7fc8b77640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7fc4158740 con 0x7f7fb00051d0 2024-04-01T01:55:59.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.470+0000 7f7fc8b77640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f7fc415e2f0 con 0x7f7fc4072370 2024-04-01T01:55:59.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.470+0000 7f7fc8b77640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f7fc41588c0 con 0x7f7fc41f7830 2024-04-01T01:55:59.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.470+0000 7f164e52a640 1 --2- 172.21.15.50:0/1636146572 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f162c067450 0x7f162c069910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:59.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.470+0000 7f8a52d20640 1 -- 172.21.15.50:0/1002595018 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8a44047570 msgr2=0x7f8a44050170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:59.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.470+0000 7f8a52d20640 1 --2- 172.21.15.50:0/1002595018 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8a44047570 0x7f8a44050170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:59.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.470+0000 7f8a52d20640 1 -- 172.21.15.50:0/1002595018 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a440d54d0 msgr2=0x7f8a4417d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:59.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.470+0000 7f8a52d20640 1 --2- 172.21.15.50:0/1002595018 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a440d54d0 0x7f8a4417d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:59.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.470+0000 7f8a52d20640 1 -- 172.21.15.50:0/1002595018 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a440de680 con 0x7f8a440db160 2024-04-01T01:55:59.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.470+0000 7f164f52c640 1 --2- 172.21.15.50:0/1636146572 >> [v2:172.21.15.97:6800/1095319381,v1:172.21.15.97:6801/1095319381] conn(0x7f1630001660 0x7f1630003b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.470+0000 7f043cff9640 1 -- 172.21.15.50:0/1487886245 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f042c005c90 con 0x7f0438047a50 2024-04-01T01:55:59.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.470+0000 7f043cff9640 1 -- 172.21.15.50:0/1487886245 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f042c0072b0 con 0x7f0438047a50 2024-04-01T01:55:59.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.474+0000 7f164f52c640 1 -- 172.21.15.50:0/1636146572 --> [v2:172.21.15.97:6800/1095319381,v1:172.21.15.97:6801/1095319381] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1630006bc0 con 0x7f1630001660 2024-04-01T01:55:59.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.474+0000 7f7fbbfff640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7fc41f7830 0x7f7fc40cbac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:59.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.474+0000 7f7fbbfff640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7fc41f7830 0x7f7fc40cbac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.50:54212/0 (socket says 172.21.15.50:54212) 2024-04-01T01:55:59.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.474+0000 7f7fbbfff640 1 -- 172.21.15.50:0/2170949035 learned_addr learned my addr 172.21.15.50:0/2170949035 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T01:55:59.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.474+0000 7f7c3739d640 1 -- 172.21.15.50:0/3177860643 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7c3004f4c0 con 0x7f7c300c64f0 2024-04-01T01:55:59.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.470+0000 7f1423fff640 1 -- 172.21.15.50:0/2341734019 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f14240b10d0 msgr2=0x7f14242028b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:59.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.470+0000 7f1423fff640 1 --2- 172.21.15.50:0/2341734019 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f14240b10d0 0x7f14242028b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:59.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.470+0000 7f1423fff640 1 -- 172.21.15.50:0/2341734019 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f14240c7e10 msgr2=0x7f14241fc260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:59.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.470+0000 7f1423fff640 1 --2- 172.21.15.50:0/2341734019 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f14240c7e10 0x7f14241fc260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:59.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.470+0000 7f1423fff640 1 -- 172.21.15.50:0/2341734019 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14240c4590 con 0x7f14240c76f0 2024-04-01T01:55:59.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.474+0000 7f8a52d20640 1 --2- 172.21.15.50:0/1002595018 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8a440db160 0x7f8a4417da10 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c0688e0 tx=0x7f8a4c068d10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:59.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.474+0000 7f7fc3fff640 1 --2- 172.21.15.50:0/2170949035 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7fc4072370 0x7f7fc41525c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:59.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.474+0000 7f10b98eb640 1 --2- 172.21.15.50:0/2464884454 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f10a0005030 0x7f10ac165210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:59.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.474+0000 7f164ed2b640 1 --2- 172.21.15.50:0/1636146572 >> [v2:172.21.15.97:6800/1095319381,v1:172.21.15.97:6801/1095319381] conn(0x7f1630001660 0x7f1630003b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:59.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.474+0000 7f8a42ffd640 1 -- 172.21.15.50:0/1002595018 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a4c073450 con 0x7f8a440db160 2024-04-01T01:55:59.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.474+0000 7f8a53521640 1 -- 172.21.15.50:0/1002595018 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a440359b0 con 0x7f8a440db160 2024-04-01T01:55:59.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.474+0000 7f8a42ffd640 1 -- 172.21.15.50:0/1002595018 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a4c08f070 con 0x7f8a440db160 2024-04-01T01:55:59.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.474+0000 7f8a42ffd640 1 -- 172.21.15.50:0/1002595018 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a4c073890 con 0x7f8a440db160 2024-04-01T01:55:59.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.474+0000 7f8a53521640 1 -- 172.21.15.50:0/1002595018 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a44035f70 con 0x7f8a440db160 2024-04-01T01:55:59.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.474+0000 7f7fbbfff640 1 -- 172.21.15.50:0/2170949035 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7fc4072370 msgr2=0x7f7fc41525c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:59.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.474+0000 7f7fbbfff640 1 --2- 172.21.15.50:0/2170949035 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7fc4072370 0x7f7fc41525c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:59.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.474+0000 7f7fbbfff640 1 -- 172.21.15.50:0/2170949035 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7fb00051d0 msgr2=0x7f7fc40c9090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:59.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.474+0000 7f7fbbfff640 1 --2- 172.21.15.50:0/2170949035 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7fb00051d0 0x7f7fc40c9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:59.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.474+0000 7f7fbbfff640 1 -- 172.21.15.50:0/2170949035 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fc40c95d0 con 0x7f7fc41f7830 2024-04-01T01:55:59.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.474+0000 7f1423fff640 1 --2- 172.21.15.50:0/2341734019 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14240c76f0 0x7f1424153e10 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f141c0af040 tx=0x7f141c019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:59.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.474+0000 7f164e52a640 1 --2- 172.21.15.50:0/1636146572 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f162c067450 0x7f162c069910 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1644000f70 tx=0x7f1644007240 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:59.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.474+0000 7f164ed2b640 1 --2- 172.21.15.50:0/1636146572 >> [v2:172.21.15.97:6800/1095319381,v1:172.21.15.97:6801/1095319381] conn(0x7f1630001660 0x7f1630003b20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:59.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.474+0000 7f7fbbfff640 1 --2- 172.21.15.50:0/2170949035 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7fc41f7830 0x7f7fc40cbac0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7fac00e830 tx=0x7f7fac00ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:59.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.474+0000 7f090cf62640 1 --2- 172.21.15.50:0/1135988993 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09080c6e00 0x7f09080c5fb0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0904009d90 tx=0x7f090401c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2ddbef30cd23f7e server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:59.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.474+0000 7f8a53521640 1 -- 172.21.15.50:0/1002595018 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8a34001040 con 0x7f8a440db160 2024-04-01T01:55:59.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.474+0000 7f7fc0ff9640 1 -- 172.21.15.50:0/2170949035 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fac017070 con 0x7f7fc41f7830 2024-04-01T01:55:59.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.474+0000 7f7fc8b77640 1 -- 172.21.15.50:0/2170949035 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fc41503d0 con 0x7f7fc41f7830 2024-04-01T01:55:59.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.474+0000 7f7fc8b77640 1 -- 172.21.15.50:0/2170949035 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fc41615b0 con 0x7f7fc41f7830 2024-04-01T01:55:59.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.474+0000 7f04455b7640 1 -- 172.21.15.50:0/1487886245 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04380e0b00 con 0x7f0438047a50 2024-04-01T01:55:59.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.474+0000 7f04455b7640 1 -- 172.21.15.50:0/1487886245 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0438049100 con 0x7f0438047a50 2024-04-01T01:55:59.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.474+0000 7f10b90ea640 1 -- 172.21.15.50:0/2464884454 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f10a0005030 msgr2=0x7f10ac165210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:59.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.474+0000 7f10b90ea640 1 --2- 172.21.15.50:0/2464884454 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f10a0005030 0x7f10ac165210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:59.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.474+0000 7f10b90ea640 1 -- 172.21.15.50:0/2464884454 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10ac035e90 msgr2=0x7f10ac0c4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:59.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.474+0000 7f10b90ea640 1 --2- 172.21.15.50:0/2464884454 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10ac035e90 0x7f10ac0c4f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:59.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.474+0000 7f10b90ea640 1 -- 172.21.15.50:0/2464884454 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10ac174490 con 0x7f10ac035250 2024-04-01T01:55:59.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.474+0000 7f10b90ea640 1 --2- 172.21.15.50:0/2464884454 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f10ac035250 0x7f10ac0df790 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f10b4050e60 tx=0x7f10b4072720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:59.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.474+0000 7f10aa7fc640 1 -- 172.21.15.50:0/2464884454 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10b4097420 con 0x7f10ac035250 2024-04-01T01:55:59.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.474+0000 7f10aa7fc640 1 -- 172.21.15.50:0/2464884454 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10b40975c0 con 0x7f10ac035250 2024-04-01T01:55:59.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.474+0000 7f10aa7fc640 1 -- 172.21.15.50:0/2464884454 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10b40979b0 con 0x7f10ac035250 2024-04-01T01:55:59.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.474+0000 7f10bbb4f640 1 -- 172.21.15.50:0/2464884454 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10ac171240 con 0x7f10ac035250 2024-04-01T01:55:59.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.474+0000 7f10bbb4f640 1 -- 172.21.15.50:0/2464884454 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10ac170760 con 0x7f10ac035250 2024-04-01T01:55:59.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.474+0000 7f04455b7640 1 -- 172.21.15.50:0/1487886245 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f04380052d0 con 0x7f0438047a50 2024-04-01T01:55:59.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.474+0000 7f14217fa640 1 -- 172.21.15.50:0/2341734019 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f141c0bc020 con 0x7f14240c76f0 2024-04-01T01:55:59.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.474+0000 7f14217fa640 1 -- 172.21.15.50:0/2341734019 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f141c0a5e50 con 0x7f14240c76f0 2024-04-01T01:55:59.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.474+0000 7f14217fa640 1 -- 172.21.15.50:0/2341734019 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f141c0b8ac0 con 0x7f14240c76f0 2024-04-01T01:55:59.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.474+0000 7f1429f47640 1 -- 172.21.15.50:0/2341734019 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14240c42b0 con 0x7f14240c76f0 2024-04-01T01:55:59.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.474+0000 7f1429f47640 1 -- 172.21.15.50:0/2341734019 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1424203460 con 0x7f14240c76f0 2024-04-01T01:55:59.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.474+0000 7f1429f47640 1 -- 172.21.15.50:0/2341734019 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f142404f4c0 con 0x7f14240c76f0 2024-04-01T01:55:59.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.474+0000 7f10bbb4f640 1 -- 172.21.15.50:0/2464884454 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f10ac174730 con 0x7f10ac035250 2024-04-01T01:55:59.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.474+0000 7f08fffff640 1 -- 172.21.15.50:0/1135988993 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09040b2070 con 0x7f09080c6e00 2024-04-01T01:55:59.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.474+0000 7f08fffff640 1 -- 172.21.15.50:0/1135988993 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09040a5960 con 0x7f09080c6e00 2024-04-01T01:55:59.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.474+0000 7f08fffff640 1 -- 172.21.15.50:0/1135988993 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09040a5d70 con 0x7f09080c6e00 2024-04-01T01:55:59.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.474+0000 7f163effd640 1 -- 172.21.15.50:0/1636146572 <== osd.4 v2:172.21.15.97:6800/1095319381 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1630006bc0 con 0x7f1630001660 2024-04-01T01:55:59.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.474+0000 7f7c26ffd640 1 -- 172.21.15.50:0/3177860643 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 87103+0+0 (secure 0 0 0) 0x7f7c200073c0 con 0x7f7c300c64f0 2024-04-01T01:55:59.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.478+0000 7f8a42ffd640 1 -- 172.21.15.50:0/1002595018 <== mon.2 v2:172.21.15.97:3301/0 4 ==== mgrmap(e 5) ==== 87103+0+0 (secure 0 0 0) 0x7f8a4c06e420 con 0x7f8a440db160 2024-04-01T01:55:59.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.478+0000 7f8a42ffd640 1 --2- 172.21.15.50:0/1002595018 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f8a30067420 0x7f8a300698e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.478+0000 7f8a42ffd640 1 -- 172.21.15.50:0/1002595018 <== mon.2 v2:172.21.15.97:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f8a4c100590 con 0x7f8a440db160 2024-04-01T01:55:59.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.478+0000 7f8a42ffd640 1 --2- 172.21.15.50:0/1002595018 >> [v2:172.21.15.97:6824/2224814961,v1:172.21.15.97:6825/2224814961] conn(0x7f8a3006f6a0 0x7f8a30071ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.478+0000 7f8a42ffd640 1 -- 172.21.15.50:0/1002595018 --> [v2:172.21.15.97:6824/2224814961,v1:172.21.15.97:6825/2224814961] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8a30072170 con 0x7f8a3006f6a0 2024-04-01T01:55:59.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.478+0000 7f8a42ffd640 1 -- 172.21.15.50:0/1002595018 <== mon.2 v2:172.21.15.97:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f8a4c100980 con 0x7f8a440db160 2024-04-01T01:55:59.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.478+0000 7f090e765640 1 -- 172.21.15.50:0/1135988993 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09080c6e00 msgr2=0x7f09080c5fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:59.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.478+0000 7f090e765640 1 --2- 172.21.15.50:0/1135988993 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09080c6e00 0x7f09080c5fb0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0904009d90 tx=0x7f090401c990 comp rx=0 tx=0).stop 2024-04-01T01:55:59.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.474+0000 7f7fc0ff9640 1 -- 172.21.15.50:0/2170949035 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fac00c8c0 con 0x7f7fc41f7830 2024-04-01T01:55:59.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.478+0000 7f090e765640 1 -- 172.21.15.50:0/1135988993 shutdown_connections 2024-04-01T01:55:59.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.478+0000 7f090e765640 1 --2- 172.21.15.50:0/1135988993 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f09080c64f0 0x7f090815e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:59.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.478+0000 7f090e765640 1 --2- 172.21.15.50:0/1135988993 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09080c6e00 0x7f09080c5fb0 secure :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0904009d90 tx=0x7f090401c990 comp rx=0 tx=0).stop 2024-04-01T01:55:59.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.478+0000 7f090e765640 1 -- 172.21.15.50:0/1135988993 >> 172.21.15.50:0/1135988993 conn(0x7f090806b220 msgr2=0x7f090806b630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:55:59.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.478+0000 7f7c26ffd640 1 --2- 172.21.15.50:0/3177860643 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f7c14067520 0x7f7c140699e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.478+0000 7f7c26ffd640 1 -- 172.21.15.50:0/3177860643 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f7c200852d0 con 0x7f7c300c64f0 2024-04-01T01:55:59.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.478+0000 7f7c26ffd640 1 --2- 172.21.15.50:0/3177860643 >> [v2:172.21.15.50:6800/710247177,v1:172.21.15.50:6801/710247177] conn(0x7f7c1406f7a0 0x7f7c14071bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.478+0000 7f7c26ffd640 1 -- 172.21.15.50:0/3177860643 --> [v2:172.21.15.50:6800/710247177,v1:172.21.15.50:6801/710247177] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7c2000de50 con 0x7f7c1406f7a0 2024-04-01T01:55:59.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.478+0000 7f7c26ffd640 1 -- 172.21.15.50:0/3177860643 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f7c200856c0 con 0x7f7c300c64f0 2024-04-01T01:55:59.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.478+0000 7f8a5251f640 1 --2- 172.21.15.50:0/1002595018 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f8a30067420 0x7f8a300698e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:59.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.478+0000 7f8a51d1e640 1 --2- 172.21.15.50:0/1002595018 >> [v2:172.21.15.97:6824/2224814961,v1:172.21.15.97:6825/2224814961] conn(0x7f8a3006f6a0 0x7f8a30071ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:59.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.478+0000 7f090e765640 1 -- 172.21.15.50:0/1135988993 shutdown_connections 2024-04-01T01:55:59.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.478+0000 7f043cff9640 1 -- 172.21.15.50:0/1487886245 <== mon.2 v2:172.21.15.97:3301/0 4 ==== mgrmap(e 5) ==== 87103+0+0 (secure 0 0 0) 0x7f042c0ba030 con 0x7f0438047a50 2024-04-01T01:55:59.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.478+0000 7f8a5251f640 1 --2- 172.21.15.50:0/1002595018 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f8a30067420 0x7f8a300698e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c009950 tx=0x7f8a3c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:59.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.478+0000 7f14217fa640 1 -- 172.21.15.50:0/2341734019 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 87103+0+0 (secure 0 0 0) 0x7f141c0bf020 con 0x7f14240c76f0 2024-04-01T01:55:59.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.478+0000 7f14217fa640 1 --2- 172.21.15.50:0/2341734019 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f1410067470 0x7f1410069930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.478+0000 7f14217fa640 1 -- 172.21.15.50:0/2341734019 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f141c120b10 con 0x7f14240c76f0 2024-04-01T01:55:59.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.478+0000 7f14217fa640 1 --2- 172.21.15.50:0/2341734019 >> [v2:172.21.15.97:6816/899031308,v1:172.21.15.97:6817/899031308] conn(0x7f141006f6f0 0x7f1410071b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.478+0000 7f14217fa640 1 -- 172.21.15.50:0/2341734019 --> [v2:172.21.15.97:6816/899031308,v1:172.21.15.97:6817/899031308] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f14100721c0 con 0x7f141006f6f0 2024-04-01T01:55:59.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.478+0000 7f1428f45640 1 --2- 172.21.15.50:0/2341734019 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f1410067470 0x7f1410069930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:59.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.478+0000 7f14217fa640 1 -- 172.21.15.50:0/2341734019 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f141c120ec0 con 0x7f14240c76f0 2024-04-01T01:55:59.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.478+0000 7f7fc0ff9640 1 -- 172.21.15.50:0/2170949035 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fac00cc90 con 0x7f7fc41f7830 2024-04-01T01:55:59.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.478+0000 7f7fc8b77640 1 -- 172.21.15.50:0/2170949035 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7fa8001040 con 0x7f7fc41f7830 2024-04-01T01:55:59.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.478+0000 7f1429746640 1 --2- 172.21.15.50:0/2341734019 >> [v2:172.21.15.97:6816/899031308,v1:172.21.15.97:6817/899031308] conn(0x7f141006f6f0 0x7f1410071b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:59.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.478+0000 7f043cff9640 1 --2- 172.21.15.50:0/1487886245 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f0424067450 0x7f0424069910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.478+0000 7f043cff9640 1 -- 172.21.15.50:0/1487886245 <== mon.2 v2:172.21.15.97:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f042c122530 con 0x7f0438047a50 2024-04-01T01:55:59.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.478+0000 7f043cff9640 1 --2- 172.21.15.50:0/1487886245 >> [v2:172.21.15.50:6824/4170468134,v1:172.21.15.50:6825/4170468134] conn(0x7f042406f670 0x7f0424071a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.478+0000 7f043cff9640 1 -- 172.21.15.50:0/1487886245 --> [v2:172.21.15.50:6824/4170468134,v1:172.21.15.50:6825/4170468134] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f042c00bf30 con 0x7f042406f670 2024-04-01T01:55:59.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.478+0000 7f043cff9640 1 -- 172.21.15.50:0/1487886245 <== mon.2 v2:172.21.15.97:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f042c122920 con 0x7f0438047a50 2024-04-01T01:55:59.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.478+0000 7f043ffff640 1 --2- 172.21.15.50:0/1487886245 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f0424067450 0x7f0424069910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:59.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.478+0000 7f0444db6640 1 --2- 172.21.15.50:0/1487886245 >> [v2:172.21.15.50:6824/4170468134,v1:172.21.15.50:6825/4170468134] conn(0x7f042406f670 0x7f0424071a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:59.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.478+0000 7f7fc0ff9640 1 -- 172.21.15.50:0/2170949035 <== mon.2 v2:172.21.15.97:3301/0 4 ==== mgrmap(e 5) ==== 87103+0+0 (secure 0 0 0) 0x7f7fac01a070 con 0x7f7fc41f7830 2024-04-01T01:55:59.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.478+0000 7f1428f45640 1 --2- 172.21.15.50:0/2341734019 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f1410067470 0x7f1410069930 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1414001b80 tx=0x7f1414001b10 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:59.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.478+0000 7f0444db6640 1 --2- 172.21.15.50:0/1487886245 >> [v2:172.21.15.50:6824/4170468134,v1:172.21.15.50:6825/4170468134] conn(0x7f042406f670 0x7f0424071a90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:59.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.478+0000 7f1429746640 1 --2- 172.21.15.50:0/2341734019 >> [v2:172.21.15.97:6816/899031308,v1:172.21.15.97:6817/899031308] conn(0x7f141006f6f0 0x7f1410071b10 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:59.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.478+0000 7f090e765640 1 -- 172.21.15.50:0/1135988993 wait complete. 2024-04-01T01:55:59.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.478+0000 7f090e765640 1 Processor -- start 2024-04-01T01:55:59.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.478+0000 7f8a51d1e640 1 --2- 172.21.15.50:0/1002595018 >> [v2:172.21.15.97:6824/2224814961,v1:172.21.15.97:6825/2224814961] conn(0x7f8a3006f6a0 0x7f8a30071ac0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:59.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.482+0000 7f7c35b9a640 1 --2- 172.21.15.50:0/3177860643 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f7c14067520 0x7f7c140699e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:59.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.482+0000 7f7c36b9c640 1 --2- 172.21.15.50:0/3177860643 >> [v2:172.21.15.50:6800/710247177,v1:172.21.15.50:6801/710247177] conn(0x7f7c1406f7a0 0x7f7c14071bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:59.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.478+0000 7f10aa7fc640 1 -- 172.21.15.50:0/2464884454 <== mon.1 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) ==== 87103+0+0 (secure 0 0 0) 0x7f10b40963c0 con 0x7f10ac035250 2024-04-01T01:55:59.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.478+0000 7f10aa7fc640 1 --2- 172.21.15.50:0/2464884454 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f1098067470 0x7f1098069930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.478+0000 7f10aa7fc640 1 -- 172.21.15.50:0/2464884454 <== mon.1 v2:172.21.15.97:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f10b4104f40 con 0x7f10ac035250 2024-04-01T01:55:59.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.478+0000 7f10aa7fc640 1 --2- 172.21.15.50:0/2464884454 >> [v2:172.21.15.97:6808/284968823,v1:172.21.15.97:6809/284968823] conn(0x7f109806f6f0 0x7f1098071b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.478+0000 7f10aa7fc640 1 -- 172.21.15.50:0/2464884454 --> [v2:172.21.15.97:6808/284968823,v1:172.21.15.97:6809/284968823] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f10980721c0 con 0x7f109806f6f0 2024-04-01T01:55:59.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.478+0000 7f10aa7fc640 1 -- 172.21.15.50:0/2464884454 <== mon.1 v2:172.21.15.97:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f10b4105420 con 0x7f10ac035250 2024-04-01T01:55:59.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.478+0000 7f10b98eb640 1 --2- 172.21.15.50:0/2464884454 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f1098067470 0x7f1098069930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:59.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.478+0000 7f10b98eb640 1 --2- 172.21.15.50:0/2464884454 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f1098067470 0x7f1098069930 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f10a40016a0 tx=0x7f10a4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:59.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.482+0000 7f10ba0ec640 1 --2- 172.21.15.50:0/2464884454 >> [v2:172.21.15.97:6808/284968823,v1:172.21.15.97:6809/284968823] conn(0x7f109806f6f0 0x7f1098071b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:59.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.482+0000 7f043cff9640 1 -- 172.21.15.50:0/1487886245 <== osd.0 v2:172.21.15.50:6824/4170468134 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f042c00bf30 con 0x7f042406f670 2024-04-01T01:55:59.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.482+0000 7f7fc0ff9640 1 --2- 172.21.15.50:0/2170949035 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f7fa4067450 0x7f7fa4069910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.482+0000 7f7c36b9c640 1 --2- 172.21.15.50:0/3177860643 >> [v2:172.21.15.50:6800/710247177,v1:172.21.15.50:6801/710247177] conn(0x7f7c1406f7a0 0x7f7c14071bc0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:59.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.482+0000 7f043ffff640 1 --2- 172.21.15.50:0/1487886245 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f0424067450 0x7f0424069910 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f043800e4b0 tx=0x7f0434008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:59.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.482+0000 7f8a42ffd640 1 -- 172.21.15.50:0/1002595018 <== osd.6 v2:172.21.15.97:6824/2224814961 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8a30072170 con 0x7f8a3006f6a0 2024-04-01T01:55:59.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.482+0000 7f090e765640 1 -- start start 2024-04-01T01:55:59.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.482+0000 7f090e765640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f09080c64f0 0x7f090814bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.482+0000 7f090e765640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0908158360 0x7f0908160b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.482+0000 7f090e765640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0908147080 0x7f0908161050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.482+0000 7f7fc0ff9640 1 -- 172.21.15.50:0/2170949035 <== mon.2 v2:172.21.15.97:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f7fac0859a0 con 0x7f7fc41f7830 2024-04-01T01:55:59.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.482+0000 7f7fc37fe640 1 --2- 172.21.15.50:0/2170949035 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f7fa4067450 0x7f7fa4069910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:59.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.482+0000 7f090e765640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f09081618c0 con 0x7f0908147080 2024-04-01T01:55:59.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.482+0000 7f090e765640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f0908161740 con 0x7f0908158360 2024-04-01T01:55:59.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.482+0000 7f090e765640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f09081692e0 con 0x7f09080c64f0 2024-04-01T01:55:59.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.482+0000 7f090cf62640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0908158360 0x7f0908160b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:59.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.482+0000 7f090cf62640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0908158360 0x7f0908160b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.50:35714/0 (socket says 172.21.15.50:35714) 2024-04-01T01:55:59.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.482+0000 7f090cf62640 1 -- 172.21.15.50:0/3193956382 learned_addr learned my addr 172.21.15.50:0/3193956382 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T01:55:59.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.482+0000 7f7fc0ff9640 1 --2- 172.21.15.50:0/2170949035 >> [v2:172.21.15.50:6816/871680805,v1:172.21.15.50:6817/871680805] conn(0x7f7fa406f6d0 0x7f7fa4071af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.482+0000 7f7fc0ff9640 1 -- 172.21.15.50:0/2170949035 --> [v2:172.21.15.50:6816/871680805,v1:172.21.15.50:6817/871680805] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7fac020e50 con 0x7f7fa406f6d0 2024-04-01T01:55:59.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.482+0000 7f7fc0ff9640 1 -- 172.21.15.50:0/2170949035 <== mon.2 v2:172.21.15.97:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f7fac08a260 con 0x7f7fc41f7830 2024-04-01T01:55:59.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.482+0000 7f090cf62640 1 -- 172.21.15.50:0/3193956382 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f09080c64f0 msgr2=0x7f090814bca0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-01T01:55:59.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.482+0000 7f090cf62640 1 --2- 172.21.15.50:0/3193956382 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f09080c64f0 0x7f090814bca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:59.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.482+0000 7f090cf62640 1 -- 172.21.15.50:0/3193956382 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0908147080 msgr2=0x7f0908161050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:59.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.482+0000 7f090cf62640 1 --2- 172.21.15.50:0/3193956382 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0908147080 0x7f0908161050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:59.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.482+0000 7f090cf62640 1 -- 172.21.15.50:0/3193956382 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09080c2170 con 0x7f0908158360 2024-04-01T01:55:59.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.482+0000 7f7fc37fe640 1 --2- 172.21.15.50:0/2170949035 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f7fa4067450 0x7f7fa4069910 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7fb4001000 tx=0x7f7fb4001b50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:59.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.482+0000 7f14217fa640 1 -- 172.21.15.50:0/2341734019 <== osd.5 v2:172.21.15.97:6816/899031308 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f14100721c0 con 0x7f141006f6f0 2024-04-01T01:55:59.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.482+0000 7f10ba0ec640 1 --2- 172.21.15.50:0/2464884454 >> [v2:172.21.15.97:6808/284968823,v1:172.21.15.97:6809/284968823] conn(0x7f109806f6f0 0x7f1098071b10 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:59.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.482+0000 7f7c35b9a640 1 --2- 172.21.15.50:0/3177860643 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f7c14067520 0x7f7c140699e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7c280af000 tx=0x7f7c280a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:59.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.482+0000 7f7fc3fff640 1 --2- 172.21.15.50:0/2170949035 >> [v2:172.21.15.50:6816/871680805,v1:172.21.15.50:6817/871680805] conn(0x7f7fa406f6d0 0x7f7fa4071af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:59.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.482+0000 7f090cf62640 1 --2- 172.21.15.50:0/3193956382 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0908158360 0x7f0908160b10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f090401b040 tx=0x7f0904019730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:59.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.482+0000 7f08fdffb640 1 -- 172.21.15.50:0/3193956382 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09040bb020 con 0x7f0908158360 2024-04-01T01:55:59.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.482+0000 7f08fdffb640 1 -- 172.21.15.50:0/3193956382 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0904003ba0 con 0x7f0908158360 2024-04-01T01:55:59.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.482+0000 7f090e765640 1 -- 172.21.15.50:0/3193956382 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f090814af00 con 0x7f0908158360 2024-04-01T01:55:59.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.482+0000 7f7c26ffd640 1 -- 172.21.15.50:0/3177860643 <== osd.2 v2:172.21.15.50:6800/710247177 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7c2000de50 con 0x7f7c1406f7a0 2024-04-01T01:55:59.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.486+0000 7f090e765640 1 -- 172.21.15.50:0/3193956382 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f090814d6e0 con 0x7f0908158360 2024-04-01T01:55:59.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.482+0000 7f08fdffb640 1 -- 172.21.15.50:0/3193956382 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09040b2040 con 0x7f0908158360 2024-04-01T01:55:59.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.486+0000 7f08f37fe640 1 -- 172.21.15.50:0/3193956382 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f08e0001040 con 0x7f0908158360 2024-04-01T01:55:59.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.486+0000 7f08fdffb640 1 -- 172.21.15.50:0/3193956382 <== mon.1 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) ==== 87103+0+0 (secure 0 0 0) 0x7f0904004000 con 0x7f0908158360 2024-04-01T01:55:59.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.486+0000 7f08fdffb640 1 --2- 172.21.15.50:0/3193956382 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f08ec067450 0x7f08ec069910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.486+0000 7f08fdffb640 1 -- 172.21.15.50:0/3193956382 <== mon.1 v2:172.21.15.97:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f0904124060 con 0x7f0908158360 2024-04-01T01:55:59.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.486+0000 7f08fdffb640 1 --2- 172.21.15.50:0/3193956382 >> [v2:172.21.15.50:6808/1794491326,v1:172.21.15.50:6809/1794491326] conn(0x7f08ec06f650 0x7f08ec071a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.486+0000 7f08fdffb640 1 -- 172.21.15.50:0/3193956382 --> [v2:172.21.15.50:6808/1794491326,v1:172.21.15.50:6809/1794491326] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f09040a5960 con 0x7f08ec06f650 2024-04-01T01:55:59.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.486+0000 7f08fdffb640 1 -- 172.21.15.50:0/3193956382 <== mon.1 v2:172.21.15.97:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f090411f350 con 0x7f0908158360 2024-04-01T01:55:59.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.490+0000 7f090df64640 1 --2- 172.21.15.50:0/3193956382 >> [v2:172.21.15.50:6808/1794491326,v1:172.21.15.50:6809/1794491326] conn(0x7f08ec06f650 0x7f08ec071a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:59.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.490+0000 7f7fc3fff640 1 --2- 172.21.15.50:0/2170949035 >> [v2:172.21.15.50:6816/871680805,v1:172.21.15.50:6817/871680805] conn(0x7f7fa406f6d0 0x7f7fa4071af0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:59.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.486+0000 7f10aa7fc640 1 -- 172.21.15.50:0/2464884454 <== osd.7 v2:172.21.15.97:6808/284968823 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f10980721c0 con 0x7f109806f6f0 2024-04-01T01:55:59.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.490+0000 7f090d763640 1 --2- 172.21.15.50:0/3193956382 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f08ec067450 0x7f08ec069910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:59.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.490+0000 7f090df64640 1 --2- 172.21.15.50:0/3193956382 >> [v2:172.21.15.50:6808/1794491326,v1:172.21.15.50:6809/1794491326] conn(0x7f08ec06f650 0x7f08ec071a70 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:59.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.490+0000 7f090d763640 1 --2- 172.21.15.50:0/3193956382 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f08ec067450 0x7f08ec069910 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0900000f70 tx=0x7f09000079c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:59.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.490+0000 7f7fc0ff9640 1 -- 172.21.15.50:0/2170949035 <== osd.3 v2:172.21.15.50:6816/871680805 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7fac020e50 con 0x7f7fa406f6d0 2024-04-01T01:55:59.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.490+0000 7f08fdffb640 1 -- 172.21.15.50:0/3193956382 <== osd.1 v2:172.21.15.50:6808/1794491326 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f09040a5960 con 0x7f08ec06f650 2024-04-01T01:55:59.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.502+0000 7f164f52c640 1 -- 172.21.15.50:0/1636146572 --> [v2:172.21.15.97:6800/1095319381,v1:172.21.15.97:6801/1095319381] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1630005ca0 con 0x7f1630001660 2024-04-01T01:55:59.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.506+0000 7f163effd640 1 -- 172.21.15.50:0/1636146572 <== osd.4 v2:172.21.15.97:6800/1095319381 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f1630005ca0 con 0x7f1630001660 2024-04-01T01:55:59.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.506+0000 7f163cff9640 1 -- 172.21.15.50:0/1636146572 >> [v2:172.21.15.97:6800/1095319381,v1:172.21.15.97:6801/1095319381] conn(0x7f1630001660 msgr2=0x7f1630003b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:59.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.506+0000 7f163cff9640 1 --2- 172.21.15.50:0/1636146572 >> [v2:172.21.15.97:6800/1095319381,v1:172.21.15.97:6801/1095319381] conn(0x7f1630001660 0x7f1630003b20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:59.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.506+0000 7f163cff9640 1 -- 172.21.15.50:0/1636146572 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f162c067450 msgr2=0x7f162c069910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:59.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.506+0000 7f163cff9640 1 --2- 172.21.15.50:0/1636146572 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f162c067450 0x7f162c069910 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1644000f70 tx=0x7f1644007240 comp rx=0 tx=0).stop 2024-04-01T01:55:59.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.506+0000 7f163cff9640 1 -- 172.21.15.50:0/1636146572 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f16480c7c10 msgr2=0x7f16481fa360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:59.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.506+0000 7f163cff9640 1 --2- 172.21.15.50:0/1636146572 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f16480c7c10 0x7f16481fa360 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f16380097f0 tx=0x7f163801ad20 comp rx=0 tx=0).stop 2024-04-01T01:55:59.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.506+0000 7f164ed2b640 1 -- 172.21.15.50:0/1636146572 reap_dead start 2024-04-01T01:55:59.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.506+0000 7f163cff9640 1 -- 172.21.15.50:0/1636146572 shutdown_connections 2024-04-01T01:55:59.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.506+0000 7f163cff9640 1 -- 172.21.15.50:0/1636146572 >> 172.21.15.50:0/1636146572 conn(0x7f164806b220 msgr2=0x7f1648157b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:55:59.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.506+0000 7f7c3739d640 1 -- 172.21.15.50:0/3177860643 --> [v2:172.21.15.50:6800/710247177,v1:172.21.15.50:6801/710247177] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7c3014d3e0 con 0x7f7c1406f7a0 2024-04-01T01:55:59.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.506+0000 7f7c26ffd640 1 -- 172.21.15.50:0/3177860643 <== osd.2 v2:172.21.15.50:6800/710247177 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f7c3014d3e0 con 0x7f7c1406f7a0 2024-04-01T01:55:59.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.506+0000 7f163cff9640 1 -- 172.21.15.50:0/1636146572 shutdown_connections 2024-04-01T01:55:59.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.506+0000 7f163cff9640 1 -- 172.21.15.50:0/1636146572 wait complete. 2024-04-01T01:55:59.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.506+0000 7f7c24ff9640 1 -- 172.21.15.50:0/3177860643 >> [v2:172.21.15.50:6800/710247177,v1:172.21.15.50:6801/710247177] conn(0x7f7c1406f7a0 msgr2=0x7f7c14071bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:59.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.506+0000 7f7c24ff9640 1 --2- 172.21.15.50:0/3177860643 >> [v2:172.21.15.50:6800/710247177,v1:172.21.15.50:6801/710247177] conn(0x7f7c1406f7a0 0x7f7c14071bc0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:59.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.506+0000 7f7c24ff9640 1 -- 172.21.15.50:0/3177860643 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f7c14067520 msgr2=0x7f7c140699e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:59.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.506+0000 7f7c24ff9640 1 --2- 172.21.15.50:0/3177860643 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f7c14067520 0x7f7c140699e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7c280af000 tx=0x7f7c280a7070 comp rx=0 tx=0).stop 2024-04-01T01:55:59.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.506+0000 7f7c24ff9640 1 -- 172.21.15.50:0/3177860643 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c300c64f0 msgr2=0x7f7c30072750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:59.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.506+0000 7f7c24ff9640 1 --2- 172.21.15.50:0/3177860643 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c300c64f0 0x7f7c30072750 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7c2000c370 tx=0x7f7c2000c830 comp rx=0 tx=0).stop 2024-04-01T01:55:59.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.510+0000 7f7c36b9c640 1 -- 172.21.15.50:0/3177860643 reap_dead start 2024-04-01T01:55:59.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.510+0000 7f04455b7640 1 -- 172.21.15.50:0/1487886245 --> [v2:172.21.15.50:6824/4170468134,v1:172.21.15.50:6825/4170468134] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f04380e40a0 con 0x7f042406f670 2024-04-01T01:55:59.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.510+0000 7f043cff9640 1 -- 172.21.15.50:0/1487886245 <== osd.0 v2:172.21.15.50:6824/4170468134 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f04380e40a0 con 0x7f042406f670 2024-04-01T01:55:59.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.510+0000 7f08f37fe640 1 -- 172.21.15.50:0/3193956382 --> [v2:172.21.15.50:6808/1794491326,v1:172.21.15.50:6809/1794491326] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f08e0002de0 con 0x7f08ec06f650 2024-04-01T01:55:59.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.510+0000 7f08fdffb640 1 -- 172.21.15.50:0/3193956382 <== osd.1 v2:172.21.15.50:6808/1794491326 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f08e0002de0 con 0x7f08ec06f650 2024-04-01T01:55:59.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.510+0000 7f10bbb4f640 1 -- 172.21.15.50:0/2464884454 --> [v2:172.21.15.97:6808/284968823,v1:172.21.15.97:6809/284968823] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f10ac005720 con 0x7f109806f6f0 2024-04-01T01:55:59.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.510+0000 7f08f37fe640 1 -- 172.21.15.50:0/3193956382 >> [v2:172.21.15.50:6808/1794491326,v1:172.21.15.50:6809/1794491326] conn(0x7f08ec06f650 msgr2=0x7f08ec071a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:59.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.514+0000 7f08f37fe640 1 --2- 172.21.15.50:0/3193956382 >> [v2:172.21.15.50:6808/1794491326,v1:172.21.15.50:6809/1794491326] conn(0x7f08ec06f650 0x7f08ec071a70 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:59.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.514+0000 7f08f37fe640 1 -- 172.21.15.50:0/3193956382 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f08ec067450 msgr2=0x7f08ec069910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:59.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.514+0000 7f08f37fe640 1 --2- 172.21.15.50:0/3193956382 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f08ec067450 0x7f08ec069910 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0900000f70 tx=0x7f09000079c0 comp rx=0 tx=0).stop 2024-04-01T01:55:59.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.514+0000 7f08f37fe640 1 -- 172.21.15.50:0/3193956382 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0908158360 msgr2=0x7f0908160b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:59.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.514+0000 7f08f37fe640 1 --2- 172.21.15.50:0/3193956382 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0908158360 0x7f0908160b10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f090401b040 tx=0x7f0904019730 comp rx=0 tx=0).stop 2024-04-01T01:55:59.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.514+0000 7f090df64640 1 -- 172.21.15.50:0/3193956382 reap_dead start 2024-04-01T01:55:59.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.514+0000 7f08f37fe640 1 -- 172.21.15.50:0/3193956382 shutdown_connections 2024-04-01T01:55:59.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.514+0000 7f08f37fe640 1 -- 172.21.15.50:0/3193956382 >> 172.21.15.50:0/3193956382 conn(0x7f090806b220 msgr2=0x7f090815d020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:55:59.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.514+0000 7f08f37fe640 1 -- 172.21.15.50:0/3193956382 shutdown_connections 2024-04-01T01:55:59.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.514+0000 7f7c24ff9640 1 -- 172.21.15.50:0/3177860643 shutdown_connections 2024-04-01T01:55:59.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.514+0000 7f7c24ff9640 1 -- 172.21.15.50:0/3177860643 >> 172.21.15.50:0/3177860643 conn(0x7f7c3006b220 msgr2=0x7f7c3006b600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:55:59.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.514+0000 7f7c24ff9640 1 -- 172.21.15.50:0/3177860643 shutdown_connections 2024-04-01T01:55:59.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.514+0000 7f08f37fe640 1 -- 172.21.15.50:0/3193956382 wait complete. 2024-04-01T01:55:59.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.514+0000 7f7c24ff9640 1 -- 172.21.15.50:0/3177860643 wait complete. 2024-04-01T01:55:59.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.514+0000 7f04455b7640 1 -- 172.21.15.50:0/1487886245 >> [v2:172.21.15.50:6824/4170468134,v1:172.21.15.50:6825/4170468134] conn(0x7f042406f670 msgr2=0x7f0424071a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:59.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.514+0000 7f04455b7640 1 --2- 172.21.15.50:0/1487886245 >> [v2:172.21.15.50:6824/4170468134,v1:172.21.15.50:6825/4170468134] conn(0x7f042406f670 0x7f0424071a90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:59.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.514+0000 7f10aa7fc640 1 -- 172.21.15.50:0/2464884454 <== osd.7 v2:172.21.15.97:6808/284968823 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f10ac005720 con 0x7f109806f6f0 2024-04-01T01:55:59.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.514+0000 7f04455b7640 1 -- 172.21.15.50:0/1487886245 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f0424067450 msgr2=0x7f0424069910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:59.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.514+0000 7f04455b7640 1 --2- 172.21.15.50:0/1487886245 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f0424067450 0x7f0424069910 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f043800e4b0 tx=0x7f0434008040 comp rx=0 tx=0).stop 2024-04-01T01:55:59.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.514+0000 7f04455b7640 1 -- 172.21.15.50:0/1487886245 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0438047a50 msgr2=0x7f04380d8740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:59.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.514+0000 7f04455b7640 1 --2- 172.21.15.50:0/1487886245 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0438047a50 0x7f04380d8740 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f042c09baa0 tx=0x7f0430005840 comp rx=0 tx=0).stop 2024-04-01T01:55:59.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.514+0000 7f0444db6640 1 -- 172.21.15.50:0/1487886245 reap_dead start 2024-04-01T01:55:59.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.514+0000 7f04455b7640 1 -- 172.21.15.50:0/1487886245 shutdown_connections 2024-04-01T01:55:59.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.514+0000 7f04455b7640 1 -- 172.21.15.50:0/1487886245 >> 172.21.15.50:0/1487886245 conn(0x7f0438050190 msgr2=0x7f0438004910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:55:59.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.514+0000 7f04455b7640 1 -- 172.21.15.50:0/1487886245 shutdown_connections 2024-04-01T01:55:59.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.514+0000 7f04455b7640 1 -- 172.21.15.50:0/1487886245 wait complete. 2024-04-01T01:55:59.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.514+0000 7f1097fff640 1 -- 172.21.15.50:0/2464884454 >> [v2:172.21.15.97:6808/284968823,v1:172.21.15.97:6809/284968823] conn(0x7f109806f6f0 msgr2=0x7f1098071b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:59.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.514+0000 7f1097fff640 1 --2- 172.21.15.50:0/2464884454 >> [v2:172.21.15.97:6808/284968823,v1:172.21.15.97:6809/284968823] conn(0x7f109806f6f0 0x7f1098071b10 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:59.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.514+0000 7f1097fff640 1 -- 172.21.15.50:0/2464884454 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f1098067470 msgr2=0x7f1098069930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:59.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.514+0000 7f1097fff640 1 --2- 172.21.15.50:0/2464884454 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f1098067470 0x7f1098069930 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f10a40016a0 tx=0x7f10a4009040 comp rx=0 tx=0).stop 2024-04-01T01:55:59.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.514+0000 7f1097fff640 1 -- 172.21.15.50:0/2464884454 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f10ac035250 msgr2=0x7f10ac0df790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:59.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.514+0000 7f1097fff640 1 --2- 172.21.15.50:0/2464884454 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f10ac035250 0x7f10ac0df790 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f10b4050e60 tx=0x7f10b4072720 comp rx=0 tx=0).stop 2024-04-01T01:55:59.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.514+0000 7f10ba0ec640 1 -- 172.21.15.50:0/2464884454 reap_dead start 2024-04-01T01:55:59.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.514+0000 7f1097fff640 1 -- 172.21.15.50:0/2464884454 shutdown_connections 2024-04-01T01:55:59.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.514+0000 7f1097fff640 1 -- 172.21.15.50:0/2464884454 >> 172.21.15.50:0/2464884454 conn(0x7f10ac0512a0 msgr2=0x7f10ac0d3410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:55:59.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.514+0000 7f1097fff640 1 -- 172.21.15.50:0/2464884454 shutdown_connections 2024-04-01T01:55:59.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.514+0000 7f1097fff640 1 -- 172.21.15.50:0/2464884454 wait complete. 2024-04-01T01:55:59.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.514+0000 7f1429f47640 1 -- 172.21.15.50:0/2341734019 --> [v2:172.21.15.97:6816/899031308,v1:172.21.15.97:6817/899031308] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f14240c8710 con 0x7f141006f6f0 2024-04-01T01:55:59.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.514+0000 7f14217fa640 1 -- 172.21.15.50:0/2341734019 <== osd.5 v2:172.21.15.97:6816/899031308 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f14240c8710 con 0x7f141006f6f0 2024-04-01T01:55:59.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.514+0000 7f1429f47640 1 -- 172.21.15.50:0/2341734019 >> [v2:172.21.15.97:6816/899031308,v1:172.21.15.97:6817/899031308] conn(0x7f141006f6f0 msgr2=0x7f1410071b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:59.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.514+0000 7f1429f47640 1 --2- 172.21.15.50:0/2341734019 >> [v2:172.21.15.97:6816/899031308,v1:172.21.15.97:6817/899031308] conn(0x7f141006f6f0 0x7f1410071b10 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:59.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.514+0000 7f1429f47640 1 -- 172.21.15.50:0/2341734019 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f1410067470 msgr2=0x7f1410069930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:59.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.514+0000 7f1429f47640 1 --2- 172.21.15.50:0/2341734019 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f1410067470 0x7f1410069930 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1414001b80 tx=0x7f1414001b10 comp rx=0 tx=0).stop 2024-04-01T01:55:59.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.514+0000 7f1429f47640 1 -- 172.21.15.50:0/2341734019 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14240c76f0 msgr2=0x7f1424153e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:59.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.514+0000 7f1429f47640 1 --2- 172.21.15.50:0/2341734019 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14240c76f0 0x7f1424153e10 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f141c0af040 tx=0x7f141c019680 comp rx=0 tx=0).stop 2024-04-01T01:55:59.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.514+0000 7f1429746640 1 -- 172.21.15.50:0/2341734019 reap_dead start 2024-04-01T01:55:59.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.514+0000 7f1429f47640 1 -- 172.21.15.50:0/2341734019 shutdown_connections 2024-04-01T01:55:59.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.514+0000 7f1429f47640 1 -- 172.21.15.50:0/2341734019 >> 172.21.15.50:0/2341734019 conn(0x7f1424070ef0 msgr2=0x7f14240cb310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:55:59.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.522+0000 7f1429f47640 1 -- 172.21.15.50:0/2341734019 shutdown_connections 2024-04-01T01:55:59.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.522+0000 7f1429f47640 1 -- 172.21.15.50:0/2341734019 wait complete. 2024-04-01T01:55:59.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.522+0000 7f8a53521640 1 -- 172.21.15.50:0/1002595018 --> [v2:172.21.15.97:6824/2224814961,v1:172.21.15.97:6825/2224814961] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8a34002d60 con 0x7f8a3006f6a0 2024-04-01T01:55:59.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.522+0000 7f8a42ffd640 1 -- 172.21.15.50:0/1002595018 <== osd.6 v2:172.21.15.97:6824/2224814961 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f8a34002d60 con 0x7f8a3006f6a0 2024-04-01T01:55:59.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.526+0000 7f7fc8b77640 1 -- 172.21.15.50:0/2170949035 --> [v2:172.21.15.50:6816/871680805,v1:172.21.15.50:6817/871680805] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7fa8002d60 con 0x7f7fa406f6d0 2024-04-01T01:55:59.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.526+0000 7f7fc0ff9640 1 -- 172.21.15.50:0/2170949035 <== osd.3 v2:172.21.15.50:6816/871680805 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f7fa8002d60 con 0x7f7fa406f6d0 2024-04-01T01:55:59.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.526+0000 7f8a53521640 1 -- 172.21.15.50:0/1002595018 >> [v2:172.21.15.97:6824/2224814961,v1:172.21.15.97:6825/2224814961] conn(0x7f8a3006f6a0 msgr2=0x7f8a30071ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:59.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.526+0000 7f8a53521640 1 --2- 172.21.15.50:0/1002595018 >> [v2:172.21.15.97:6824/2224814961,v1:172.21.15.97:6825/2224814961] conn(0x7f8a3006f6a0 0x7f8a30071ac0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:59.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.526+0000 7f8a53521640 1 -- 172.21.15.50:0/1002595018 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f8a30067420 msgr2=0x7f8a300698e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:59.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.526+0000 7f8a53521640 1 --2- 172.21.15.50:0/1002595018 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f8a30067420 0x7f8a300698e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c009950 tx=0x7f8a3c008040 comp rx=0 tx=0).stop 2024-04-01T01:55:59.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.526+0000 7f8a53521640 1 -- 172.21.15.50:0/1002595018 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8a440db160 msgr2=0x7f8a4417da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:59.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.526+0000 7f8a53521640 1 --2- 172.21.15.50:0/1002595018 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8a440db160 0x7f8a4417da10 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c0688e0 tx=0x7f8a4c068d10 comp rx=0 tx=0).stop 2024-04-01T01:55:59.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.526+0000 7f7fc8b77640 1 -- 172.21.15.50:0/2170949035 >> [v2:172.21.15.50:6816/871680805,v1:172.21.15.50:6817/871680805] conn(0x7f7fa406f6d0 msgr2=0x7f7fa4071af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:59.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.526+0000 7f8a52d20640 1 -- 172.21.15.50:0/1002595018 reap_dead start 2024-04-01T01:55:59.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.526+0000 7f7fc8b77640 1 --2- 172.21.15.50:0/2170949035 >> [v2:172.21.15.50:6816/871680805,v1:172.21.15.50:6817/871680805] conn(0x7f7fa406f6d0 0x7f7fa4071af0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:59.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.526+0000 7f7fc8b77640 1 -- 172.21.15.50:0/2170949035 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f7fa4067450 msgr2=0x7f7fa4069910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:59.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.526+0000 7f7fc8b77640 1 --2- 172.21.15.50:0/2170949035 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f7fa4067450 0x7f7fa4069910 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7fb4001000 tx=0x7f7fb4001b50 comp rx=0 tx=0).stop 2024-04-01T01:55:59.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.526+0000 7f7fc8b77640 1 -- 172.21.15.50:0/2170949035 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7fc41f7830 msgr2=0x7f7fc40cbac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:59.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.526+0000 7f7fc8b77640 1 --2- 172.21.15.50:0/2170949035 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7fc41f7830 0x7f7fc40cbac0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7fac00e830 tx=0x7f7fac00ecf0 comp rx=0 tx=0).stop 2024-04-01T01:55:59.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.526+0000 7f7fc3fff640 1 -- 172.21.15.50:0/2170949035 reap_dead start 2024-04-01T01:55:59.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.526+0000 7f8a53521640 1 -- 172.21.15.50:0/1002595018 shutdown_connections 2024-04-01T01:55:59.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.526+0000 7f8a53521640 1 -- 172.21.15.50:0/1002595018 >> 172.21.15.50:0/1002595018 conn(0x7f8a44050a20 msgr2=0x7f8a440da440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:55:59.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.526+0000 7f7fc8b77640 1 -- 172.21.15.50:0/2170949035 shutdown_connections 2024-04-01T01:55:59.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.526+0000 7f7fc8b77640 1 -- 172.21.15.50:0/2170949035 >> 172.21.15.50:0/2170949035 conn(0x7f7fc406b220 msgr2=0x7f7fc415bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:55:59.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.526+0000 7f7fc8b77640 1 -- 172.21.15.50:0/2170949035 shutdown_connections 2024-04-01T01:55:59.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.526+0000 7f7fc8b77640 1 -- 172.21.15.50:0/2170949035 wait complete. 2024-04-01T01:55:59.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.526+0000 7f8a53521640 1 -- 172.21.15.50:0/1002595018 shutdown_connections 2024-04-01T01:55:59.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.526+0000 7f8a53521640 1 -- 172.21.15.50:0/1002595018 wait complete. 2024-04-01T01:55:59.600 INFO:teuthology.orchestra.run.smithi050.stdout:64424509448 2024-04-01T01:55:59.600 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-01T01:55:59.601 INFO:teuthology.orchestra.run.smithi050.stdout:64424509446 2024-04-01T01:55:59.601 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-01T01:55:59.602 INFO:teuthology.orchestra.run.smithi050.stdout:64424509447 2024-04-01T01:55:59.602 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-01T01:55:59.603 INFO:teuthology.orchestra.run.smithi050.stdout:64424509447 2024-04-01T01:55:59.603 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-01T01:55:59.604 INFO:teuthology.orchestra.run.smithi050.stdout:64424509447 2024-04-01T01:55:59.604 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-01T01:55:59.605 INFO:teuthology.orchestra.run.smithi050.stdout:55834574855 2024-04-01T01:55:59.605 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-01T01:55:59.606 INFO:teuthology.orchestra.run.smithi050.stdout:64424509446 2024-04-01T01:55:59.606 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-01T01:55:59.607 INFO:teuthology.orchestra.run.smithi050.stdout:60129542150 2024-04-01T01:55:59.607 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-01T01:55:59.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.802+0000 7f23eda47640 1 Processor -- start 2024-04-01T01:55:59.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.802+0000 7f23eda47640 1 -- start start 2024-04-01T01:55:59.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.806+0000 7f23eda47640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f23e8072170 0x7f23e80c7a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.806+0000 7f23eda47640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f23e80728e0 0x7f23e80c7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.806+0000 7f23eda47640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23e8156c60 con 0x7f23e8150010 2024-04-01T01:55:59.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.806+0000 7f23eda47640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f23e80c8780 con 0x7f23e80728e0 2024-04-01T01:55:59.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.806+0000 7f23eda47640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f23e815a260 con 0x7f23e8072170 2024-04-01T01:55:59.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.806+0000 7f23e77fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f23e80728e0 0x7f23e80c7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:59.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.806+0000 7f23e6ffd640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f23e8150010 0x7f23e8156550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44596/0 (socket says 172.21.15.50:44596) 2024-04-01T01:55:59.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.806+0000 7f23e6ffd640 1 -- 172.21.15.50:0/3360071244 learned_addr learned my addr 172.21.15.50:0/3360071244 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-04-01T01:55:59.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.806+0000 7f23e67fc640 1 --2- 172.21.15.50:0/3360071244 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f23e8072170 0x7f23e80c7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:59.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.806+0000 7f23e77fe640 1 -- 172.21.15.50:0/3360071244 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f23e8072170 msgr2=0x7f23e80c7a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:55:59.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.806+0000 7f23e77fe640 1 --2- 172.21.15.50:0/3360071244 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f23e8072170 0x7f23e80c7a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:59.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.806+0000 7f23e77fe640 1 -- 172.21.15.50:0/3360071244 >> v1:172.21.15.50:6789/0 conn(0x7f23e8150010 legacy=0x7f23e8156550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:59.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.806+0000 7f23e77fe640 1 -- 172.21.15.50:0/3360071244 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23e81503f0 con 0x7f23e80728e0 2024-04-01T01:55:59.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.806+0000 7f23e67fc640 1 --2- 172.21.15.50:0/3360071244 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f23e8072170 0x7f23e80c7a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T01:55:59.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.810+0000 7f23e77fe640 1 --2- 172.21.15.50:0/3360071244 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23e80728e0 0x7f23e80c7fc0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f23dc0097c0 tx=0x7f23dc01c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5467fd8d9cd01094 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:59.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.810+0000 7f23e5ffb640 1 -- 172.21.15.50:0/3360071244 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23dc0b0070 con 0x7f23e80728e0 2024-04-01T01:55:59.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.810+0000 7f23e5ffb640 1 -- 172.21.15.50:0/3360071244 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23dc0ab600 con 0x7f23e80728e0 2024-04-01T01:55:59.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.810+0000 7f23e5ffb640 1 -- 172.21.15.50:0/3360071244 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23dc0ab9d0 con 0x7f23e80728e0 2024-04-01T01:55:59.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.810+0000 7f23eda47640 1 -- 172.21.15.50:0/3360071244 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23e80728e0 msgr2=0x7f23e80c7fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:59.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.810+0000 7f23eda47640 1 --2- 172.21.15.50:0/3360071244 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23e80728e0 0x7f23e80c7fc0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f23dc0097c0 tx=0x7f23dc01c330 comp rx=0 tx=0).stop 2024-04-01T01:55:59.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.810+0000 7f23eda47640 1 -- 172.21.15.50:0/3360071244 shutdown_connections 2024-04-01T01:55:59.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.810+0000 7f23eda47640 1 --2- 172.21.15.50:0/3360071244 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23e80728e0 0x7f23e80c7fc0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:59.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.810+0000 7f23eda47640 1 --2- 172.21.15.50:0/3360071244 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f23e8072170 0x7f23e80c7a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:59.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.810+0000 7f23eda47640 1 -- 172.21.15.50:0/3360071244 >> 172.21.15.50:0/3360071244 conn(0x7f23e806b220 msgr2=0x7f23e806b630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:55:59.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.810+0000 7f23eda47640 1 -- 172.21.15.50:0/3360071244 shutdown_connections 2024-04-01T01:55:59.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.810+0000 7f23eda47640 1 -- 172.21.15.50:0/3360071244 wait complete. 2024-04-01T01:55:59.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.814+0000 7f9ceedaa640 1 Processor -- start 2024-04-01T01:55:59.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.814+0000 7f9ceedaa640 1 -- start start 2024-04-01T01:55:59.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.814+0000 7f23eda47640 1 Processor -- start 2024-04-01T01:55:59.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.814+0000 7f23eda47640 1 -- start start 2024-04-01T01:55:59.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.814+0000 7f9ceedaa640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9ce8151f40 0x7f9ce806f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.814+0000 7f9ceedaa640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f9ce806fe60 0x7f9ce80c6d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.814+0000 7f9ceedaa640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ce8072490 con 0x7f9ce80c7250 2024-04-01T01:55:59.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.814+0000 7f9ceedaa640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f9ce80c76c0 con 0x7f9ce806fe60 2024-04-01T01:55:59.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.814+0000 7f9ceedaa640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f9ce8070290 con 0x7f9ce8151f40 2024-04-01T01:55:59.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.814+0000 7f9cee5a9640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f9ce80c7250 0x7f9ce8157c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44612/0 (socket says 172.21.15.50:44612) 2024-04-01T01:55:59.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.814+0000 7f9cee5a9640 1 -- 172.21.15.50:0/3568356354 learned_addr learned my addr 172.21.15.50:0/3568356354 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-04-01T01:55:59.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.814+0000 7f9cedda8640 1 --2- 172.21.15.50:0/3568356354 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9ce8151f40 0x7f9ce806f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:59.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.814+0000 7f9ced5a7640 1 --2- 172.21.15.50:0/3568356354 >> v2:172.21.15.97:3300/0 conn(0x7f9ce806fe60 0x7f9ce80c6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:59.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.814+0000 7f23eda47640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f23e8072170 0x7f23e8155080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.814+0000 7f23eda47640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f23e80728e0 0x7f23e8150610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.814+0000 7f23eda47640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23e8150010 0x7f23e814c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.814+0000 7f23eda47640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f23e80c6480 con 0x7f23e8150010 2024-04-01T01:55:59.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.814+0000 7f23eda47640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f23e8155d00 con 0x7f23e8072170 2024-04-01T01:55:59.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.814+0000 7f23eda47640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f23e8160680 con 0x7f23e80728e0 2024-04-01T01:55:59.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.814+0000 7f9cecda6640 1 -- 172.21.15.50:0/3568356354 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 668923180 0 0) 0x7f9ce8072490 con 0x7f9ce80c7250 2024-04-01T01:55:59.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.814+0000 7f9cecda6640 1 -- 172.21.15.50:0/3568356354 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9cd4003530 con 0x7f9ce80c7250 2024-04-01T01:55:59.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.814+0000 7f23e67fc640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f23e80728e0 0x7f23e8150610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:59.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.814+0000 7f23e67fc640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f23e80728e0 0x7f23e8150610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.50:54258/0 (socket says 172.21.15.50:54258) 2024-04-01T01:55:59.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.814+0000 7f23e67fc640 1 -- 172.21.15.50:0/1881289167 learned_addr learned my addr 172.21.15.50:0/1881289167 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T01:55:59.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.814+0000 7f23e77fe640 1 --2- 172.21.15.50:0/1881289167 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23e8150010 0x7f23e814c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:59.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.814+0000 7f23e6ffd640 1 --2- 172.21.15.50:0/1881289167 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f23e8072170 0x7f23e8155080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:59.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.814+0000 7f70371b4640 1 Processor -- start 2024-04-01T01:55:59.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.814+0000 7f70371b4640 1 -- start start 2024-04-01T01:55:59.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.814+0000 7f23e77fe640 1 -- 172.21.15.50:0/1881289167 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f23e80728e0 msgr2=0x7f23e8150610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:59.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.814+0000 7f23e77fe640 1 --2- 172.21.15.50:0/1881289167 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f23e80728e0 0x7f23e8150610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:59.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.814+0000 7f23e77fe640 1 -- 172.21.15.50:0/1881289167 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f23e8072170 msgr2=0x7f23e8155080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:59.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.814+0000 7f23e77fe640 1 --2- 172.21.15.50:0/1881289167 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f23e8072170 0x7f23e8155080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:59.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.814+0000 7f23e77fe640 1 -- 172.21.15.50:0/1881289167 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23e81eee00 con 0x7f23e8150010 2024-04-01T01:55:59.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.814+0000 7f23e6ffd640 1 --2- 172.21.15.50:0/1881289167 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f23e8072170 0x7f23e8155080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T01:55:59.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.814+0000 7f23e67fc640 1 --2- 172.21.15.50:0/1881289167 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f23e80728e0 0x7f23e8150610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T01:55:59.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.814+0000 7f9cedda8640 1 -- 172.21.15.50:0/3568356354 >> v2:172.21.15.97:3300/0 conn(0x7f9ce806fe60 msgr2=0x7f9ce80c6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:55:59.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.814+0000 7f9cedda8640 1 --2- 172.21.15.50:0/3568356354 >> v2:172.21.15.97:3300/0 conn(0x7f9ce806fe60 0x7f9ce80c6d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:59.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.814+0000 7f9cedda8640 1 -- 172.21.15.50:0/3568356354 >> v1:172.21.15.50:6789/0 conn(0x7f9ce80c7250 legacy=0x7f9ce8157c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:59.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.814+0000 7f9cedda8640 1 -- 172.21.15.50:0/3568356354 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ce8072770 con 0x7f9ce8151f40 2024-04-01T01:55:59.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.814+0000 7f23e77fe640 1 --2- 172.21.15.50:0/1881289167 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23e8150010 0x7f23e814c0b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f23dc0ab000 tx=0x7f23dc0190d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:59.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.814+0000 7f70371b4640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f70300c6e00 0x7f70300c5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.814+0000 7f70371b4640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f70300c64f0 0x7f703015e810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.814+0000 7f70371b4640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7030161b60 con 0x7f7030158360 2024-04-01T01:55:59.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.814+0000 7f70371b4640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f70301626e0 con 0x7f70300c64f0 2024-04-01T01:55:59.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.814+0000 7f70371b4640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f7030161e40 con 0x7f70300c6e00 2024-04-01T01:55:59.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.814+0000 7f23cffff640 1 -- 172.21.15.50:0/1881289167 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23dc0ba070 con 0x7f23e8150010 2024-04-01T01:55:59.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.814+0000 7f23cffff640 1 -- 172.21.15.50:0/1881289167 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23dc0b43f0 con 0x7f23e8150010 2024-04-01T01:55:59.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.814+0000 7f23cffff640 1 -- 172.21.15.50:0/1881289167 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23dc0b0040 con 0x7f23e8150010 2024-04-01T01:55:59.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.814+0000 7f23eda47640 1 -- 172.21.15.50:0/1881289167 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23e81ef0a0 con 0x7f23e8150010 2024-04-01T01:55:59.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.814+0000 7f70359b1640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f70300c6e00 0x7f70300c5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:59.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.814+0000 7f70359b1640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f70300c6e00 0x7f70300c5fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.50:54260/0 (socket says 172.21.15.50:54260) 2024-04-01T01:55:59.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.814+0000 7f70359b1640 1 -- 172.21.15.50:0/3584933347 learned_addr learned my addr 172.21.15.50:0/3584933347 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T01:55:59.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.814+0000 7f70369b3640 1 --2- 172.21.15.50:0/3584933347 >> v2:172.21.15.97:3300/0 conn(0x7f70300c64f0 0x7f703015e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:59.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.818+0000 7f23eda47640 1 -- 172.21.15.50:0/1881289167 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23e81ef660 con 0x7f23e8150010 2024-04-01T01:55:59.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.818+0000 7f70359b1640 1 -- 172.21.15.50:0/3584933347 >> v2:172.21.15.97:3300/0 conn(0x7f70300c64f0 msgr2=0x7f703015e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:55:59.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.818+0000 7f70359b1640 1 --2- 172.21.15.50:0/3584933347 >> v2:172.21.15.97:3300/0 conn(0x7f70300c64f0 0x7f703015e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:59.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.818+0000 7f70359b1640 1 -- 172.21.15.50:0/3584933347 >> v1:172.21.15.97:6789/0 conn(0x7f7030158360 legacy=0x7f70300c8270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:59.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.818+0000 7f70359b1640 1 -- 172.21.15.50:0/3584933347 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7030162120 con 0x7f70300c6e00 2024-04-01T01:55:59.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.818+0000 7f23eda47640 1 -- 172.21.15.50:0/1881289167 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23e804f4c0 con 0x7f23e8150010 2024-04-01T01:55:59.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.818+0000 7f9cedda8640 1 --2- 172.21.15.50:0/3568356354 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9ce8151f40 0x7f9ce806f920 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9ce40097c0 tx=0x7f9ce401c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=437d3c82182b4f67 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:59.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.818+0000 7f9cecda6640 1 -- 172.21.15.50:0/3568356354 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ce40b1070 con 0x7f9ce8151f40 2024-04-01T01:55:59.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.818+0000 7f9cecda6640 1 -- 172.21.15.50:0/3568356354 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ce40ac410 con 0x7f9ce8151f40 2024-04-01T01:55:59.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.818+0000 7f9cecda6640 1 -- 172.21.15.50:0/3568356354 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ce40ac800 con 0x7f9ce8151f40 2024-04-01T01:55:59.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.818+0000 7f9ceedaa640 1 -- 172.21.15.50:0/3568356354 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9ce8151f40 msgr2=0x7f9ce806f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:59.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.818+0000 7f9ceedaa640 1 --2- 172.21.15.50:0/3568356354 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9ce8151f40 0x7f9ce806f920 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9ce40097c0 tx=0x7f9ce401c4c0 comp rx=0 tx=0).stop 2024-04-01T01:55:59.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.818+0000 7f088734a640 1 Processor -- start 2024-04-01T01:55:59.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.818+0000 7f8f4f7ab640 1 Processor -- start 2024-04-01T01:55:59.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.818+0000 7f8f4f7ab640 1 -- start start 2024-04-01T01:55:59.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.818+0000 7f088734a640 1 -- start start 2024-04-01T01:55:59.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.818+0000 7f088734a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f08800cc5c0 0x7f08800c8520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.818+0000 7f088734a640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f08800cc9a0 0x7f08800c9700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.818+0000 7f088734a640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08800c8f40 con 0x7f08800c7fd0 2024-04-01T01:55:59.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.818+0000 7f088734a640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f08800c3ab0 con 0x7f08800cc9a0 2024-04-01T01:55:59.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.818+0000 7f088734a640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f08800c3d90 con 0x7f08800cc5c0 2024-04-01T01:55:59.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.818+0000 7f9ceedaa640 1 -- 172.21.15.50:0/3568356354 shutdown_connections 2024-04-01T01:55:59.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.818+0000 7f9ceedaa640 1 --2- 172.21.15.50:0/3568356354 >> v2:172.21.15.97:3300/0 conn(0x7f9ce806fe60 0x7f9ce80c6d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:59.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.818+0000 7f9ceedaa640 1 --2- 172.21.15.50:0/3568356354 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9ce8151f40 0x7f9ce806f920 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:59.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.818+0000 7f9ceedaa640 1 -- 172.21.15.50:0/3568356354 >> 172.21.15.50:0/3568356354 conn(0x7f9ce80c8f10 msgr2=0x7f9ce80c92f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:55:59.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.818+0000 7f23cffff640 1 -- 172.21.15.50:0/1881289167 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 87103+0+0 (secure 0 0 0) 0x7f23dc0bd070 con 0x7f23e8150010 2024-04-01T01:55:59.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.818+0000 7f23cffff640 1 --2- 172.21.15.50:0/1881289167 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f23d4067520 0x7f23d40699e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.818+0000 7f23cffff640 1 -- 172.21.15.50:0/1881289167 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f23dc11e790 con 0x7f23e8150010 2024-04-01T01:55:59.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.818+0000 7f8f4f7ab640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f8f48150f20 0x7f8f48072530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.818+0000 7f9ceedaa640 1 -- 172.21.15.50:0/3568356354 shutdown_connections 2024-04-01T01:55:59.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.818+0000 7f08850e6640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f08800cc5c0 0x7f08800c8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:59.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.818+0000 7f08850e6640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f08800cc5c0 0x7f08800c8520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.50:54270/0 (socket says 172.21.15.50:54270) 2024-04-01T01:55:59.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.818+0000 7f08850e6640 1 -- 172.21.15.50:0/2661889307 learned_addr learned my addr 172.21.15.50:0/2661889307 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T01:55:59.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.818+0000 7f9ceedaa640 1 -- 172.21.15.50:0/3568356354 wait complete. 2024-04-01T01:55:59.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.818+0000 7f23e6ffd640 1 --2- 172.21.15.50:0/1881289167 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f23d4067520 0x7f23d40699e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:59.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.818+0000 7f08848e5640 1 --2- 172.21.15.50:0/2661889307 >> v2:172.21.15.97:3300/0 conn(0x7f08800cc9a0 0x7f08800c9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:59.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.818+0000 7f4dea13a640 1 Processor -- start 2024-04-01T01:55:59.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.822+0000 7f8f4d547640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f8f48150f20 0x7f8f48072530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:59.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.822+0000 7f8f4f7ab640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8f480c7f30 0x7f8f480c3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.822+0000 7f4dea13a640 1 -- start start 2024-04-01T01:55:59.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.822+0000 7f70359b1640 1 --2- 172.21.15.50:0/3584933347 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f70300c6e00 0x7f70300c5fb0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f702c009870 tx=0x7f702c01c5a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a97ff0277706857 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:59.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.822+0000 7f23e6ffd640 1 --2- 172.21.15.50:0/1881289167 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f23d4067520 0x7f23d40699e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f23d8000c10 tx=0x7f23d8007e10 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:59.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.822+0000 7fc50b59e640 1 Processor -- start 2024-04-01T01:55:59.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.822+0000 7f08850e6640 1 -- 172.21.15.50:0/2661889307 >> v2:172.21.15.97:3300/0 conn(0x7f08800cc9a0 msgr2=0x7f08800c9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:55:59.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.822+0000 7f08850e6640 1 --2- 172.21.15.50:0/2661889307 >> v2:172.21.15.97:3300/0 conn(0x7f08800cc9a0 0x7f08800c9700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:59.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.822+0000 7f08850e6640 1 -- 172.21.15.50:0/2661889307 >> v1:172.21.15.97:6789/0 conn(0x7f08800c7fd0 legacy=0x7f0880150950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:55:59.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.822+0000 7f08850e6640 1 -- 172.21.15.50:0/2661889307 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08800c91e0 con 0x7f08800cc5c0 2024-04-01T01:55:59.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.822+0000 7f70351b0640 1 -- 172.21.15.50:0/3584933347 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f702c0a7070 con 0x7f70300c6e00 2024-04-01T01:55:59.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.822+0000 7f70351b0640 1 -- 172.21.15.50:0/3584933347 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f702c0b0070 con 0x7f70300c6e00 2024-04-01T01:55:59.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.822+0000 7f70351b0640 1 -- 172.21.15.50:0/3584933347 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f702c0ab890 con 0x7f70300c6e00 2024-04-01T01:55:59.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.822+0000 7f4dea13a640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4de415e1e0 0x7f4de406b220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.822+0000 7f4dea13a640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f4de406b760 0x7f4de4072bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.822+0000 7f4dea13a640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4de415e800 con 0x7f4de41585c0 2024-04-01T01:55:59.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.822+0000 7f4dea13a640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f4de41589a0 con 0x7f4de415e1e0 2024-04-01T01:55:59.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.822+0000 7f4dea13a640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f4de4072760 con 0x7f4de406b760 2024-04-01T01:55:59.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.822+0000 7f9ceedaa640 1 Processor -- start 2024-04-01T01:55:59.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.822+0000 7fc50b59e640 1 -- start start 2024-04-01T01:55:59.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.822+0000 7f9ceedaa640 1 -- start start 2024-04-01T01:55:59.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.822+0000 7f8f4d547640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f8f48150f20 0x7f8f48072530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.50:35768/0 (socket says 172.21.15.50:35768) 2024-04-01T01:55:59.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.822+0000 7f8f4d547640 1 -- 172.21.15.50:0/3338857591 learned_addr learned my addr 172.21.15.50:0/3338857591 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T01:55:59.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.822+0000 7f8f4f7ab640 1 -- 172.21.15.50:0/3338857591 --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f48151300 con 0x7f8f480c3a60 2024-04-01T01:55:59.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.822+0000 7f8f4f7ab640 1 -- 172.21.15.50:0/3338857591 --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f8f48072a70 con 0x7f8f480c7f30 2024-04-01T01:55:59.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.822+0000 7f8f4f7ab640 1 -- 172.21.15.50:0/3338857591 --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f8f480c8a40 con 0x7f8f48150f20 2024-04-01T01:55:59.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.822+0000 7f8f4dd48640 1 --2- 172.21.15.50:0/3338857591 >> v2:172.21.15.50:3300/0 conn(0x7f8f480c7f30 0x7f8f480c3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:59.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.822+0000 7f4de9939640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f4de406b760 0x7f4de4072bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:59.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.822+0000 7f4de9939640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f4de406b760 0x7f4de4072bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.50:35784/0 (socket says 172.21.15.50:35784) 2024-04-01T01:55:59.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.822+0000 7f4de9939640 1 -- 172.21.15.50:0/1617778890 learned_addr learned my addr 172.21.15.50:0/1617778890 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T01:55:59.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.822+0000 7fc50b59e640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fc50c158360 0x7fc50c0c8270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.822+0000 7f70371b4640 1 -- 172.21.15.50:0/3584933347 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f70300c6e00 msgr2=0x7f70300c5fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:59.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.822+0000 7f70371b4640 1 --2- 172.21.15.50:0/3584933347 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f70300c6e00 0x7f70300c5fb0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f702c009870 tx=0x7f702c01c5a0 comp rx=0 tx=0).stop 2024-04-01T01:55:59.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.822+0000 7f70371b4640 1 -- 172.21.15.50:0/3584933347 shutdown_connections 2024-04-01T01:55:59.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.822+0000 7f70371b4640 1 --2- 172.21.15.50:0/3584933347 >> v2:172.21.15.97:3300/0 conn(0x7f70300c64f0 0x7f703015e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:59.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.822+0000 7f70371b4640 1 --2- 172.21.15.50:0/3584933347 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f70300c6e00 0x7f70300c5fb0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:59.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.822+0000 7f70371b4640 1 -- 172.21.15.50:0/3584933347 >> 172.21.15.50:0/3584933347 conn(0x7f703006b220 msgr2=0x7f703006b630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:55:59.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.822+0000 7f70371b4640 1 -- 172.21.15.50:0/3584933347 shutdown_connections 2024-04-01T01:55:59.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.822+0000 7fc50b59e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc50c0c87b0 con 0x7fc50c0c6e00 2024-04-01T01:55:59.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.822+0000 7fc50b59e640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc50c161b60 con 0x7fc50c15e810 2024-04-01T01:55:59.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.822+0000 7fc50b59e640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fc50c1626e0 con 0x7fc50c158360 2024-04-01T01:55:59.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.822+0000 7fc50a59c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fc50c158360 0x7fc50c0c8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:59.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.822+0000 7fc50a59c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fc50c158360 0x7fc50c0c8270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.50:35786/0 (socket says 172.21.15.50:35786) 2024-04-01T01:55:59.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.822+0000 7fc50a59c640 1 -- 172.21.15.50:0/2671193544 learned_addr learned my addr 172.21.15.50:0/2671193544 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T01:55:59.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.822+0000 7fc50a59c640 1 -- 172.21.15.50:0/2671193544 >> v1:172.21.15.97:6789/0 conn(0x7fc50c15e810 legacy=0x7fc50c168ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:59.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.822+0000 7fc50a59c640 1 -- 172.21.15.50:0/2671193544 >> v1:172.21.15.50:6789/0 conn(0x7fc50c0c6e00 legacy=0x7fc50c0c5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:59.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.822+0000 7f08850e6640 1 --2- 172.21.15.50:0/2661889307 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f08800cc5c0 0x7f08800c8520 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f087c009870 tx=0x7f087c01c520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa105207a2b5a0f4 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:59.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.822+0000 7fc50a59c640 1 -- 172.21.15.50:0/2671193544 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc50c161e40 con 0x7fc50c158360 2024-04-01T01:55:59.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.822+0000 7f8f4d547640 1 -- 172.21.15.50:0/3338857591 >> v2:172.21.15.50:3300/0 conn(0x7f8f480c7f30 msgr2=0x7f8f480c3ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:55:59.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.822+0000 7f8f4d547640 1 --2- 172.21.15.50:0/3338857591 >> v2:172.21.15.50:3300/0 conn(0x7f8f480c7f30 0x7f8f480c3ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:59.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.822+0000 7f8f4d547640 1 -- 172.21.15.50:0/3338857591 >> v1:172.21.15.50:6789/0 conn(0x7f8f480c3a60 legacy=0x7f8f480c7820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:59.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.822+0000 7f8f4d547640 1 -- 172.21.15.50:0/3338857591 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f480c8d20 con 0x7f8f48150f20 2024-04-01T01:55:59.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.822+0000 7f70371b4640 1 -- 172.21.15.50:0/3584933347 wait complete. 2024-04-01T01:55:59.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.826+0000 7f70371b4640 1 Processor -- start 2024-04-01T01:55:59.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.826+0000 7f0877fff640 1 -- 172.21.15.50:0/2661889307 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f087c0b0070 con 0x7f08800cc5c0 2024-04-01T01:55:59.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.826+0000 7f0877fff640 1 -- 172.21.15.50:0/2661889307 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f087c0ab600 con 0x7f08800cc5c0 2024-04-01T01:55:59.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.826+0000 7f0877fff640 1 -- 172.21.15.50:0/2661889307 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f087c0ab9d0 con 0x7f08800cc5c0 2024-04-01T01:55:59.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.826+0000 7f088734a640 1 -- 172.21.15.50:0/2661889307 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f08800cc5c0 msgr2=0x7f08800c8520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:59.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.826+0000 7f088734a640 1 --2- 172.21.15.50:0/2661889307 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f08800cc5c0 0x7f08800c8520 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f087c009870 tx=0x7f087c01c520 comp rx=0 tx=0).stop 2024-04-01T01:55:59.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.826+0000 7f088734a640 1 -- 172.21.15.50:0/2661889307 shutdown_connections 2024-04-01T01:55:59.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.826+0000 7f088734a640 1 --2- 172.21.15.50:0/2661889307 >> v2:172.21.15.97:3300/0 conn(0x7f08800cc9a0 0x7f08800c9700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:59.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.826+0000 7f088734a640 1 --2- 172.21.15.50:0/2661889307 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f08800cc5c0 0x7f08800c8520 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:59.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.826+0000 7f088734a640 1 -- 172.21.15.50:0/2661889307 >> 172.21.15.50:0/2661889307 conn(0x7f0880067560 msgr2=0x7f088006c330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:55:59.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.822+0000 7f9ceedaa640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9ce80c7250 0x7f9ce8155290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.822+0000 7f9ceedaa640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ce8151f40 0x7f9ce8144280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.822+0000 7f9ceedaa640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9ce8156d60 0x7f9ce81fb780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.822+0000 7f9ceedaa640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9ce80c9b90 con 0x7f9ce8151f40 2024-04-01T01:55:59.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.822+0000 7f9ceedaa640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f9ce8152320 con 0x7f9ce8156d60 2024-04-01T01:55:59.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.822+0000 7f9ceedaa640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f9ce80c9d10 con 0x7f9ce80c7250 2024-04-01T01:55:59.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.822+0000 7f9cee5a9640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9ce8156d60 0x7f9ce81fb780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:59.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.822+0000 7f9cee5a9640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9ce8156d60 0x7f9ce81fb780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.50:35788/0 (socket says 172.21.15.50:35788) 2024-04-01T01:55:59.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.822+0000 7f9cee5a9640 1 -- 172.21.15.50:0/2347993976 learned_addr learned my addr 172.21.15.50:0/2347993976 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T01:55:59.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.822+0000 7f9cee5a9640 1 -- 172.21.15.50:0/2347993976 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9ce80c7250 msgr2=0x7f9ce8155290 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-01T01:55:59.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.822+0000 7f9cee5a9640 1 --2- 172.21.15.50:0/2347993976 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9ce80c7250 0x7f9ce8155290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:59.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.822+0000 7f9cee5a9640 1 -- 172.21.15.50:0/2347993976 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ce8151f40 msgr2=0x7f9ce8144280 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-01T01:55:59.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.822+0000 7f9cee5a9640 1 --2- 172.21.15.50:0/2347993976 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ce8151f40 0x7f9ce8144280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:59.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.822+0000 7f9cee5a9640 1 -- 172.21.15.50:0/2347993976 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ce8153260 con 0x7f9ce8156d60 2024-04-01T01:55:59.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.822+0000 7f9cee5a9640 1 --2- 172.21.15.50:0/2347993976 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9ce8156d60 0x7f9ce81fb780 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9ce000cb10 tx=0x7f9ce000a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:59.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.826+0000 7f9cde7fc640 1 -- 172.21.15.50:0/2347993976 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ce0028070 con 0x7f9ce8156d60 2024-04-01T01:55:59.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.826+0000 7f9cde7fc640 1 -- 172.21.15.50:0/2347993976 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ce000aa70 con 0x7f9ce8156d60 2024-04-01T01:55:59.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.826+0000 7f9cde7fc640 1 -- 172.21.15.50:0/2347993976 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ce000ae40 con 0x7f9ce8156d60 2024-04-01T01:55:59.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.826+0000 7f9ceedaa640 1 -- 172.21.15.50:0/2347993976 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ce80c0520 con 0x7f9ce8156d60 2024-04-01T01:55:59.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.826+0000 7f9ceedaa640 1 -- 172.21.15.50:0/2347993976 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ce8157700 con 0x7f9ce8156d60 2024-04-01T01:55:59.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.826+0000 7f9ceedaa640 1 -- 172.21.15.50:0/2347993976 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9cd00052a0 con 0x7f9ce8156d60 2024-04-01T01:55:59.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.822+0000 7f4de9939640 1 -- 172.21.15.50:0/1617778890 >> v2:172.21.15.50:3300/0 conn(0x7f4de415e1e0 msgr2=0x7f4de406b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:55:59.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.822+0000 7f4de9939640 1 --2- 172.21.15.50:0/1617778890 >> v2:172.21.15.50:3300/0 conn(0x7f4de415e1e0 0x7f4de406b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:59.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.822+0000 7f4de9939640 1 -- 172.21.15.50:0/1617778890 >> v1:172.21.15.97:6789/0 conn(0x7f4de41585c0 legacy=0x7f4de40706f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:59.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.822+0000 7f4de9939640 1 -- 172.21.15.50:0/1617778890 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4de415eac0 con 0x7f4de406b760 2024-04-01T01:55:59.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.826+0000 7f088734a640 1 -- 172.21.15.50:0/2661889307 shutdown_connections 2024-04-01T01:55:59.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.826+0000 7f70371b4640 1 -- start start 2024-04-01T01:55:59.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.826+0000 7f70371b4640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f70300c64f0 0x7f703015ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.826+0000 7f70371b4640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f70300c6e00 0x7f703014f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.826+0000 7f70371b4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7030158360 0x7f703014f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.826+0000 7f70371b4640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f70301618c0 con 0x7f7030158360 2024-04-01T01:55:59.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.826+0000 7f70371b4640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f7030161740 con 0x7f70300c64f0 2024-04-01T01:55:59.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.826+0000 7f70371b4640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f703016b2f0 con 0x7f70300c6e00 2024-04-01T01:55:59.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.826+0000 7f088734a640 1 -- 172.21.15.50:0/2661889307 wait complete. 2024-04-01T01:55:59.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.826+0000 7f70369b3640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7030158360 0x7f703014f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:59.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.826+0000 7f70369b3640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7030158360 0x7f703014f790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50646/0 (socket says 172.21.15.50:50646) 2024-04-01T01:55:59.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.826+0000 7f70369b3640 1 -- 172.21.15.50:0/1562319720 learned_addr learned my addr 172.21.15.50:0/1562319720 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T01:55:59.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.826+0000 7f70359b1640 1 --2- 172.21.15.50:0/1562319720 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f70300c6e00 0x7f703014f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:59.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.826+0000 7f4de9939640 1 --2- 172.21.15.50:0/1617778890 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4de406b760 0x7f4de4072bf0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4de406db10 tx=0x7f4de001ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b0e7023158ea01c server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:59.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.826+0000 7f8f4d547640 1 --2- 172.21.15.50:0/3338857591 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8f48150f20 0x7f8f48072530 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8f4806cba0 tx=0x7f8f4401c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=48c7b784bca52b0d server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:59.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.826+0000 7f70369b3640 1 -- 172.21.15.50:0/1562319720 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f70300c6e00 msgr2=0x7f703014f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:59.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.826+0000 7f70369b3640 1 --2- 172.21.15.50:0/1562319720 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f70300c6e00 0x7f703014f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:59.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.826+0000 7f70369b3640 1 -- 172.21.15.50:0/1562319720 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f70300c64f0 msgr2=0x7f703015ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:59.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.826+0000 7f70369b3640 1 --2- 172.21.15.50:0/1562319720 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f70300c64f0 0x7f703015ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:59.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.826+0000 7f70369b3640 1 -- 172.21.15.50:0/1562319720 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f703014cc10 con 0x7f7030158360 2024-04-01T01:55:59.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.826+0000 7f70369b3640 1 --2- 172.21.15.50:0/1562319720 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7030158360 0x7f703014f790 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f702800efc0 tx=0x7f702800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:59.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.826+0000 7fc50a59c640 1 --2- 172.21.15.50:0/2671193544 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc50c158360 0x7fc50c0c8270 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc500009870 tx=0x7fc50001c560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=13ae66cfef0a56c server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:59.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.826+0000 7f088734a640 1 Processor -- start 2024-04-01T01:55:59.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.826+0000 7f088734a640 1 -- start start 2024-04-01T01:55:59.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.826+0000 7f9cde7fc640 1 -- 172.21.15.50:0/2347993976 <== mon.1 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) ==== 87103+0+0 (secure 0 0 0) 0x7f9ce002b070 con 0x7f9ce8156d60 2024-04-01T01:55:59.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.826+0000 7f9cde7fc640 1 --2- 172.21.15.50:0/2347993976 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f9ccc0674f0 0x7f9ccc0699b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.826+0000 7f088734a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f08800c7fd0 0x7f08800c13f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.826+0000 7f088734a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08800cc5c0 0x7f088014c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.826+0000 7f088734a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f08800cc9a0 0x7f08800c19a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.826+0000 7f088734a640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f08801511e0 con 0x7f08800cc5c0 2024-04-01T01:55:59.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.826+0000 7f088734a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f0880151060 con 0x7f08800cc9a0 2024-04-01T01:55:59.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.826+0000 7f088734a640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f0880159ff0 con 0x7f08800c7fd0 2024-04-01T01:55:59.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.826+0000 7f08848e5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08800cc5c0 0x7f088014c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:59.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.826+0000 7f9cde7fc640 1 -- 172.21.15.50:0/2347993976 <== mon.1 v2:172.21.15.97:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f9ce0096860 con 0x7f9ce8156d60 2024-04-01T01:55:59.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.826+0000 7f08848e5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08800cc5c0 0x7f088014c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50648/0 (socket says 172.21.15.50:50648) 2024-04-01T01:55:59.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.826+0000 7f08848e5640 1 -- 172.21.15.50:0/4047521787 learned_addr learned my addr 172.21.15.50:0/4047521787 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T01:55:59.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.826+0000 7f9cedda8640 1 --2- 172.21.15.50:0/2347993976 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f9ccc0674f0 0x7f9ccc0699b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:59.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.830+0000 7f08850e6640 1 --2- 172.21.15.50:0/4047521787 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f08800c7fd0 0x7f08800c13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:59.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.830+0000 7f08848e5640 1 -- 172.21.15.50:0/4047521787 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f08800c7fd0 msgr2=0x7f08800c13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:59.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.830+0000 7f08848e5640 1 --2- 172.21.15.50:0/4047521787 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f08800c7fd0 0x7f08800c13f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:59.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.830+0000 7f08848e5640 1 -- 172.21.15.50:0/4047521787 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f08800cc9a0 msgr2=0x7f08800c19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:59.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.830+0000 7f08858e7640 1 --2- 172.21.15.50:0/4047521787 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f08800cc9a0 0x7f08800c19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:59.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.830+0000 7f08848e5640 1 --2- 172.21.15.50:0/4047521787 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f08800cc9a0 0x7f08800c19a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:59.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.830+0000 7f08848e5640 1 -- 172.21.15.50:0/4047521787 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f088014c940 con 0x7f08800cc5c0 2024-04-01T01:55:59.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.830+0000 7f08858e7640 1 --2- 172.21.15.50:0/4047521787 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f08800cc9a0 0x7f08800c19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T01:55:59.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.830+0000 7f08848e5640 1 --2- 172.21.15.50:0/4047521787 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08800cc5c0 0x7f088014c400 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f087000d990 tx=0x7f087000de50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:59.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.830+0000 7f23cffff640 1 -- 172.21.15.50:0/1881289167 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+176632 (secure 0 0 0) 0x7f23dc015fb0 con 0x7f23e8150010 2024-04-01T01:55:59.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.830+0000 7f9cedda8640 1 --2- 172.21.15.50:0/2347993976 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f9ccc0674f0 0x7f9ccc0699b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9ce40ae000 tx=0x7f9ce40a6040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:59.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.830+0000 7f7026ffd640 1 -- 172.21.15.50:0/1562319720 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7028018020 con 0x7f7030158360 2024-04-01T01:55:59.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.830+0000 7f0875ffb640 1 -- 172.21.15.50:0/4047521787 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0870015020 con 0x7f08800cc5c0 2024-04-01T01:55:59.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.830+0000 7f70371b4640 1 -- 172.21.15.50:0/1562319720 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f703014cef0 con 0x7f7030158360 2024-04-01T01:55:59.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.830+0000 7f70371b4640 1 -- 172.21.15.50:0/1562319720 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f703014d4b0 con 0x7f7030158360 2024-04-01T01:55:59.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.830+0000 7f088734a640 1 -- 172.21.15.50:0/4047521787 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f088014e290 con 0x7f08800cc5c0 2024-04-01T01:55:59.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.830+0000 7f088734a640 1 -- 172.21.15.50:0/4047521787 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08801fa500 con 0x7f08800cc5c0 2024-04-01T01:55:59.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.830+0000 7f0875ffb640 1 -- 172.21.15.50:0/4047521787 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0870004440 con 0x7f08800cc5c0 2024-04-01T01:55:59.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.830+0000 7f7026ffd640 1 -- 172.21.15.50:0/1562319720 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7028014480 con 0x7f7030158360 2024-04-01T01:55:59.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.830+0000 7f7026ffd640 1 -- 172.21.15.50:0/1562319720 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7028014830 con 0x7f7030158360 2024-04-01T01:55:59.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.830+0000 7f0875ffb640 1 -- 172.21.15.50:0/4047521787 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0870007880 con 0x7f08800cc5c0 2024-04-01T01:55:59.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.830+0000 7f088734a640 1 -- 172.21.15.50:0/4047521787 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08600052a0 con 0x7f08800cc5c0 2024-04-01T01:55:59.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.830+0000 7f70371b4640 1 -- 172.21.15.50:0/1562319720 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70180052a0 con 0x7f7030158360 2024-04-01T01:55:59.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.830+0000 7f7026ffd640 1 -- 172.21.15.50:0/1562319720 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 87103+0+0 (secure 0 0 0) 0x7f702801b020 con 0x7f7030158360 2024-04-01T01:55:59.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.830+0000 7f7026ffd640 1 --2- 172.21.15.50:0/1562319720 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f7014067450 0x7f7014069910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.830+0000 7f7026ffd640 1 -- 172.21.15.50:0/1562319720 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f7028086a90 con 0x7f7030158360 2024-04-01T01:55:59.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.834+0000 7f0875ffb640 1 -- 172.21.15.50:0/4047521787 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 87103+0+0 (secure 0 0 0) 0x7f0870018020 con 0x7f08800cc5c0 2024-04-01T01:55:59.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.834+0000 7f0875ffb640 1 --2- 172.21.15.50:0/4047521787 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f0864067420 0x7f08640698e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.834+0000 7f0875ffb640 1 -- 172.21.15.50:0/4047521787 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f0870085d90 con 0x7f08800cc5c0 2024-04-01T01:55:59.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.834+0000 7f70361b2640 1 --2- 172.21.15.50:0/1562319720 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f7014067450 0x7f7014069910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:59.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.834+0000 7f08850e6640 1 --2- 172.21.15.50:0/4047521787 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f0864067420 0x7f08640698e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:59.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.834+0000 7f08850e6640 1 --2- 172.21.15.50:0/4047521787 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f0864067420 0x7f08640698e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f087c0ad000 tx=0x7f087c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:59.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.834+0000 7f70361b2640 1 --2- 172.21.15.50:0/1562319720 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f7014067450 0x7f7014069910 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7020000f70 tx=0x7f70200079c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:59.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.838+0000 7f4ddbfff640 1 -- 172.21.15.50:0/1617778890 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4de00b5070 con 0x7f4de406b760 2024-04-01T01:55:59.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.838+0000 7f4ddbfff640 1 -- 172.21.15.50:0/1617778890 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4de00a8a30 con 0x7f4de406b760 2024-04-01T01:55:59.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.838+0000 7f4ddbfff640 1 -- 172.21.15.50:0/1617778890 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4de00a8e40 con 0x7f4de406b760 2024-04-01T01:55:59.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.838+0000 7f8f3ffff640 1 -- 172.21.15.50:0/3338857591 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f440b0070 con 0x7f8f48150f20 2024-04-01T01:55:59.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.838+0000 7f8f3ffff640 1 -- 172.21.15.50:0/3338857591 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f440ab600 con 0x7f8f48150f20 2024-04-01T01:55:59.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.838+0000 7f8f3ffff640 1 -- 172.21.15.50:0/3338857591 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f440ab9d0 con 0x7f8f48150f20 2024-04-01T01:55:59.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.838+0000 7f9cde7fc640 1 -- 172.21.15.50:0/2347993976 <== mon.1 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+176632 (secure 0 0 0) 0x7f9ce0032020 con 0x7f9ce8156d60 2024-04-01T01:55:59.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.838+0000 7fc50959a640 1 -- 172.21.15.50:0/2671193544 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5000a7070 con 0x7fc50c158360 2024-04-01T01:55:59.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.838+0000 7fc50959a640 1 -- 172.21.15.50:0/2671193544 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5000b0070 con 0x7fc50c158360 2024-04-01T01:55:59.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.838+0000 7fc50959a640 1 -- 172.21.15.50:0/2671193544 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5000ab890 con 0x7fc50c158360 2024-04-01T01:55:59.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.838+0000 7f7026ffd640 1 -- 172.21.15.50:0/1562319720 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+176632 (secure 0 0 0) 0x7f7028022070 con 0x7f7030158360 2024-04-01T01:55:59.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.838+0000 7f4dea13a640 1 -- 172.21.15.50:0/1617778890 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4de406b760 msgr2=0x7f4de4072bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:59.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.838+0000 7f4dea13a640 1 --2- 172.21.15.50:0/1617778890 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4de406b760 0x7f4de4072bf0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4de406db10 tx=0x7f4de001ed30 comp rx=0 tx=0).stop 2024-04-01T01:55:59.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.838+0000 7fc50b59e640 1 -- 172.21.15.50:0/2671193544 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc50c158360 msgr2=0x7fc50c0c8270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:59.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.838+0000 7fc50b59e640 1 --2- 172.21.15.50:0/2671193544 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc50c158360 0x7fc50c0c8270 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc500009870 tx=0x7fc50001c560 comp rx=0 tx=0).stop 2024-04-01T01:55:59.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.838+0000 7fc50b59e640 1 -- 172.21.15.50:0/2671193544 shutdown_connections 2024-04-01T01:55:59.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.838+0000 7fc50b59e640 1 --2- 172.21.15.50:0/2671193544 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc50c158360 0x7fc50c0c8270 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:59.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.838+0000 7fc50b59e640 1 -- 172.21.15.50:0/2671193544 >> 172.21.15.50:0/2671193544 conn(0x7fc50c06b220 msgr2=0x7fc50c06b630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:55:59.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.838+0000 7f8f4f7ab640 1 -- 172.21.15.50:0/3338857591 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8f48150f20 msgr2=0x7f8f48072530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:59.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.838+0000 7f8f4f7ab640 1 --2- 172.21.15.50:0/3338857591 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8f48150f20 0x7f8f48072530 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8f4806cba0 tx=0x7f8f4401c510 comp rx=0 tx=0).stop 2024-04-01T01:55:59.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.838+0000 7f4dea13a640 1 -- 172.21.15.50:0/1617778890 shutdown_connections 2024-04-01T01:55:59.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.838+0000 7f4dea13a640 1 --2- 172.21.15.50:0/1617778890 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4de406b760 0x7f4de4072bf0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:59.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.838+0000 7f4dea13a640 1 --2- 172.21.15.50:0/1617778890 >> v2:172.21.15.50:3300/0 conn(0x7f4de415e1e0 0x7f4de406b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:59.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.838+0000 7f4dea13a640 1 -- 172.21.15.50:0/1617778890 >> 172.21.15.50:0/1617778890 conn(0x7f4de40c8f10 msgr2=0x7f4de40c92f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:55:59.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.838+0000 7f4dea13a640 1 -- 172.21.15.50:0/1617778890 shutdown_connections 2024-04-01T01:55:59.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.838+0000 7fc50b59e640 1 -- 172.21.15.50:0/2671193544 shutdown_connections 2024-04-01T01:55:59.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.838+0000 7f4dea13a640 1 -- 172.21.15.50:0/1617778890 wait complete. 2024-04-01T01:55:59.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.838+0000 7f4dea13a640 1 Processor -- start 2024-04-01T01:55:59.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.838+0000 7f4dea13a640 1 -- start start 2024-04-01T01:55:59.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.842+0000 7f4dea13a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4de406b760 0x7f4de4158fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.842+0000 7f4dea13a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4de41585c0 0x7f4de4155890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.842+0000 7f4dea13a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4de415e1e0 0x7f4de41f4010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.842+0000 7f4dea13a640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4de40723f0 con 0x7f4de41585c0 2024-04-01T01:55:59.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.842+0000 7f4dea13a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f4de415f080 con 0x7f4de406b760 2024-04-01T01:55:59.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.842+0000 7f4dea13a640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f4de406beb0 con 0x7f4de415e1e0 2024-04-01T01:55:59.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.838+0000 7fc50b59e640 1 -- 172.21.15.50:0/2671193544 wait complete. 2024-04-01T01:55:59.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.838+0000 7f8f4f7ab640 1 -- 172.21.15.50:0/3338857591 shutdown_connections 2024-04-01T01:55:59.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.838+0000 7f8f4f7ab640 1 --2- 172.21.15.50:0/3338857591 >> v2:172.21.15.50:3300/0 conn(0x7f8f480c7f30 0x7f8f480c3ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:59.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.838+0000 7f8f4f7ab640 1 --2- 172.21.15.50:0/3338857591 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8f48150f20 0x7f8f48072530 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:59.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.838+0000 7f8f4f7ab640 1 -- 172.21.15.50:0/3338857591 >> 172.21.15.50:0/3338857591 conn(0x7f8f48067130 msgr2=0x7f8f4806c330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:55:59.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.842+0000 7f8f4f7ab640 1 -- 172.21.15.50:0/3338857591 shutdown_connections 2024-04-01T01:55:59.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.842+0000 7f8f4f7ab640 1 -- 172.21.15.50:0/3338857591 wait complete. 2024-04-01T01:55:59.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.842+0000 7fc50b59e640 1 Processor -- start 2024-04-01T01:55:59.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.842+0000 7f4de8937640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4de41585c0 0x7f4de4155890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:59.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.842+0000 7f4de8937640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4de41585c0 0x7f4de4155890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50656/0 (socket says 172.21.15.50:50656) 2024-04-01T01:55:59.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.842+0000 7f4de8937640 1 -- 172.21.15.50:0/2473809369 learned_addr learned my addr 172.21.15.50:0/2473809369 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T01:55:59.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.842+0000 7f4de9138640 1 --2- 172.21.15.50:0/2473809369 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4de406b760 0x7f4de4158fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:59.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.842+0000 7f4de9939640 1 --2- 172.21.15.50:0/2473809369 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4de415e1e0 0x7f4de41f4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:59.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.842+0000 7f4de9939640 1 -- 172.21.15.50:0/2473809369 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4de406b760 msgr2=0x7f4de4158fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:59.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.842+0000 7f4de9939640 1 --2- 172.21.15.50:0/2473809369 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4de406b760 0x7f4de4158fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:59.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.842+0000 7f4de9939640 1 -- 172.21.15.50:0/2473809369 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4de41585c0 msgr2=0x7f4de4155890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:59.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.842+0000 7f4de9939640 1 --2- 172.21.15.50:0/2473809369 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4de41585c0 0x7f4de4155890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:59.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.842+0000 7f4de9939640 1 -- 172.21.15.50:0/2473809369 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4de41596e0 con 0x7f4de415e1e0 2024-04-01T01:55:59.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.842+0000 7fc50b59e640 1 -- start start 2024-04-01T01:55:59.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.842+0000 7f8f4f7ab640 1 Processor -- start 2024-04-01T01:55:59.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.842+0000 7fc50b59e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc50c0c6e00 0x7fc50c0c9090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.842+0000 7fc50b59e640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc50c158360 0x7fc50c1fa320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.842+0000 7fc50b59e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc50c15e810 0x7fc50c06ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.842+0000 7fc50b59e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc50c158740 con 0x7fc50c15e810 2024-04-01T01:55:59.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.842+0000 7fc50b59e640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fc50c15f030 con 0x7fc50c0c6e00 2024-04-01T01:55:59.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.842+0000 7fc50b59e640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fc50c1588c0 con 0x7fc50c158360 2024-04-01T01:55:59.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.842+0000 7f4de9939640 1 --2- 172.21.15.50:0/2473809369 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4de415e1e0 0x7f4de41f4010 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4de4071c90 tx=0x7f4de001bad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:59.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.842+0000 7f8f4f7ab640 1 -- start start 2024-04-01T01:55:59.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.842+0000 7fc50a59c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc50c0c6e00 0x7fc50c0c9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:59.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.842+0000 7fc509d9b640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc50c158360 0x7fc50c1fa320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:59.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.842+0000 7fc509d9b640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc50c158360 0x7fc50c1fa320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.50:54302/0 (socket says 172.21.15.50:54302) 2024-04-01T01:55:59.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.842+0000 7fc509d9b640 1 -- 172.21.15.50:0/1226987042 learned_addr learned my addr 172.21.15.50:0/1226987042 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T01:55:59.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.842+0000 7fc50ad9d640 1 --2- 172.21.15.50:0/1226987042 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc50c15e810 0x7fc50c06ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:59.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.842+0000 7fc50ad9d640 1 -- 172.21.15.50:0/1226987042 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc50c158360 msgr2=0x7fc50c1fa320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:59.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.842+0000 7fc50ad9d640 1 --2- 172.21.15.50:0/1226987042 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc50c158360 0x7fc50c1fa320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:59.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.842+0000 7fc50ad9d640 1 -- 172.21.15.50:0/1226987042 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc50c0c6e00 msgr2=0x7fc50c0c9090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:59.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.842+0000 7fc50ad9d640 1 --2- 172.21.15.50:0/1226987042 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc50c0c6e00 0x7fc50c0c9090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:59.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.842+0000 7fc50ad9d640 1 -- 172.21.15.50:0/1226987042 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc50c0c95d0 con 0x7fc50c15e810 2024-04-01T01:55:59.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.842+0000 7fc50a59c640 1 --2- 172.21.15.50:0/1226987042 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc50c0c6e00 0x7fc50c0c9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T01:55:59.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.842+0000 7f8f4f7ab640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f480c3a60 0x7f8f480c1880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.842+0000 7f7f08ee5640 1 Processor -- start 2024-04-01T01:55:59.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.842+0000 7f8f4f7ab640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8f480c7f30 0x7f8f480c2570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.842+0000 7fc50ad9d640 1 --2- 172.21.15.50:0/1226987042 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc50c15e810 0x7fc50c06ed80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc50400c730 tx=0x7fc50400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:59.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.842+0000 7f4dd9ffb640 1 -- 172.21.15.50:0/2473809369 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4de00c0070 con 0x7f4de415e1e0 2024-04-01T01:55:59.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.842+0000 7f4dea13a640 1 -- 172.21.15.50:0/2473809369 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4de41599c0 con 0x7f4de415e1e0 2024-04-01T01:55:59.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.842+0000 7f4dea13a640 1 -- 172.21.15.50:0/2473809369 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4de415c4d0 con 0x7f4de415e1e0 2024-04-01T01:55:59.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.846+0000 7f8f4f7ab640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8f48150f20 0x7f8f480c2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.842+0000 7f7f08ee5640 1 -- start start 2024-04-01T01:55:59.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.846+0000 7f8f4f7ab640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8f480c86e0 con 0x7f8f480c3a60 2024-04-01T01:55:59.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.846+0000 7f8f4f7ab640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f8f480c6260 con 0x7f8f480c7f30 2024-04-01T01:55:59.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.846+0000 7f8f4f7ab640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f8f48072d20 con 0x7f8f48150f20 2024-04-01T01:55:59.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.846+0000 7f4dd9ffb640 1 -- 172.21.15.50:0/2473809369 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4de00a8a30 con 0x7f4de415e1e0 2024-04-01T01:55:59.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.846+0000 7f4dd9ffb640 1 -- 172.21.15.50:0/2473809369 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4de00b5070 con 0x7f4de415e1e0 2024-04-01T01:55:59.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.846+0000 7f8f4cd46640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8f480c7f30 0x7f8f480c2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:59.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.846+0000 7f8f4d547640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f480c3a60 0x7f8f480c1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:59.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.846+0000 7f8f4d547640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f480c3a60 0x7f8f480c1880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50664/0 (socket says 172.21.15.50:50664) 2024-04-01T01:55:59.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.846+0000 7f8f4d547640 1 -- 172.21.15.50:0/547252400 learned_addr learned my addr 172.21.15.50:0/547252400 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T01:55:59.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.846+0000 7f8f4dd48640 1 --2- 172.21.15.50:0/547252400 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8f48150f20 0x7f8f480c2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:59.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.846+0000 7f8f4d547640 1 -- 172.21.15.50:0/547252400 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8f48150f20 msgr2=0x7f8f480c2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:59.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.846+0000 7f8f4d547640 1 --2- 172.21.15.50:0/547252400 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8f48150f20 0x7f8f480c2ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:59.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.846+0000 7f8f4d547640 1 -- 172.21.15.50:0/547252400 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8f480c7f30 msgr2=0x7f8f480c2570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:59.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.846+0000 7f8f4d547640 1 --2- 172.21.15.50:0/547252400 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8f480c7f30 0x7f8f480c2570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:59.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.846+0000 7f8f4d547640 1 -- 172.21.15.50:0/547252400 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f481f8140 con 0x7f8f480c3a60 2024-04-01T01:55:59.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.846+0000 7f8f4d547640 1 --2- 172.21.15.50:0/547252400 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f480c3a60 0x7f8f480c1880 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8f44000c10 tx=0x7f8f440192b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:59.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.846+0000 7f7f08ee5640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7f041540e0 0x7f7f04159d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.846+0000 7f7f08ee5640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f7f040c4460 0x7f7f040cc340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.846+0000 7f7f08ee5640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f0415a390 con 0x7f7f040cb800 2024-04-01T01:55:59.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.846+0000 7f7f08ee5640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f7f0415e280 con 0x7f7f041540e0 2024-04-01T01:55:59.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.846+0000 7f7f08ee5640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f7f041544c0 con 0x7f7f040c4460 2024-04-01T01:55:59.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.846+0000 7f7f037fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7f041540e0 0x7f7f04159d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:59.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.846+0000 7f7f037fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7f041540e0 0x7f7f04159d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50668/0 (socket says 172.21.15.50:50668) 2024-04-01T01:55:59.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.846+0000 7f7f037fe640 1 -- 172.21.15.50:0/1878382124 learned_addr learned my addr 172.21.15.50:0/1878382124 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T01:55:59.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.846+0000 7f7f037fe640 1 -- 172.21.15.50:0/1878382124 >> v2:172.21.15.97:3300/0 conn(0x7f7f040c4460 msgr2=0x7f7f040cc340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:55:59.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.846+0000 7f7f03fff640 1 --2- 172.21.15.50:0/1878382124 >> v2:172.21.15.97:3300/0 conn(0x7f7f040c4460 0x7f7f040cc340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:59.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.846+0000 7f7f037fe640 1 --2- 172.21.15.50:0/1878382124 >> v2:172.21.15.97:3300/0 conn(0x7f7f040c4460 0x7f7f040cc340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:59.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.846+0000 7f7f037fe640 1 -- 172.21.15.50:0/1878382124 >> v1:172.21.15.50:6789/0 conn(0x7f7f040cb800 legacy=0x7f7f0415db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:55:59.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.846+0000 7f4dd9ffb640 1 -- 172.21.15.50:0/2473809369 <== mon.2 v2:172.21.15.97:3301/0 4 ==== mgrmap(e 5) ==== 87103+0+0 (secure 0 0 0) 0x7f4de00c3070 con 0x7f4de415e1e0 2024-04-01T01:55:59.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.846+0000 7f4dd9ffb640 1 --2- 172.21.15.50:0/2473809369 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f4dc8067420 0x7f4dc80698e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.846+0000 7f4dd9ffb640 1 -- 172.21.15.50:0/2473809369 <== mon.2 v2:172.21.15.97:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f4de0122a80 con 0x7f4de415e1e0 2024-04-01T01:55:59.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.846+0000 7f4de9138640 1 --2- 172.21.15.50:0/2473809369 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f4dc8067420 0x7f4dc80698e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:59.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.846+0000 7f7f037fe640 1 -- 172.21.15.50:0/1878382124 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f0415a650 con 0x7f7f041540e0 2024-04-01T01:55:59.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.850+0000 7f7f03fff640 1 --2- 172.21.15.50:0/1878382124 >> v2:172.21.15.97:3300/0 conn(0x7f7f040c4460 0x7f7f040cc340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T01:55:59.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.850+0000 7f4dea13a640 1 -- 172.21.15.50:0/2473809369 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4dc40052a0 con 0x7f4de415e1e0 2024-04-01T01:55:59.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.850+0000 7f4de9138640 1 --2- 172.21.15.50:0/2473809369 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f4dc8067420 0x7f4dc80698e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc0012f0 tx=0x7f4ddc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:59.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.850+0000 7fc4faffd640 1 -- 172.21.15.50:0/1226987042 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc504003b80 con 0x7fc50c15e810 2024-04-01T01:55:59.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.850+0000 7f8f3dffb640 1 -- 172.21.15.50:0/547252400 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f440b0040 con 0x7f8f480c3a60 2024-04-01T01:55:59.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.850+0000 7f0875ffb640 1 -- 172.21.15.50:0/4047521787 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+176632 (secure 0 0 0) 0x7f087001f020 con 0x7f08800cc5c0 2024-04-01T01:55:59.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.850+0000 7fc50b59e640 1 -- 172.21.15.50:0/1226987042 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc50c15af80 con 0x7fc50c15e810 2024-04-01T01:55:59.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.850+0000 7fc50b59e640 1 -- 172.21.15.50:0/1226987042 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc50c0cb290 con 0x7fc50c15e810 2024-04-01T01:55:59.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.850+0000 7f8f4f7ab640 1 -- 172.21.15.50:0/547252400 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f481f7300 con 0x7f8f480c3a60 2024-04-01T01:55:59.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.850+0000 7f8f4f7ab640 1 -- 172.21.15.50:0/547252400 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f481f78a0 con 0x7f8f480c3a60 2024-04-01T01:55:59.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.850+0000 7f8f4f7ab640 1 -- 172.21.15.50:0/547252400 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f48068940 con 0x7f8f480c3a60 2024-04-01T01:55:59.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.850+0000 7fc50b59e640 1 -- 172.21.15.50:0/1226987042 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc50c04f4c0 con 0x7fc50c15e810 2024-04-01T01:55:59.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.850+0000 7f7f037fe640 1 --2- 172.21.15.50:0/1878382124 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f041540e0 0x7f7f04159d00 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7f04074e30 tx=0x7f7efc01c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8959ef35b969de65 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:59.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.850+0000 7fc4faffd640 1 -- 172.21.15.50:0/1226987042 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5040050d0 con 0x7fc50c15e810 2024-04-01T01:55:59.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.850+0000 7fc4faffd640 1 -- 172.21.15.50:0/1226987042 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc504001700 con 0x7fc50c15e810 2024-04-01T01:55:59.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.850+0000 7f8f3dffb640 1 -- 172.21.15.50:0/547252400 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f440b9070 con 0x7f8f480c3a60 2024-04-01T01:55:59.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.850+0000 7f8f3dffb640 1 -- 172.21.15.50:0/547252400 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f440be660 con 0x7f8f480c3a60 2024-04-01T01:55:59.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.854+0000 7f7f027fc640 1 -- 172.21.15.50:0/1878382124 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7efc0a5670 con 0x7f7f041540e0 2024-04-01T01:55:59.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.854+0000 7f7f027fc640 1 -- 172.21.15.50:0/1878382124 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7efc0a5810 con 0x7f7f041540e0 2024-04-01T01:55:59.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.854+0000 7f7f027fc640 1 -- 172.21.15.50:0/1878382124 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7efc0a5be0 con 0x7f7f041540e0 2024-04-01T01:55:59.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.854+0000 7fc4faffd640 1 -- 172.21.15.50:0/1226987042 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 87103+0+0 (secure 0 0 0) 0x7fc5040054c0 con 0x7fc50c15e810 2024-04-01T01:55:59.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.854+0000 7f7f08ee5640 1 -- 172.21.15.50:0/1878382124 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f041540e0 msgr2=0x7f7f04159d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:59.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.854+0000 7f7f08ee5640 1 --2- 172.21.15.50:0/1878382124 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f041540e0 0x7f7f04159d00 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7f04074e30 tx=0x7f7efc01c9d0 comp rx=0 tx=0).stop 2024-04-01T01:55:59.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.854+0000 7f8f3dffb640 1 -- 172.21.15.50:0/547252400 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 87103+0+0 (secure 0 0 0) 0x7f8f440be800 con 0x7f8f480c3a60 2024-04-01T01:55:59.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.854+0000 7f8f3dffb640 1 --2- 172.21.15.50:0/547252400 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f8f2c067420 0x7f8f2c0698e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.854+0000 7f8f3dffb640 1 -- 172.21.15.50:0/547252400 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f8f4411fd10 con 0x7f8f480c3a60 2024-04-01T01:55:59.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.854+0000 7fc4faffd640 1 --2- 172.21.15.50:0/1226987042 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fc4ec067420 0x7fc4ec0698e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.854+0000 7fc4faffd640 1 -- 172.21.15.50:0/1226987042 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fc5040057b0 con 0x7fc50c15e810 2024-04-01T01:55:59.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.854+0000 7f7f08ee5640 1 -- 172.21.15.50:0/1878382124 shutdown_connections 2024-04-01T01:55:59.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.854+0000 7f7f08ee5640 1 --2- 172.21.15.50:0/1878382124 >> v2:172.21.15.97:3300/0 conn(0x7f7f040c4460 0x7f7f040cc340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:59.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.854+0000 7f7f08ee5640 1 --2- 172.21.15.50:0/1878382124 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f041540e0 0x7f7f04159d00 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:59.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.854+0000 7f7f08ee5640 1 -- 172.21.15.50:0/1878382124 >> 172.21.15.50:0/1878382124 conn(0x7f7f04067130 msgr2=0x7f7f04067540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:55:59.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.854+0000 7f8f4cd46640 1 --2- 172.21.15.50:0/547252400 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f8f2c067420 0x7f8f2c0698e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:59.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.854+0000 7fc50a59c640 1 --2- 172.21.15.50:0/1226987042 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fc4ec067420 0x7fc4ec0698e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:59.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.854+0000 7f7f08ee5640 1 -- 172.21.15.50:0/1878382124 shutdown_connections 2024-04-01T01:55:59.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.858+0000 7f8f4cd46640 1 --2- 172.21.15.50:0/547252400 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f8f2c067420 0x7f8f2c0698e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8f480cc530 tx=0x7f8f38009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:59.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.854+0000 7f7f08ee5640 1 -- 172.21.15.50:0/1878382124 wait complete. 2024-04-01T01:55:59.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.858+0000 7f7f08ee5640 1 Processor -- start 2024-04-01T01:55:59.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.858+0000 7f7f08ee5640 1 -- start start 2024-04-01T01:55:59.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.858+0000 7fc50a59c640 1 --2- 172.21.15.50:0/1226987042 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fc4ec067420 0x7fc4ec0698e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc5000af000 tx=0x7fc5000a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:59.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.858+0000 7f7f08ee5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f040c4460 0x7f7f04157000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.858+0000 7f7f08ee5640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7f040cb800 0x7f7f04154ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.858+0000 7f7f037fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f040c4460 0x7f7f04157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:59.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.858+0000 7fc4faffd640 1 -- 172.21.15.50:0/1226987042 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+176632 (secure 0 0 0) 0x7fc504056740 con 0x7fc50c15e810 2024-04-01T01:55:59.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.858+0000 7f7f037fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f040c4460 0x7f7f04157000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50676/0 (socket says 172.21.15.50:50676) 2024-04-01T01:55:59.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.858+0000 7f7f037fe640 1 -- 172.21.15.50:0/2694674377 learned_addr learned my addr 172.21.15.50:0/2694674377 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T01:55:59.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.858+0000 7f7f02ffd640 1 --2- 172.21.15.50:0/2694674377 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7f040cb800 0x7f7f04154ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:59.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.862+0000 7f4dd9ffb640 1 -- 172.21.15.50:0/2473809369 <== mon.2 v2:172.21.15.97:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+176632 (secure 0 0 0) 0x7f4de0018890 con 0x7f4de415e1e0 2024-04-01T01:55:59.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.866+0000 7f8f3dffb640 1 -- 172.21.15.50:0/547252400 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+176632 (secure 0 0 0) 0x7f8f44016130 con 0x7f8f480c3a60 2024-04-01T01:55:59.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.862+0000 7f7f08ee5640 1 --2- 172.21.15.50:0/2694674377 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7f041540e0 0x7f7f04155020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.862+0000 7f7f08ee5640 1 -- 172.21.15.50:0/2694674377 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7f040c4b80 con 0x7f7f040c4460 2024-04-01T01:55:59.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.862+0000 7f7f08ee5640 1 -- 172.21.15.50:0/2694674377 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f7f0415d650 con 0x7f7f040cb800 2024-04-01T01:55:59.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.862+0000 7f7f08ee5640 1 -- 172.21.15.50:0/2694674377 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f7f040c4d00 con 0x7f7f041540e0 2024-04-01T01:55:59.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.862+0000 7f7f037fe640 1 -- 172.21.15.50:0/2694674377 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7f041540e0 msgr2=0x7f7f04155020 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-01T01:55:59.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.862+0000 7f7f037fe640 1 --2- 172.21.15.50:0/2694674377 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7f041540e0 0x7f7f04155020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:59.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.862+0000 7f7f037fe640 1 -- 172.21.15.50:0/2694674377 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7f040cb800 msgr2=0x7f7f04154ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:55:59.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.862+0000 7f7f037fe640 1 --2- 172.21.15.50:0/2694674377 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7f040cb800 0x7f7f04154ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:55:59.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.862+0000 7f7f037fe640 1 -- 172.21.15.50:0/2694674377 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f040c6d00 con 0x7f7f040c4460 2024-04-01T01:55:59.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.862+0000 7f7f037fe640 1 --2- 172.21.15.50:0/2694674377 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f040c4460 0x7f7f04157000 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7efc01d270 tx=0x7f7efc019770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:59.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.866+0000 7f7eebfff640 1 -- 172.21.15.50:0/2694674377 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7efc0b8670 con 0x7f7f040c4460 2024-04-01T01:55:59.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.874+0000 7f7eebfff640 1 -- 172.21.15.50:0/2694674377 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7efc0be070 con 0x7f7f040c4460 2024-04-01T01:55:59.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.874+0000 7f7f02ffd640 1 --2- 172.21.15.50:0/2694674377 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7f040cb800 0x7f7f04154ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T01:55:59.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.874+0000 7f7eebfff640 1 -- 172.21.15.50:0/2694674377 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7efc0b8a50 con 0x7f7f040c4460 2024-04-01T01:55:59.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.874+0000 7f7f08ee5640 1 -- 172.21.15.50:0/2694674377 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f040c90d0 con 0x7f7f040c4460 2024-04-01T01:55:59.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.874+0000 7f7f08ee5640 1 -- 172.21.15.50:0/2694674377 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f040c9690 con 0x7f7f040c4460 2024-04-01T01:55:59.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.874+0000 7f7f08ee5640 1 -- 172.21.15.50:0/2694674377 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f0404f4c0 con 0x7f7f040c4460 2024-04-01T01:55:59.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.874+0000 7f7eebfff640 1 -- 172.21.15.50:0/2694674377 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 87103+0+0 (secure 0 0 0) 0x7f7efc0b8bf0 con 0x7f7f040c4460 2024-04-01T01:55:59.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.878+0000 7f7eebfff640 1 --2- 172.21.15.50:0/2694674377 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f7ef00674f0 0x7f7ef00699b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:55:59.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.878+0000 7f7eebfff640 1 -- 172.21.15.50:0/2694674377 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f7efc120a40 con 0x7f7f040c4460 2024-04-01T01:55:59.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.878+0000 7f7f02ffd640 1 --2- 172.21.15.50:0/2694674377 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f7ef00674f0 0x7f7ef00699b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:55:59.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.878+0000 7f7f02ffd640 1 --2- 172.21.15.50:0/2694674377 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f7ef00674f0 0x7f7ef00699b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7f0415d2b0 tx=0x7f7ef4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:55:59.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:55:59.886+0000 7f7eebfff640 1 -- 172.21.15.50:0/2694674377 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+176632 (secure 0 0 0) 0x7f7efc122e20 con 0x7f7f040c4460 2024-04-01T01:56:00.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:00.126+0000 7f23eda47640 1 -- 172.21.15.50:0/1881289167 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f23e814d620 con 0x7f23e8150010 2024-04-01T01:56:00.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:00.130+0000 7f23cffff640 1 -- 172.21.15.50:0/1881289167 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f23dc0eeec0 con 0x7f23e8150010 2024-04-01T01:56:00.133 INFO:teuthology.orchestra.run.smithi050.stdout:64424509444 2024-04-01T01:56:00.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:00.142+0000 7f23cdffb640 1 -- 172.21.15.50:0/1881289167 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f23d4067520 msgr2=0x7f23d40699e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:00.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:00.142+0000 7f23cdffb640 1 --2- 172.21.15.50:0/1881289167 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f23d4067520 0x7f23d40699e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f23d8000c10 tx=0x7f23d8007e10 comp rx=0 tx=0).stop 2024-04-01T01:56:00.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:00.142+0000 7f23cdffb640 1 -- 172.21.15.50:0/1881289167 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23e8150010 msgr2=0x7f23e814c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:00.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:00.142+0000 7f23cdffb640 1 --2- 172.21.15.50:0/1881289167 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23e8150010 0x7f23e814c0b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f23dc0ab000 tx=0x7f23dc0190d0 comp rx=0 tx=0).stop 2024-04-01T01:56:00.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:00.142+0000 7f23cdffb640 1 -- 172.21.15.50:0/1881289167 shutdown_connections 2024-04-01T01:56:00.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:00.142+0000 7f23cdffb640 1 --2- 172.21.15.50:0/1881289167 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f23d4067520 0x7f23d40699e0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:00.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:00.142+0000 7f23cdffb640 1 --2- 172.21.15.50:0/1881289167 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23e8150010 0x7f23e814c0b0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:00.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:00.142+0000 7f23cdffb640 1 --2- 172.21.15.50:0/1881289167 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f23e80728e0 0x7f23e8150610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:00.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:00.142+0000 7f23cdffb640 1 --2- 172.21.15.50:0/1881289167 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f23e8072170 0x7f23e8155080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:00.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:00.142+0000 7f23cdffb640 1 -- 172.21.15.50:0/1881289167 >> 172.21.15.50:0/1881289167 conn(0x7f23e806b220 msgr2=0x7f23e806b600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:56:00.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:00.142+0000 7f23cdffb640 1 -- 172.21.15.50:0/1881289167 shutdown_connections 2024-04-01T01:56:00.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:00.142+0000 7f23cdffb640 1 -- 172.21.15.50:0/1881289167 wait complete. 2024-04-01T01:56:00.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:00.166+0000 7f9ceedaa640 1 -- 172.21.15.50:0/2347993976 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f9cd0005860 con 0x7f9ce8156d60 2024-04-01T01:56:00.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:00.166+0000 7f9cde7fc640 1 -- 172.21.15.50:0/2347993976 <== mon.1 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9ce0067550 con 0x7f9ce8156d60 2024-04-01T01:56:00.180 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509444 for osd.0 2024-04-01T01:56:00.180 INFO:teuthology.orchestra.run.smithi050.stdout:64424509446 2024-04-01T01:56:00.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:00.178+0000 7f8f4f7ab640 1 -- 172.21.15.50:0/547252400 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f8f480727c0 con 0x7f8f480c3a60 2024-04-01T01:56:00.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:00.182+0000 7f70371b4640 1 -- 172.21.15.50:0/1562319720 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f7018005590 con 0x7f7030158360 2024-04-01T01:56:00.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:00.182+0000 7f8f3dffb640 1 -- 172.21.15.50:0/547252400 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8f440f0a10 con 0x7f8f480c3a60 2024-04-01T01:56:00.183 INFO:teuthology.orchestra.run.smithi050.stdout:64424509445 2024-04-01T01:56:00.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:00.182+0000 7f7026ffd640 1 -- 172.21.15.50:0/1562319720 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7028010040 con 0x7f7030158360 2024-04-01T01:56:00.183 INFO:teuthology.orchestra.run.smithi050.stdout:55834574854 2024-04-01T01:56:00.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:00.182+0000 7f8f4f7ab640 1 -- 172.21.15.50:0/547252400 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f8f2c067420 msgr2=0x7f8f2c0698e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:00.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:00.182+0000 7f8f4f7ab640 1 --2- 172.21.15.50:0/547252400 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f8f2c067420 0x7f8f2c0698e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8f480cc530 tx=0x7f8f38009040 comp rx=0 tx=0).stop 2024-04-01T01:56:00.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:00.182+0000 7f8f4f7ab640 1 -- 172.21.15.50:0/547252400 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f480c3a60 msgr2=0x7f8f480c1880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:00.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:00.182+0000 7f8f4f7ab640 1 --2- 172.21.15.50:0/547252400 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f480c3a60 0x7f8f480c1880 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8f44000c10 tx=0x7f8f440192b0 comp rx=0 tx=0).stop 2024-04-01T01:56:00.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:00.182+0000 7f8f4f7ab640 1 -- 172.21.15.50:0/547252400 shutdown_connections 2024-04-01T01:56:00.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:00.186+0000 7f8f4f7ab640 1 --2- 172.21.15.50:0/547252400 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f8f2c067420 0x7f8f2c0698e0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:00.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:00.186+0000 7f9ceedaa640 1 -- 172.21.15.50:0/2347993976 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f9ccc0674f0 msgr2=0x7f9ccc0699b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:00.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:00.186+0000 7f8f4f7ab640 1 --2- 172.21.15.50:0/547252400 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8f48150f20 0x7f8f480c2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:00.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:00.186+0000 7f9ceedaa640 1 --2- 172.21.15.50:0/2347993976 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f9ccc0674f0 0x7f9ccc0699b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9ce40ae000 tx=0x7f9ce40a6040 comp rx=0 tx=0).stop 2024-04-01T01:56:00.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:00.186+0000 7f9ceedaa640 1 -- 172.21.15.50:0/2347993976 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9ce8156d60 msgr2=0x7f9ce81fb780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:00.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:00.186+0000 7f9ceedaa640 1 --2- 172.21.15.50:0/2347993976 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9ce8156d60 0x7f9ce81fb780 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9ce000cb10 tx=0x7f9ce000a060 comp rx=0 tx=0).stop 2024-04-01T01:56:00.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:00.186+0000 7f8f4f7ab640 1 --2- 172.21.15.50:0/547252400 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8f480c7f30 0x7f8f480c2570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:00.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:00.186+0000 7f8f4f7ab640 1 --2- 172.21.15.50:0/547252400 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f480c3a60 0x7f8f480c1880 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:00.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:00.186+0000 7f8f4f7ab640 1 -- 172.21.15.50:0/547252400 >> 172.21.15.50:0/547252400 conn(0x7f8f48067130 msgr2=0x7f8f4814e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:56:00.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:00.186+0000 7f8f4f7ab640 1 -- 172.21.15.50:0/547252400 shutdown_connections 2024-04-01T01:56:00.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:00.186+0000 7f8f4f7ab640 1 -- 172.21.15.50:0/547252400 wait complete. 2024-04-01T01:56:00.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:00.186+0000 7f7024ff9640 1 -- 172.21.15.50:0/1562319720 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f7014067450 msgr2=0x7f7014069910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:00.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:00.186+0000 7f7024ff9640 1 --2- 172.21.15.50:0/1562319720 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f7014067450 0x7f7014069910 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7020000f70 tx=0x7f70200079c0 comp rx=0 tx=0).stop 2024-04-01T01:56:00.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:00.186+0000 7f7024ff9640 1 -- 172.21.15.50:0/1562319720 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7030158360 msgr2=0x7f703014f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:00.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:00.186+0000 7f7024ff9640 1 --2- 172.21.15.50:0/1562319720 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7030158360 0x7f703014f790 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f702800efc0 tx=0x7f702800c490 comp rx=0 tx=0).stop 2024-04-01T01:56:00.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:00.186+0000 7f9ceedaa640 1 -- 172.21.15.50:0/2347993976 shutdown_connections 2024-04-01T01:56:00.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:00.186+0000 7f9ceedaa640 1 --2- 172.21.15.50:0/2347993976 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f9ccc0674f0 0x7f9ccc0699b0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:00.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:00.186+0000 7f9ceedaa640 1 --2- 172.21.15.50:0/2347993976 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9ce8156d60 0x7f9ce81fb780 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:00.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:00.186+0000 7f9ceedaa640 1 --2- 172.21.15.50:0/2347993976 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ce8151f40 0x7f9ce8144280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:00.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:00.186+0000 7f9ceedaa640 1 --2- 172.21.15.50:0/2347993976 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9ce80c7250 0x7f9ce8155290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:00.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:00.186+0000 7f9ceedaa640 1 -- 172.21.15.50:0/2347993976 >> 172.21.15.50:0/2347993976 conn(0x7f9ce80c8f10 msgr2=0x7f9ce814daf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:56:00.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:00.186+0000 7f9ceedaa640 1 -- 172.21.15.50:0/2347993976 shutdown_connections 2024-04-01T01:56:00.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:00.186+0000 7fc50b59e640 1 -- 172.21.15.50:0/1226987042 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fc50c0c6b30 con 0x7fc50c15e810 2024-04-01T01:56:00.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:00.186+0000 7f7024ff9640 1 -- 172.21.15.50:0/1562319720 shutdown_connections 2024-04-01T01:56:00.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:00.186+0000 7f7024ff9640 1 --2- 172.21.15.50:0/1562319720 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f7014067450 0x7f7014069910 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:00.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:00.186+0000 7f7024ff9640 1 --2- 172.21.15.50:0/1562319720 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7030158360 0x7f703014f790 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:00.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:00.186+0000 7f7024ff9640 1 --2- 172.21.15.50:0/1562319720 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f70300c6e00 0x7f703014f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:00.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:00.186+0000 7f7024ff9640 1 --2- 172.21.15.50:0/1562319720 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f70300c64f0 0x7f703015ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:00.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:00.186+0000 7f7024ff9640 1 -- 172.21.15.50:0/1562319720 >> 172.21.15.50:0/1562319720 conn(0x7f703006b220 msgr2=0x7f703015d7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:56:00.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:00.186+0000 7f9ceedaa640 1 -- 172.21.15.50:0/2347993976 wait complete. 2024-04-01T01:56:00.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:00.186+0000 7f7024ff9640 1 -- 172.21.15.50:0/1562319720 shutdown_connections 2024-04-01T01:56:00.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:00.186+0000 7f7024ff9640 1 -- 172.21.15.50:0/1562319720 wait complete. 2024-04-01T01:56:00.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:00.190+0000 7fc4faffd640 1 -- 172.21.15.50:0/1226987042 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc50405a7e0 con 0x7fc50c15e810 2024-04-01T01:56:00.193 INFO:teuthology.orchestra.run.smithi050.stdout:64424509445 2024-04-01T01:56:00.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:00.190+0000 7f4dea13a640 1 -- 172.21.15.50:0/2473809369 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f4dc4005590 con 0x7f4de415e1e0 2024-04-01T01:56:00.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:00.190+0000 7f4dd9ffb640 1 -- 172.21.15.50:0/2473809369 <== mon.2 v2:172.21.15.97:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4de00f3130 con 0x7f4de415e1e0 2024-04-01T01:56:00.195 INFO:teuthology.orchestra.run.smithi050.stdout:64424509444 2024-04-01T01:56:00.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:00.194+0000 7f4dea13a640 1 -- 172.21.15.50:0/2473809369 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f4dc8067420 msgr2=0x7f4dc80698e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:00.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:00.194+0000 7f4dea13a640 1 --2- 172.21.15.50:0/2473809369 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f4dc8067420 0x7f4dc80698e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc0012f0 tx=0x7f4ddc009040 comp rx=0 tx=0).stop 2024-04-01T01:56:00.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:00.194+0000 7f4dea13a640 1 -- 172.21.15.50:0/2473809369 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4de415e1e0 msgr2=0x7f4de41f4010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:00.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:00.194+0000 7f4dea13a640 1 --2- 172.21.15.50:0/2473809369 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4de415e1e0 0x7f4de41f4010 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4de4071c90 tx=0x7f4de001bad0 comp rx=0 tx=0).stop 2024-04-01T01:56:00.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:00.194+0000 7f4dea13a640 1 -- 172.21.15.50:0/2473809369 shutdown_connections 2024-04-01T01:56:00.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:00.194+0000 7fc4f8ff9640 1 -- 172.21.15.50:0/1226987042 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fc4ec067420 msgr2=0x7fc4ec0698e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:00.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:00.194+0000 7f4dea13a640 1 --2- 172.21.15.50:0/2473809369 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f4dc8067420 0x7f4dc80698e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:00.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:00.194+0000 7fc4f8ff9640 1 --2- 172.21.15.50:0/1226987042 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fc4ec067420 0x7fc4ec0698e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc5000af000 tx=0x7fc5000a7000 comp rx=0 tx=0).stop 2024-04-01T01:56:00.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:00.194+0000 7fc4f8ff9640 1 -- 172.21.15.50:0/1226987042 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc50c15e810 msgr2=0x7fc50c06ed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:00.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:00.194+0000 7fc4f8ff9640 1 --2- 172.21.15.50:0/1226987042 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc50c15e810 0x7fc50c06ed80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc50400c730 tx=0x7fc50400cbf0 comp rx=0 tx=0).stop 2024-04-01T01:56:00.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:00.194+0000 7f4dea13a640 1 --2- 172.21.15.50:0/2473809369 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4de415e1e0 0x7f4de41f4010 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:00.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:00.194+0000 7f4dea13a640 1 --2- 172.21.15.50:0/2473809369 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4de41585c0 0x7f4de4155890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:00.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:00.194+0000 7f4dea13a640 1 --2- 172.21.15.50:0/2473809369 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4de406b760 0x7f4de4158fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:00.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:00.194+0000 7f4dea13a640 1 -- 172.21.15.50:0/2473809369 >> 172.21.15.50:0/2473809369 conn(0x7f4de40c8f10 msgr2=0x7f4de4074120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:56:00.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:00.194+0000 7fc4f8ff9640 1 -- 172.21.15.50:0/1226987042 shutdown_connections 2024-04-01T01:56:00.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:00.194+0000 7fc4f8ff9640 1 --2- 172.21.15.50:0/1226987042 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fc4ec067420 0x7fc4ec0698e0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:00.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:00.198+0000 7fc4f8ff9640 1 --2- 172.21.15.50:0/1226987042 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc50c15e810 0x7fc50c06ed80 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:00.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:00.198+0000 7fc4f8ff9640 1 --2- 172.21.15.50:0/1226987042 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc50c158360 0x7fc50c1fa320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:00.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:00.198+0000 7fc4f8ff9640 1 --2- 172.21.15.50:0/1226987042 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc50c0c6e00 0x7fc50c0c9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:00.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:00.198+0000 7fc4f8ff9640 1 -- 172.21.15.50:0/1226987042 >> 172.21.15.50:0/1226987042 conn(0x7fc50c06b220 msgr2=0x7fc50c0720d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:56:00.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:00.198+0000 7f4dea13a640 1 -- 172.21.15.50:0/2473809369 shutdown_connections 2024-04-01T01:56:00.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:00.198+0000 7f4dea13a640 1 -- 172.21.15.50:0/2473809369 wait complete. 2024-04-01T01:56:00.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:00.198+0000 7fc4f8ff9640 1 -- 172.21.15.50:0/1226987042 shutdown_connections 2024-04-01T01:56:00.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:00.198+0000 7fc4f8ff9640 1 -- 172.21.15.50:0/1226987042 wait complete. 2024-04-01T01:56:00.220 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509445 for osd.1 2024-04-01T01:56:00.222 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509446 for osd.4 2024-04-01T01:56:00.223 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.5 2024-04-01T01:56:00.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:00.226+0000 7f088734a640 1 -- 172.21.15.50:0/4047521787 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f0860005860 con 0x7f08800cc5c0 2024-04-01T01:56:00.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:00.226+0000 7f0875ffb640 1 -- 172.21.15.50:0/4047521787 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0870056c10 con 0x7f08800cc5c0 2024-04-01T01:56:00.230 INFO:teuthology.orchestra.run.smithi050.stdout:64424509445 2024-04-01T01:56:00.231 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509444 for osd.3 2024-04-01T01:56:00.232 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509445 for osd.2 2024-04-01T01:56:00.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:00.230+0000 7f088734a640 1 -- 172.21.15.50:0/4047521787 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f0864067420 msgr2=0x7f08640698e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:00.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:00.230+0000 7f088734a640 1 --2- 172.21.15.50:0/4047521787 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f0864067420 0x7f08640698e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f087c0ad000 tx=0x7f087c008040 comp rx=0 tx=0).stop 2024-04-01T01:56:00.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:00.230+0000 7f088734a640 1 -- 172.21.15.50:0/4047521787 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08800cc5c0 msgr2=0x7f088014c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:00.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:00.230+0000 7f088734a640 1 --2- 172.21.15.50:0/4047521787 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08800cc5c0 0x7f088014c400 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f087000d990 tx=0x7f087000de50 comp rx=0 tx=0).stop 2024-04-01T01:56:00.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:00.230+0000 7f088734a640 1 -- 172.21.15.50:0/4047521787 shutdown_connections 2024-04-01T01:56:00.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:00.230+0000 7f088734a640 1 --2- 172.21.15.50:0/4047521787 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f0864067420 0x7f08640698e0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:00.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:00.230+0000 7f088734a640 1 --2- 172.21.15.50:0/4047521787 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f08800cc9a0 0x7f08800c19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:00.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:00.230+0000 7f088734a640 1 --2- 172.21.15.50:0/4047521787 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08800cc5c0 0x7f088014c400 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:00.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:00.230+0000 7f088734a640 1 --2- 172.21.15.50:0/4047521787 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f08800c7fd0 0x7f08800c13f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:00.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:00.230+0000 7f088734a640 1 -- 172.21.15.50:0/4047521787 >> 172.21.15.50:0/4047521787 conn(0x7f0880067560 msgr2=0x7f088006fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:56:00.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:00.230+0000 7f088734a640 1 -- 172.21.15.50:0/4047521787 shutdown_connections 2024-04-01T01:56:00.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:00.230+0000 7f088734a640 1 -- 172.21.15.50:0/4047521787 wait complete. 2024-04-01T01:56:00.247 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509445 for osd.7 2024-04-01T01:56:00.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:00.258+0000 7f7f08ee5640 1 -- 172.21.15.50:0/2694674377 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f7f040b53f0 con 0x7f7f040c4460 2024-04-01T01:56:00.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:00.258+0000 7f7eebfff640 1 -- 172.21.15.50:0/2694674377 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7efc0165c0 con 0x7f7f040c4460 2024-04-01T01:56:00.259 INFO:teuthology.orchestra.run.smithi050.stdout:60129542149 2024-04-01T01:56:00.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:00.258+0000 7f7f08ee5640 1 -- 172.21.15.50:0/2694674377 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f7ef00674f0 msgr2=0x7f7ef00699b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:00.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:00.258+0000 7f7f08ee5640 1 --2- 172.21.15.50:0/2694674377 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f7ef00674f0 0x7f7ef00699b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7f0415d2b0 tx=0x7f7ef4009040 comp rx=0 tx=0).stop 2024-04-01T01:56:00.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:00.258+0000 7f7f08ee5640 1 -- 172.21.15.50:0/2694674377 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f040c4460 msgr2=0x7f7f04157000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:00.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:00.258+0000 7f7f08ee5640 1 --2- 172.21.15.50:0/2694674377 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f040c4460 0x7f7f04157000 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7efc01d270 tx=0x7f7efc019770 comp rx=0 tx=0).stop 2024-04-01T01:56:00.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:00.258+0000 7f7f08ee5640 1 -- 172.21.15.50:0/2694674377 shutdown_connections 2024-04-01T01:56:00.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:00.258+0000 7f7f08ee5640 1 --2- 172.21.15.50:0/2694674377 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f7ef00674f0 0x7f7ef00699b0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:00.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:00.258+0000 7f7f08ee5640 1 --2- 172.21.15.50:0/2694674377 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7f041540e0 0x7f7f04155020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:00.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:00.258+0000 7f7f08ee5640 1 --2- 172.21.15.50:0/2694674377 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7f040cb800 0x7f7f04154ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:00.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:00.258+0000 7f7f08ee5640 1 --2- 172.21.15.50:0/2694674377 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f040c4460 0x7f7f04157000 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:00.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:00.258+0000 7f7f08ee5640 1 -- 172.21.15.50:0/2694674377 >> 172.21.15.50:0/2694674377 conn(0x7f7f04067130 msgr2=0x7f7f04153380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:56:00.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:00.258+0000 7f7f08ee5640 1 -- 172.21.15.50:0/2694674377 shutdown_connections 2024-04-01T01:56:00.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:00.258+0000 7f7f08ee5640 1 -- 172.21.15.50:0/2694674377 wait complete. 2024-04-01T01:56:00.276 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.6 2024-04-01T01:56:01.182 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-01T01:56:01.221 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-01T01:56:01.223 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-01T01:56:01.223 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-01T01:56:01.232 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-01T01:56:01.232 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-01T01:56:01.248 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-01T01:56:01.277 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-01T01:56:01.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.342+0000 7f0754e55640 1 Processor -- start 2024-04-01T01:56:01.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.342+0000 7f0754e55640 1 -- start start 2024-04-01T01:56:01.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.342+0000 7f0754e55640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f0750158230 0x7f07500c5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:01.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.342+0000 7f0754e55640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07500726a0 con 0x7f0750071190 2024-04-01T01:56:01.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.342+0000 7f0754e55640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0750072940 con 0x7f07500c83e0 2024-04-01T01:56:01.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.342+0000 7f0754e55640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f0750072360 con 0x7f0750158230 2024-04-01T01:56:01.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.342+0000 7f074ed9d640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f07500c83e0 0x7f0750168950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.50:50432/0 (socket says 172.21.15.50:50432) 2024-04-01T01:56:01.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.342+0000 7f074ed9d640 1 -- 172.21.15.50:0/1805059943 learned_addr learned my addr 172.21.15.50:0/1805059943 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-04-01T01:56:01.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.346+0000 7f074e59c640 1 --2- 172.21.15.50:0/1805059943 >> v2:172.21.15.97:3300/0 conn(0x7f0750158230 0x7f07500c5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:01.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.346+0000 7f074d59a640 1 -- 172.21.15.50:0/1805059943 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1892342468 0 0) 0x7f0750072940 con 0x7f07500c83e0 2024-04-01T01:56:01.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.346+0000 7f074d59a640 1 -- 172.21.15.50:0/1805059943 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0738003530 con 0x7f07500c83e0 2024-04-01T01:56:01.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.346+0000 7f074e59c640 1 -- 172.21.15.50:0/1805059943 >> v1:172.21.15.97:6789/0 conn(0x7f07500c83e0 legacy=0x7f0750168950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:01.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.346+0000 7f074e59c640 1 -- 172.21.15.50:0/1805059943 >> v1:172.21.15.50:6789/0 conn(0x7f0750071190 legacy=0x7f07500c7cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:01.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.346+0000 7f074e59c640 1 -- 172.21.15.50:0/1805059943 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07500c6940 con 0x7f0750158230 2024-04-01T01:56:01.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.350+0000 7f074e59c640 1 --2- 172.21.15.50:0/1805059943 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0750158230 0x7f07500c5fa0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f07440097f0 tx=0x7f074401c350 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d350d74f738f54ba server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:56:01.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.350+0000 7f074d59a640 1 -- 172.21.15.50:0/1805059943 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07440b0070 con 0x7f0750158230 2024-04-01T01:56:01.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.350+0000 7f074d59a640 1 -- 172.21.15.50:0/1805059943 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07440ab600 con 0x7f0750158230 2024-04-01T01:56:01.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.350+0000 7f0754e55640 1 -- 172.21.15.50:0/1805059943 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0750158230 msgr2=0x7f07500c5fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:01.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.350+0000 7f0754e55640 1 --2- 172.21.15.50:0/1805059943 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0750158230 0x7f07500c5fa0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f07440097f0 tx=0x7f074401c350 comp rx=0 tx=0).stop 2024-04-01T01:56:01.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.350+0000 7f0754e55640 1 -- 172.21.15.50:0/1805059943 shutdown_connections 2024-04-01T01:56:01.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.350+0000 7f0754e55640 1 --2- 172.21.15.50:0/1805059943 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0750158230 0x7f07500c5fa0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:01.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.350+0000 7f0754e55640 1 -- 172.21.15.50:0/1805059943 >> 172.21.15.50:0/1805059943 conn(0x7f075006b220 msgr2=0x7f075006b630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:56:01.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.350+0000 7f0754e55640 1 -- 172.21.15.50:0/1805059943 shutdown_connections 2024-04-01T01:56:01.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.350+0000 7f0754e55640 1 -- 172.21.15.50:0/1805059943 wait complete. 2024-04-01T01:56:01.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.354+0000 7f0754e55640 1 Processor -- start 2024-04-01T01:56:01.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.354+0000 7f0754e55640 1 -- start start 2024-04-01T01:56:01.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.354+0000 7f0754e55640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0750071190 0x7f07500cac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:01.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.354+0000 7f0754e55640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f07500c83e0 0x7f075013f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:01.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.354+0000 7f0754e55640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f07501472a0 0x7f0750140ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:01.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.354+0000 7f0754e55640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f075006f9c0 con 0x7f0750071190 2024-04-01T01:56:01.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.354+0000 7f0754e55640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f075006f840 con 0x7f07501472a0 2024-04-01T01:56:01.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.354+0000 7f0754e55640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f075006fb40 con 0x7f07500c83e0 2024-04-01T01:56:01.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.354+0000 7f074dd9b640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f07500c83e0 0x7f075013f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:01.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.354+0000 7f074dd9b640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f07500c83e0 0x7f075013f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.50:54320/0 (socket says 172.21.15.50:54320) 2024-04-01T01:56:01.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.354+0000 7f074dd9b640 1 -- 172.21.15.50:0/549347987 learned_addr learned my addr 172.21.15.50:0/549347987 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T01:56:01.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.354+0000 7f074ed9d640 1 --2- 172.21.15.50:0/549347987 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f07501472a0 0x7f0750140ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:01.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.354+0000 7f074dd9b640 1 -- 172.21.15.50:0/549347987 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f07501472a0 msgr2=0x7f0750140ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:01.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.354+0000 7f074dd9b640 1 --2- 172.21.15.50:0/549347987 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f07501472a0 0x7f0750140ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:01.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.354+0000 7f074dd9b640 1 -- 172.21.15.50:0/549347987 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0750071190 msgr2=0x7f07500cac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:01.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.354+0000 7f074dd9b640 1 --2- 172.21.15.50:0/549347987 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0750071190 0x7f07500cac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:01.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.354+0000 7f074dd9b640 1 -- 172.21.15.50:0/549347987 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f075013fba0 con 0x7f07500c83e0 2024-04-01T01:56:01.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.354+0000 7f074dd9b640 1 --2- 172.21.15.50:0/549347987 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f07500c83e0 0x7f075013f660 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0740009db0 tx=0x7f074000c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:56:01.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.358+0000 7f073effd640 1 -- 172.21.15.50:0/549347987 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0740018030 con 0x7f07500c83e0 2024-04-01T01:56:01.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.358+0000 7f0754e55640 1 -- 172.21.15.50:0/549347987 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07500cbc60 con 0x7f07500c83e0 2024-04-01T01:56:01.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.358+0000 7f0754e55640 1 -- 172.21.15.50:0/549347987 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f07501400c0 con 0x7f07500c83e0 2024-04-01T01:56:01.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.358+0000 7f073effd640 1 -- 172.21.15.50:0/549347987 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f074000cd50 con 0x7f07500c83e0 2024-04-01T01:56:01.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.358+0000 7f073effd640 1 -- 172.21.15.50:0/549347987 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0740008a10 con 0x7f07500c83e0 2024-04-01T01:56:01.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.362+0000 7f073effd640 1 -- 172.21.15.50:0/549347987 <== mon.2 v2:172.21.15.97:3301/0 4 ==== mgrmap(e 5) ==== 87103+0+0 (secure 0 0 0) 0x7f074001b070 con 0x7f07500c83e0 2024-04-01T01:56:01.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.362+0000 7f0754e55640 1 -- 172.21.15.50:0/549347987 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07340052a0 con 0x7f07500c83e0 2024-04-01T01:56:01.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.362+0000 7f073effd640 1 --2- 172.21.15.50:0/549347987 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f07300674f0 0x7f07300699b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:01.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.362+0000 7f073effd640 1 -- 172.21.15.50:0/549347987 <== mon.2 v2:172.21.15.97:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f0740087a70 con 0x7f07500c83e0 2024-04-01T01:56:01.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.362+0000 7f074e59c640 1 --2- 172.21.15.50:0/549347987 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f07300674f0 0x7f07300699b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:01.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.362+0000 7f074e59c640 1 --2- 172.21.15.50:0/549347987 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f07300674f0 0x7f07300699b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f07440ad000 tx=0x7f0744004740 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:56:01.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.374+0000 7f073effd640 1 -- 172.21.15.50:0/549347987 <== mon.2 v2:172.21.15.97:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+176632 (secure 0 0 0) 0x7f075013fba0 con 0x7f07500c83e0 2024-04-01T01:56:01.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.382+0000 7f6998c95640 1 Processor -- start 2024-04-01T01:56:01.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.382+0000 7f6998c95640 1 -- start start 2024-04-01T01:56:01.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.386+0000 7f148d5bd640 1 Processor -- start 2024-04-01T01:56:01.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.386+0000 7f148d5bd640 1 -- start start 2024-04-01T01:56:01.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.386+0000 7f6998c95640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f698c050360 0x7f698c009e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:01.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.386+0000 7f6998c95640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f698c0e0450 con 0x7f698c0d6ef0 2024-04-01T01:56:01.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.386+0000 7f6998c95640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f698c0e0730 con 0x7f698c00a370 2024-04-01T01:56:01.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.386+0000 7f6998c95640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f698c04fcf0 con 0x7f698c050360 2024-04-01T01:56:01.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.386+0000 7f69937fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f698c0d6ef0 0x7f698c0510e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44652/0 (socket says 172.21.15.50:44652) 2024-04-01T01:56:01.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.386+0000 7f69937fe640 1 -- 172.21.15.50:0/183800351 learned_addr learned my addr 172.21.15.50:0/183800351 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-04-01T01:56:01.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.386+0000 7f7b39532640 1 Processor -- start 2024-04-01T01:56:01.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.386+0000 7f69927fc640 1 -- 172.21.15.50:0/183800351 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2088475000 0 0) 0x7f698c0e0450 con 0x7f698c0d6ef0 2024-04-01T01:56:01.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.386+0000 7f69927fc640 1 -- 172.21.15.50:0/183800351 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6984003530 con 0x7f698c0d6ef0 2024-04-01T01:56:01.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.386+0000 7f7b39532640 1 -- start start 2024-04-01T01:56:01.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.386+0000 7f6992ffd640 1 --2- 172.21.15.50:0/183800351 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f698c050360 0x7f698c009e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:01.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.386+0000 7f148d5bd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1488153f70 0x7f1488071250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:01.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.386+0000 7f148d5bd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f1488071790 0x7f148806ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:01.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.386+0000 7f148d5bd640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f148815e1b0 con 0x7f14880c6270 2024-04-01T01:56:01.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.386+0000 7f148d5bd640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f14880c6ca0 con 0x7f1488071790 2024-04-01T01:56:01.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.386+0000 7f148d5bd640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f148815a960 con 0x7f1488153f70 2024-04-01T01:56:01.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.386+0000 7f69927fc640 1 -- 172.21.15.50:0/183800351 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1985507838 0 0) 0x7f6984003530 con 0x7f698c0d6ef0 2024-04-01T01:56:01.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.386+0000 7f69927fc640 1 -- 172.21.15.50:0/183800351 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f698c050360 msgr2=0x7f698c009e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:56:01.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.386+0000 7f69927fc640 1 --2- 172.21.15.50:0/183800351 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f698c050360 0x7f698c009e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:01.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.386+0000 7f69927fc640 1 -- 172.21.15.50:0/183800351 >> v1:172.21.15.97:6789/0 conn(0x7f698c00a370 legacy=0x7f698c0dd150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:01.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.386+0000 7f69927fc640 1 -- 172.21.15.50:0/183800351 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f698c0e0a10 con 0x7f698c0d6ef0 2024-04-01T01:56:01.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.386+0000 7f69927fc640 1 -- 172.21.15.50:0/183800351 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2779672543 0 0) 0x7f6980001680 con 0x7f698c0d6ef0 2024-04-01T01:56:01.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.386+0000 7f69927fc640 1 -- 172.21.15.50:0/183800351 >> v1:172.21.15.50:6789/0 conn(0x7f698c0d6ef0 legacy=0x7f698c0510e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:01.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.386+0000 7f69927fc640 1 --2- 172.21.15.50:0/183800351 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69840039f0 0x7f6984003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:01.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.386+0000 7f69927fc640 1 --2- 172.21.15.50:0/183800351 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6984004810 0x7f6984004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:01.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.386+0000 7f69927fc640 1 --2- 172.21.15.50:0/183800351 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f698c050360 0x7f69840051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:01.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.386+0000 7f69927fc640 1 -- 172.21.15.50:0/183800351 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f698c04fcf0 con 0x7f69840039f0 2024-04-01T01:56:01.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.386+0000 7f69927fc640 1 -- 172.21.15.50:0/183800351 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f6984009b50 con 0x7f6984004810 2024-04-01T01:56:01.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.386+0000 7f69927fc640 1 -- 172.21.15.50:0/183800351 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f69840145d0 con 0x7f698c050360 2024-04-01T01:56:01.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.386+0000 7f14877fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f14880c6270 0x7f148806f180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44660/0 (socket says 172.21.15.50:44660) 2024-04-01T01:56:01.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.386+0000 7f14877fe640 1 -- 172.21.15.50:0/3373357512 learned_addr learned my addr 172.21.15.50:0/3373357512 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-04-01T01:56:01.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.386+0000 7f1486ffd640 1 --2- 172.21.15.50:0/3373357512 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1488153f70 0x7f1488071250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:01.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.386+0000 7f69937fe640 1 --2- 172.21.15.50:0/183800351 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69840039f0 0x7f6984003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:01.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.386+0000 7f6993fff640 1 --2- 172.21.15.50:0/183800351 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f698c050360 0x7f69840051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:01.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.386+0000 7f6992ffd640 1 --2- 172.21.15.50:0/183800351 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6984004810 0x7f6984004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:01.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.386+0000 7f6993fff640 1 -- 172.21.15.50:0/183800351 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6984004810 msgr2=0x7f6984004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:56:01.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.386+0000 7f6993fff640 1 --2- 172.21.15.50:0/183800351 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6984004810 0x7f6984004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:01.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.386+0000 7f6993fff640 1 -- 172.21.15.50:0/183800351 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69840039f0 msgr2=0x7f6984003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:56:01.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.386+0000 7f6993fff640 1 --2- 172.21.15.50:0/183800351 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69840039f0 0x7f6984003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:01.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.386+0000 7f6993fff640 1 -- 172.21.15.50:0/183800351 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f698c0e0a10 con 0x7f698c050360 2024-04-01T01:56:01.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.386+0000 7f7b39532640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7b340c5fb0 0x7f7b340c63d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:01.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.386+0000 7f7b39532640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7b340c7c10 0x7f7b340c8080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:01.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.386+0000 7f7b39532640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b3415a150 con 0x7f7b34153fc0 2024-04-01T01:56:01.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.386+0000 7f7b39532640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f7b34071980 con 0x7f7b340c7c10 2024-04-01T01:56:01.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.386+0000 7f7b39532640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f7b3415a410 con 0x7f7b340c5fb0 2024-04-01T01:56:01.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.386+0000 7f7b33fff640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f7b34153fc0 0x7f7b3415d9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.50:50444/0 (socket says 172.21.15.50:50444) 2024-04-01T01:56:01.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.386+0000 7f7b33fff640 1 -- 172.21.15.50:0/3338735059 learned_addr learned my addr 172.21.15.50:0/3338735059 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-04-01T01:56:01.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.386+0000 7f1486ffd640 1 -- 172.21.15.50:0/3373357512 >> v2:172.21.15.97:3300/0 conn(0x7f1488071790 msgr2=0x7f148806ec40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-01T01:56:01.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.386+0000 7f1486ffd640 1 --2- 172.21.15.50:0/3373357512 >> v2:172.21.15.97:3300/0 conn(0x7f1488071790 0x7f148806ec40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:01.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.386+0000 7f1486ffd640 1 -- 172.21.15.50:0/3373357512 >> v1:172.21.15.50:6789/0 conn(0x7f14880c6270 legacy=0x7f148806f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:01.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.386+0000 7f1486ffd640 1 -- 172.21.15.50:0/3373357512 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f148815d3f0 con 0x7f1488153f70 2024-04-01T01:56:01.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.386+0000 7f7b337fe640 1 --2- 172.21.15.50:0/3338735059 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7b340c5fb0 0x7f7b340c63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:01.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.386+0000 7f7b38d31640 1 --2- 172.21.15.50:0/3338735059 >> v2:172.21.15.50:3300/0 conn(0x7f7b340c7c10 0x7f7b340c8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:01.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.386+0000 7f7b337fe640 1 -- 172.21.15.50:0/3338735059 >> v2:172.21.15.50:3300/0 conn(0x7f7b340c7c10 msgr2=0x7f7b340c8080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:56:01.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.386+0000 7f7b337fe640 1 --2- 172.21.15.50:0/3338735059 >> v2:172.21.15.50:3300/0 conn(0x7f7b340c7c10 0x7f7b340c8080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:01.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.386+0000 7f7b337fe640 1 -- 172.21.15.50:0/3338735059 >> v1:172.21.15.97:6789/0 conn(0x7f7b34153fc0 legacy=0x7f7b3415d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:01.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.386+0000 7f7b337fe640 1 -- 172.21.15.50:0/3338735059 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b3415a6f0 con 0x7f7b340c5fb0 2024-04-01T01:56:01.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.390+0000 7f6993fff640 1 --2- 172.21.15.50:0/183800351 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f698c050360 0x7f69840051d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f69940507d0 tx=0x7f6994097900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=593ea5c7daf2a5f4 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:56:01.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.390+0000 7f1486ffd640 1 --2- 172.21.15.50:0/3373357512 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1488153f70 0x7f1488071250 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f14780097c0 tx=0x7f147801c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=97e78b296526dddb server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:56:01.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.390+0000 7f69927fc640 1 -- 172.21.15.50:0/183800351 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69940504b0 con 0x7f698c050360 2024-04-01T01:56:01.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.390+0000 7f7b337fe640 1 --2- 172.21.15.50:0/3338735059 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7b340c5fb0 0x7f7b340c63d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7b2c009d90 tx=0x7f7b2c01c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb20a21f2a687d47 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:56:01.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.390+0000 7f69927fc640 1 -- 172.21.15.50:0/183800351 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f699406e420 con 0x7f698c050360 2024-04-01T01:56:01.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.390+0000 7f69927fc640 1 -- 172.21.15.50:0/183800351 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f699406e810 con 0x7f698c050360 2024-04-01T01:56:01.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.390+0000 7f1485ffb640 1 -- 172.21.15.50:0/3373357512 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14780b0070 con 0x7f1488153f70 2024-04-01T01:56:01.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.390+0000 7f1485ffb640 1 -- 172.21.15.50:0/3373357512 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14780ab600 con 0x7f1488153f70 2024-04-01T01:56:01.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.390+0000 7f1485ffb640 1 -- 172.21.15.50:0/3373357512 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14780ab9d0 con 0x7f1488153f70 2024-04-01T01:56:01.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.390+0000 7f7b32ffd640 1 -- 172.21.15.50:0/3338735059 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b2c0b2070 con 0x7f7b340c5fb0 2024-04-01T01:56:01.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.390+0000 7f7b32ffd640 1 -- 172.21.15.50:0/3338735059 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b2c0a5820 con 0x7f7b340c5fb0 2024-04-01T01:56:01.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.390+0000 7f6998c95640 1 -- 172.21.15.50:0/183800351 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f698c050360 msgr2=0x7f69840051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:01.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.390+0000 7f6998c95640 1 --2- 172.21.15.50:0/183800351 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f698c050360 0x7f69840051d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f69940507d0 tx=0x7f6994097900 comp rx=0 tx=0).stop 2024-04-01T01:56:01.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.390+0000 7f6993fff640 1 -- 172.21.15.50:0/183800351 reap_dead start 2024-04-01T01:56:01.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.390+0000 7f6998c95640 1 -- 172.21.15.50:0/183800351 shutdown_connections 2024-04-01T01:56:01.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.390+0000 7f6998c95640 1 -- 172.21.15.50:0/183800351 >> 172.21.15.50:0/183800351 conn(0x7f698c00c380 msgr2=0x7f698c00c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:56:01.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.390+0000 7f7b39532640 1 -- 172.21.15.50:0/3338735059 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7b340c5fb0 msgr2=0x7f7b340c63d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:01.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.390+0000 7f7b39532640 1 --2- 172.21.15.50:0/3338735059 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7b340c5fb0 0x7f7b340c63d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7b2c009d90 tx=0x7f7b2c01c800 comp rx=0 tx=0).stop 2024-04-01T01:56:01.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.394+0000 7f148d5bd640 1 -- 172.21.15.50:0/3373357512 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1488153f70 msgr2=0x7f1488071250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:01.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.394+0000 7f148d5bd640 1 --2- 172.21.15.50:0/3373357512 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1488153f70 0x7f1488071250 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f14780097c0 tx=0x7f147801c4c0 comp rx=0 tx=0).stop 2024-04-01T01:56:01.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.394+0000 7f6998c95640 1 -- 172.21.15.50:0/183800351 shutdown_connections 2024-04-01T01:56:01.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.394+0000 7f6998c95640 1 -- 172.21.15.50:0/183800351 wait complete. 2024-04-01T01:56:01.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.394+0000 7f6998c95640 1 Processor -- start 2024-04-01T01:56:01.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.394+0000 7f148d5bd640 1 -- 172.21.15.50:0/3373357512 shutdown_connections 2024-04-01T01:56:01.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.394+0000 7f148d5bd640 1 --2- 172.21.15.50:0/3373357512 >> v2:172.21.15.97:3300/0 conn(0x7f1488071790 0x7f148806ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:01.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.394+0000 7f148d5bd640 1 --2- 172.21.15.50:0/3373357512 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1488153f70 0x7f1488071250 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:01.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.394+0000 7f148d5bd640 1 -- 172.21.15.50:0/3373357512 >> 172.21.15.50:0/3373357512 conn(0x7f1488067560 msgr2=0x7f148806b220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:56:01.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.394+0000 7f7b39532640 1 -- 172.21.15.50:0/3338735059 shutdown_connections 2024-04-01T01:56:01.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.394+0000 7f7b39532640 1 --2- 172.21.15.50:0/3338735059 >> v2:172.21.15.50:3300/0 conn(0x7f7b340c7c10 0x7f7b340c8080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:01.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.394+0000 7f7b39532640 1 --2- 172.21.15.50:0/3338735059 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7b340c5fb0 0x7f7b340c63d0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:01.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.394+0000 7f7b39532640 1 -- 172.21.15.50:0/3338735059 >> 172.21.15.50:0/3338735059 conn(0x7f7b3406b220 msgr2=0x7f7b3406b630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:56:01.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.394+0000 7f6998c95640 1 -- start start 2024-04-01T01:56:01.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.394+0000 7f6998c95640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f698c050360 0x7f698c171240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:01.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.394+0000 7f7b39532640 1 -- 172.21.15.50:0/3338735059 shutdown_connections 2024-04-01T01:56:01.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.394+0000 7f6998c95640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f698c009e50 0x7f698c04dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:01.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.394+0000 7f6998c95640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f698c04e770 0x7f698c0d2330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:01.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.394+0000 7f6998c95640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f698c0dcc30 con 0x7f698c04e770 2024-04-01T01:56:01.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.394+0000 7f6998c95640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f698c0e0fd0 con 0x7f698c050360 2024-04-01T01:56:01.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.394+0000 7f7b39532640 1 -- 172.21.15.50:0/3338735059 wait complete. 2024-04-01T01:56:01.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.394+0000 7f6992ffd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f698c009e50 0x7f698c04dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:01.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.394+0000 7f6992ffd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f698c009e50 0x7f698c04dc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.50:54372/0 (socket says 172.21.15.50:54372) 2024-04-01T01:56:01.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.394+0000 7f69937fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f698c050360 0x7f698c171240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:01.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.394+0000 7f6992ffd640 1 -- 172.21.15.50:0/4087269701 learned_addr learned my addr 172.21.15.50:0/4087269701 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T01:56:01.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.394+0000 7f6993fff640 1 --2- 172.21.15.50:0/4087269701 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f698c04e770 0x7f698c0d2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:01.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.394+0000 7f6998c95640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f698c0e0110 con 0x7f698c009e50 2024-04-01T01:56:01.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.398+0000 7f148d5bd640 1 -- 172.21.15.50:0/3373357512 shutdown_connections 2024-04-01T01:56:01.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.398+0000 7f148d5bd640 1 -- 172.21.15.50:0/3373357512 wait complete. 2024-04-01T01:56:01.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.398+0000 7f6993fff640 1 -- 172.21.15.50:0/4087269701 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f698c009e50 msgr2=0x7f698c04dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:01.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.398+0000 7f6993fff640 1 --2- 172.21.15.50:0/4087269701 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f698c009e50 0x7f698c04dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:01.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.398+0000 7f6993fff640 1 -- 172.21.15.50:0/4087269701 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f698c050360 msgr2=0x7f698c171240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:01.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.398+0000 7f6993fff640 1 --2- 172.21.15.50:0/4087269701 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f698c050360 0x7f698c171240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:01.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.398+0000 7f6993fff640 1 -- 172.21.15.50:0/4087269701 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f698c166670 con 0x7f698c04e770 2024-04-01T01:56:01.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.398+0000 7f7b39532640 1 Processor -- start 2024-04-01T01:56:01.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.398+0000 7f6993fff640 1 --2- 172.21.15.50:0/4087269701 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f698c04e770 0x7f698c0d2330 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6994068020 tx=0x7f6984005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:56:01.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.398+0000 7f148d5bd640 1 Processor -- start 2024-04-01T01:56:01.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.398+0000 7f7b39532640 1 -- start start 2024-04-01T01:56:01.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.398+0000 7f7b39532640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7b340c5fb0 0x7f7b34143b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:01.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.398+0000 7f7b39532640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7b340c7c10 0x7f7b341440c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:01.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.398+0000 7f7b39532640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b34153fc0 0x7f7b340c9090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:01.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.398+0000 7f7b39532640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7b341543a0 con 0x7f7b34153fc0 2024-04-01T01:56:01.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.398+0000 7f7b39532640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f7b3415d4c0 con 0x7f7b340c7c10 2024-04-01T01:56:01.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.398+0000 7f7b39532640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f7b3415e0f0 con 0x7f7b340c5fb0 2024-04-01T01:56:01.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.398+0000 7f7b38d31640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b34153fc0 0x7f7b340c9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:01.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.398+0000 7f7b38d31640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b34153fc0 0x7f7b340c9090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50720/0 (socket says 172.21.15.50:50720) 2024-04-01T01:56:01.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.398+0000 7f7b38d31640 1 -- 172.21.15.50:0/1959115843 learned_addr learned my addr 172.21.15.50:0/1959115843 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T01:56:01.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.398+0000 7f7b33fff640 1 --2- 172.21.15.50:0/1959115843 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7b340c5fb0 0x7f7b34143b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:01.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.398+0000 7f7b337fe640 1 --2- 172.21.15.50:0/1959115843 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7b340c7c10 0x7f7b341440c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:01.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.398+0000 7f148d5bd640 1 -- start start 2024-04-01T01:56:01.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.398+0000 7f148d5bd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1488071790 0x7f14881f8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:01.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.398+0000 7f148d5bd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14880c6270 0x7f14881f9150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:01.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.398+0000 7f148d5bd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1488153f70 0x7f1488150c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:01.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.398+0000 7f148d5bd640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f14881544d0 con 0x7f14880c6270 2024-04-01T01:56:01.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.398+0000 7f148d5bd640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f1488154350 con 0x7f1488153f70 2024-04-01T01:56:01.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.398+0000 7f148d5bd640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f14880c8960 con 0x7f1488071790 2024-04-01T01:56:01.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.398+0000 7f7b38d31640 1 -- 172.21.15.50:0/1959115843 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7b340c5fb0 msgr2=0x7f7b34143b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:01.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.398+0000 7f7b38d31640 1 --2- 172.21.15.50:0/1959115843 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7b340c5fb0 0x7f7b34143b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:01.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.398+0000 7f7b38d31640 1 -- 172.21.15.50:0/1959115843 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7b340c7c10 msgr2=0x7f7b341440c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:01.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.398+0000 7f7b38d31640 1 --2- 172.21.15.50:0/1959115843 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7b340c7c10 0x7f7b341440c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:01.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.398+0000 7f7b38d31640 1 -- 172.21.15.50:0/1959115843 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b340cb360 con 0x7f7b34153fc0 2024-04-01T01:56:01.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.398+0000 7f697ffff640 1 -- 172.21.15.50:0/4087269701 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69940504b0 con 0x7f698c04e770 2024-04-01T01:56:01.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.398+0000 7f6998c95640 1 -- 172.21.15.50:0/4087269701 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f698c166950 con 0x7f698c04e770 2024-04-01T01:56:01.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.398+0000 7f6998c95640 1 -- 172.21.15.50:0/4087269701 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f698c0d1500 con 0x7f698c04e770 2024-04-01T01:56:01.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.398+0000 7f7b38d31640 1 --2- 172.21.15.50:0/1959115843 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b34153fc0 0x7f7b340c9090 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7b2400e850 tx=0x7f7b2400ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:56:01.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.402+0000 7f697ffff640 1 -- 172.21.15.50:0/4087269701 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6994130420 con 0x7f698c04e770 2024-04-01T01:56:01.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.402+0000 7f14867fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14880c6270 0x7f14881f9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:01.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.402+0000 7f14867fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14880c6270 0x7f14881f9150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50722/0 (socket says 172.21.15.50:50722) 2024-04-01T01:56:01.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.402+0000 7f14867fc640 1 -- 172.21.15.50:0/784174987 learned_addr learned my addr 172.21.15.50:0/784174987 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T01:56:01.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.402+0000 7f14867fc640 1 -- 172.21.15.50:0/784174987 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1488071790 msgr2=0x7f14881f8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:01.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.402+0000 7f14867fc640 1 --2- 172.21.15.50:0/784174987 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1488071790 0x7f14881f8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:01.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.402+0000 7f14867fc640 1 -- 172.21.15.50:0/784174987 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1488153f70 msgr2=0x7f1488150c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:01.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.402+0000 7f14867fc640 1 --2- 172.21.15.50:0/784174987 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1488153f70 0x7f1488150c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:01.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.402+0000 7f14867fc640 1 -- 172.21.15.50:0/784174987 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14881f78c0 con 0x7f14880c6270 2024-04-01T01:56:01.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.402+0000 7f14867fc640 1 --2- 172.21.15.50:0/784174987 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14880c6270 0x7f14881f9150 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f147c00b3e0 tx=0x7f147c00b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:56:01.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.402+0000 7f697ffff640 1 -- 172.21.15.50:0/4087269701 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69941307d0 con 0x7f698c04e770 2024-04-01T01:56:01.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.402+0000 7f7b30ff9640 1 -- 172.21.15.50:0/1959115843 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b24017070 con 0x7f7b34153fc0 2024-04-01T01:56:01.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.402+0000 7f7b30ff9640 1 -- 172.21.15.50:0/1959115843 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b2400c940 con 0x7f7b34153fc0 2024-04-01T01:56:01.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.402+0000 7f7b39532640 1 -- 172.21.15.50:0/1959115843 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b34150be0 con 0x7f7b34153fc0 2024-04-01T01:56:01.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.402+0000 7f7b30ff9640 1 -- 172.21.15.50:0/1959115843 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b2400cd10 con 0x7f7b34153fc0 2024-04-01T01:56:01.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.402+0000 7f7b39532640 1 -- 172.21.15.50:0/1959115843 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b34150620 con 0x7f7b34153fc0 2024-04-01T01:56:01.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.402+0000 7f697ffff640 1 -- 172.21.15.50:0/4087269701 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 87103+0+0 (secure 0 0 0) 0x7f6994130970 con 0x7f698c04e770 2024-04-01T01:56:01.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.402+0000 7f697ffff640 1 --2- 172.21.15.50:0/4087269701 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f6978067520 0x7f69780699e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:01.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.402+0000 7f697ffff640 1 -- 172.21.15.50:0/4087269701 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f6994199d60 con 0x7f698c04e770 2024-04-01T01:56:01.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.402+0000 7f69937fe640 1 --2- 172.21.15.50:0/4087269701 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f6978067520 0x7f69780699e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:01.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.406+0000 7f7b39532640 1 -- 172.21.15.50:0/1959115843 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b3404f4c0 con 0x7f7b34153fc0 2024-04-01T01:56:01.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.406+0000 7f7b30ff9640 1 -- 172.21.15.50:0/1959115843 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 87103+0+0 (secure 0 0 0) 0x7f7b2401a070 con 0x7f7b34153fc0 2024-04-01T01:56:01.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.406+0000 7f146f7fe640 1 -- 172.21.15.50:0/784174987 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f147c015020 con 0x7f14880c6270 2024-04-01T01:56:01.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.406+0000 7f69937fe640 1 --2- 172.21.15.50:0/4087269701 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f6978067520 0x7f69780699e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6980000c10 tx=0x7f6980009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:56:01.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.406+0000 7f148d5bd640 1 -- 172.21.15.50:0/784174987 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14881f7b60 con 0x7f14880c6270 2024-04-01T01:56:01.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.406+0000 7f148d5bd640 1 -- 172.21.15.50:0/784174987 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14881f8410 con 0x7f14880c6270 2024-04-01T01:56:01.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.406+0000 7f7b30ff9640 1 --2- 172.21.15.50:0/1959115843 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f7b20067470 0x7f7b20069930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:01.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.406+0000 7f7b30ff9640 1 -- 172.21.15.50:0/1959115843 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f7b24085500 con 0x7f7b34153fc0 2024-04-01T01:56:01.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.406+0000 7f7b33fff640 1 --2- 172.21.15.50:0/1959115843 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f7b20067470 0x7f7b20069930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:01.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.406+0000 7f146f7fe640 1 -- 172.21.15.50:0/784174987 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f147c011830 con 0x7f14880c6270 2024-04-01T01:56:01.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.406+0000 7f7b33fff640 1 --2- 172.21.15.50:0/1959115843 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f7b20067470 0x7f7b20069930 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7b28000f70 tx=0x7f7b2800b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:56:01.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.406+0000 7f146f7fe640 1 -- 172.21.15.50:0/784174987 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f147c011c00 con 0x7f14880c6270 2024-04-01T01:56:01.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.406+0000 7f6998c95640 1 -- 172.21.15.50:0/4087269701 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69740052a0 con 0x7f698c04e770 2024-04-01T01:56:01.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.410+0000 7f148d5bd640 1 -- 172.21.15.50:0/784174987 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14680052a0 con 0x7f14880c6270 2024-04-01T01:56:01.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.410+0000 7f7b30ff9640 1 -- 172.21.15.50:0/1959115843 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+176632 (secure 0 0 0) 0x7f7b24055cb0 con 0x7f7b34153fc0 2024-04-01T01:56:01.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.414+0000 7f697ffff640 1 -- 172.21.15.50:0/4087269701 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+176632 (secure 0 0 0) 0x7f6994135060 con 0x7f698c04e770 2024-04-01T01:56:01.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.418+0000 7f146f7fe640 1 -- 172.21.15.50:0/784174987 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 87103+0+0 (secure 0 0 0) 0x7f147c018020 con 0x7f14880c6270 2024-04-01T01:56:01.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.418+0000 7f146f7fe640 1 --2- 172.21.15.50:0/784174987 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f1474067470 0x7f1474069930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:01.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.418+0000 7f146f7fe640 1 -- 172.21.15.50:0/784174987 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f147c0542c0 con 0x7f14880c6270 2024-04-01T01:56:01.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.418+0000 7f1486ffd640 1 --2- 172.21.15.50:0/784174987 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f1474067470 0x7f1474069930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:01.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.418+0000 7f1486ffd640 1 --2- 172.21.15.50:0/784174987 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f1474067470 0x7f1474069930 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f14780ad000 tx=0x7f1478004740 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:56:01.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.426+0000 7f146f7fe640 1 -- 172.21.15.50:0/784174987 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+176632 (secure 0 0 0) 0x7f147c01f020 con 0x7f14880c6270 2024-04-01T01:56:01.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.458+0000 7f4a13fff640 1 Processor -- start 2024-04-01T01:56:01.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.458+0000 7f4a13fff640 1 -- start start 2024-04-01T01:56:01.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.458+0000 7f4a13fff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f4a0c031a20 0x7f4a0c0e26e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:01.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.458+0000 7f4a13fff640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a0c0dee20 con 0x7f4a0c0d90b0 2024-04-01T01:56:01.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.458+0000 7f4a13fff640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a0c0df100 con 0x7f4a0c04f9c0 2024-04-01T01:56:01.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.458+0000 7f4a12ffd640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f4a0c04f9c0 0x7f4a0c050db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.50:50452/0 (socket says 172.21.15.50:50452) 2024-04-01T01:56:01.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.458+0000 7f4a12ffd640 1 -- 172.21.15.50:0/1088522763 learned_addr learned my addr 172.21.15.50:0/1088522763 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-04-01T01:56:01.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.462+0000 7f4a137fe640 1 --2- 172.21.15.50:0/1088522763 >> v2:172.21.15.97:3300/0 conn(0x7f4a0c031a20 0x7f4a0c0e26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:01.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.462+0000 7f4a13fff640 1 -- 172.21.15.50:0/1088522763 --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f4a0c0d94f0 con 0x7f4a0c031a20 2024-04-01T01:56:01.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.462+0000 7f4a11ffb640 1 -- 172.21.15.50:0/1088522763 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2117399827 0 0) 0x7f4a0c0df100 con 0x7f4a0c04f9c0 2024-04-01T01:56:01.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.462+0000 7f4a11ffb640 1 -- 172.21.15.50:0/1088522763 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f49fc003530 con 0x7f4a0c04f9c0 2024-04-01T01:56:01.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.462+0000 7f4a137fe640 1 -- 172.21.15.50:0/1088522763 >> v1:172.21.15.97:6789/0 conn(0x7f4a0c04f9c0 legacy=0x7f4a0c050db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:01.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.462+0000 7f4a137fe640 1 -- 172.21.15.50:0/1088522763 >> v1:172.21.15.50:6789/0 conn(0x7f4a0c0d90b0 legacy=0x7f4a0c052340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:56:01.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.462+0000 7f4a137fe640 1 -- 172.21.15.50:0/1088522763 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a0c0df3e0 con 0x7f4a0c031a20 2024-04-01T01:56:01.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.462+0000 7fded7fff640 1 Processor -- start 2024-04-01T01:56:01.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.466+0000 7fded7fff640 1 -- start start 2024-04-01T01:56:01.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.466+0000 7f4a137fe640 1 --2- 172.21.15.50:0/1088522763 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4a0c031a20 0x7f4a0c0e26e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4a14000b70 tx=0x7f4a1409a440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8497da470899c113 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:56:01.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.466+0000 7f4a11ffb640 1 -- 172.21.15.50:0/1088522763 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a1406e420 con 0x7f4a0c031a20 2024-04-01T01:56:01.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.466+0000 7f4a11ffb640 1 -- 172.21.15.50:0/1088522763 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a1406e600 con 0x7f4a0c031a20 2024-04-01T01:56:01.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.466+0000 7f4a11ffb640 1 -- 172.21.15.50:0/1088522763 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a1406ea70 con 0x7f4a0c031a20 2024-04-01T01:56:01.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.466+0000 7f4a13fff640 1 -- 172.21.15.50:0/1088522763 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4a0c031a20 msgr2=0x7f4a0c0e26e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:01.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.466+0000 7f4a13fff640 1 --2- 172.21.15.50:0/1088522763 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4a0c031a20 0x7f4a0c0e26e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4a14000b70 tx=0x7f4a1409a440 comp rx=0 tx=0).stop 2024-04-01T01:56:01.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.466+0000 7fded7fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fded80c6da0 0x7fded80c7f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:01.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.466+0000 7fded6ffd640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fded80c56f0 0x7fded8072720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44686/0 (socket says 172.21.15.50:44686) 2024-04-01T01:56:01.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.466+0000 7f4a13fff640 1 -- 172.21.15.50:0/1088522763 shutdown_connections 2024-04-01T01:56:01.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.466+0000 7f4a13fff640 1 --2- 172.21.15.50:0/1088522763 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4a0c031a20 0x7f4a0c0e26e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:01.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.466+0000 7f4a13fff640 1 -- 172.21.15.50:0/1088522763 >> 172.21.15.50:0/1088522763 conn(0x7f4a0c00c380 msgr2=0x7f4a0c00c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:56:01.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.466+0000 7fded67fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fded80c6da0 0x7fded80c7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:01.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.466+0000 7fded67fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fded80c6da0 0x7fded80c7f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50736/0 (socket says 172.21.15.50:50736) 2024-04-01T01:56:01.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.466+0000 7f4a13fff640 1 -- 172.21.15.50:0/1088522763 shutdown_connections 2024-04-01T01:56:01.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.466+0000 7fded6ffd640 1 -- 172.21.15.50:0/1533429182 learned_addr learned my addr 172.21.15.50:0/1533429182 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-04-01T01:56:01.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.466+0000 7fded7fff640 1 --2- 172.21.15.50:0/1533429182 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fded8072e30 0x7fded80c5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:01.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.466+0000 7fded7fff640 1 -- 172.21.15.50:0/1533429182 --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fded80c8560 con 0x7fded80c56f0 2024-04-01T01:56:01.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.466+0000 7fded7fff640 1 -- 172.21.15.50:0/1533429182 --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fded80c4170 con 0x7fded80c6da0 2024-04-01T01:56:01.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.466+0000 7fded7fff640 1 -- 172.21.15.50:0/1533429182 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fded80c87e0 con 0x7fded8072e30 2024-04-01T01:56:01.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.466+0000 7fded77fe640 1 --2- 172.21.15.50:0/1533429182 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fded8072e30 0x7fded80c5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:01.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.466+0000 7fded5ffb640 1 -- 172.21.15.50:0/1533429182 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4163091077 0 0) 0x7fdec8001120 con 0x7fded80c56f0 2024-04-01T01:56:01.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.466+0000 7fded5ffb640 1 -- 172.21.15.50:0/1533429182 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdec0003530 con 0x7fded80c56f0 2024-04-01T01:56:01.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.466+0000 7fded5ffb640 1 -- 172.21.15.50:0/1533429182 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 796220924 0 0) 0x7fdec0003530 con 0x7fded80c56f0 2024-04-01T01:56:01.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.466+0000 7fded5ffb640 1 -- 172.21.15.50:0/1533429182 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fded8072e30 msgr2=0x7fded80c5ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:56:01.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.466+0000 7fded5ffb640 1 --2- 172.21.15.50:0/1533429182 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fded8072e30 0x7fded80c5ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:01.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.466+0000 7fded5ffb640 1 -- 172.21.15.50:0/1533429182 >> v2:172.21.15.50:3300/0 conn(0x7fded80c6da0 msgr2=0x7fded80c7f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:56:01.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.466+0000 7fded5ffb640 1 --2- 172.21.15.50:0/1533429182 >> v2:172.21.15.50:3300/0 conn(0x7fded80c6da0 0x7fded80c7f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:01.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.466+0000 7fded5ffb640 1 -- 172.21.15.50:0/1533429182 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fded80c8ac0 con 0x7fded80c56f0 2024-04-01T01:56:01.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.466+0000 7fded5ffb640 1 -- 172.21.15.50:0/1533429182 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2779672543 0 0) 0x7fdec8001850 con 0x7fded80c56f0 2024-04-01T01:56:01.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.466+0000 7fded5ffb640 1 -- 172.21.15.50:0/1533429182 >> v1:172.21.15.50:6789/0 conn(0x7fded80c56f0 legacy=0x7fded8072720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:01.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.466+0000 7fded5ffb640 1 --2- 172.21.15.50:0/1533429182 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fded8072e30 0x7fdec0003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:01.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.466+0000 7fded5ffb640 1 --2- 172.21.15.50:0/1533429182 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdec0003fb0 0x7fdec0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:01.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.466+0000 7fded5ffb640 1 --2- 172.21.15.50:0/1533429182 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdec0004d50 0x7fdec00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:01.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.466+0000 7fded5ffb640 1 -- 172.21.15.50:0/1533429182 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fded80c4170 con 0x7fdec0004d50 2024-04-01T01:56:01.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.466+0000 7fded5ffb640 1 -- 172.21.15.50:0/1533429182 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fded80c87e0 con 0x7fdec0003fb0 2024-04-01T01:56:01.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.466+0000 7fded5ffb640 1 -- 172.21.15.50:0/1533429182 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fdec000ba00 con 0x7fded8072e30 2024-04-01T01:56:01.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.466+0000 7fded77fe640 1 --2- 172.21.15.50:0/1533429182 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdec0004d50 0x7fdec00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:01.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.466+0000 7fded6ffd640 1 --2- 172.21.15.50:0/1533429182 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fded8072e30 0x7fdec0003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:01.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.466+0000 7fded67fc640 1 --2- 172.21.15.50:0/1533429182 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdec0003fb0 0x7fdec0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:01.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.466+0000 7f4a13fff640 1 -- 172.21.15.50:0/1088522763 wait complete. 2024-04-01T01:56:01.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.466+0000 7f4a13fff640 1 Processor -- start 2024-04-01T01:56:01.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.466+0000 7fded77fe640 1 -- 172.21.15.50:0/1533429182 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fded8072e30 msgr2=0x7fdec0003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:56:01.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.466+0000 7fded77fe640 1 --2- 172.21.15.50:0/1533429182 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fded8072e30 0x7fdec0003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:01.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.466+0000 7fded77fe640 1 -- 172.21.15.50:0/1533429182 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdec0003fb0 msgr2=0x7fdec0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:56:01.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.466+0000 7fded77fe640 1 --2- 172.21.15.50:0/1533429182 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdec0003fb0 0x7fdec0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:01.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.466+0000 7fded77fe640 1 -- 172.21.15.50:0/1533429182 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fded80c8ac0 con 0x7fdec0004d50 2024-04-01T01:56:01.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.470+0000 7f4a13fff640 1 -- start start 2024-04-01T01:56:01.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.470+0000 7f4a13fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a0c04f9c0 0x7f4a0c008e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:01.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.470+0000 7f4a13fff640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4a0c0d90b0 0x7f4a0c0de360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:01.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.470+0000 7f4a13fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4a0c00a8c0 0x7f4a0c0cecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:01.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.470+0000 7f4a13fff640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4a0c0514c0 con 0x7f4a0c04f9c0 2024-04-01T01:56:01.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.470+0000 7f4a13fff640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f4a0c0df9a0 con 0x7f4a0c00a8c0 2024-04-01T01:56:01.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.470+0000 7f4a13fff640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f4a0c051640 con 0x7f4a0c0d90b0 2024-04-01T01:56:01.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.470+0000 7f4a12ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a0c04f9c0 0x7f4a0c008e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:01.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.470+0000 7f4a12ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a0c04f9c0 0x7f4a0c008e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50748/0 (socket says 172.21.15.50:50748) 2024-04-01T01:56:01.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.470+0000 7f4a12ffd640 1 -- 172.21.15.50:0/1067706483 learned_addr learned my addr 172.21.15.50:0/1067706483 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T01:56:01.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.470+0000 7f4a127fc640 1 --2- 172.21.15.50:0/1067706483 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4a0c0d90b0 0x7f4a0c0de360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:01.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.470+0000 7f4a137fe640 1 --2- 172.21.15.50:0/1067706483 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4a0c00a8c0 0x7f4a0c0cecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:01.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.470+0000 7f4a12ffd640 1 -- 172.21.15.50:0/1067706483 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4a0c0d90b0 msgr2=0x7f4a0c0de360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:01.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.470+0000 7f4a12ffd640 1 --2- 172.21.15.50:0/1067706483 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4a0c0d90b0 0x7f4a0c0de360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:01.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.470+0000 7f4a12ffd640 1 -- 172.21.15.50:0/1067706483 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4a0c00a8c0 msgr2=0x7f4a0c0cecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:01.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.470+0000 7f4a12ffd640 1 --2- 172.21.15.50:0/1067706483 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4a0c00a8c0 0x7f4a0c0cecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:01.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.470+0000 7f4a12ffd640 1 -- 172.21.15.50:0/1067706483 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a0c02da00 con 0x7f4a0c04f9c0 2024-04-01T01:56:01.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.470+0000 7f4a12ffd640 1 --2- 172.21.15.50:0/1067706483 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a0c04f9c0 0x7f4a0c008e10 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4a0400c3f0 tx=0x7f4a0400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:56:01.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.470+0000 7f49fb7fe640 1 -- 172.21.15.50:0/1067706483 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a04017070 con 0x7f4a0c04f9c0 2024-04-01T01:56:01.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.470+0000 7fded77fe640 1 --2- 172.21.15.50:0/1533429182 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdec0004d50 0x7fdec00051d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fded0009fc0 tx=0x7fded001cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c82a2d7b7191057 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:56:01.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.470+0000 7fded5ffb640 1 -- 172.21.15.50:0/1533429182 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fded00b2070 con 0x7fdec0004d50 2024-04-01T01:56:01.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.470+0000 7fded5ffb640 1 -- 172.21.15.50:0/1533429182 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fded00a5c90 con 0x7fdec0004d50 2024-04-01T01:56:01.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.470+0000 7fded5ffb640 1 -- 172.21.15.50:0/1533429182 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fded0009c10 con 0x7fdec0004d50 2024-04-01T01:56:01.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.470+0000 7f4a13fff640 1 -- 172.21.15.50:0/1067706483 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a0c007f60 con 0x7f4a0c04f9c0 2024-04-01T01:56:01.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.470+0000 7f4a13fff640 1 -- 172.21.15.50:0/1067706483 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a0c0303a0 con 0x7f4a0c04f9c0 2024-04-01T01:56:01.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.474+0000 7f49fb7fe640 1 -- 172.21.15.50:0/1067706483 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a04005cf0 con 0x7f4a0c04f9c0 2024-04-01T01:56:01.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.474+0000 7f4a13fff640 1 -- 172.21.15.50:0/1067706483 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a0c005720 con 0x7f4a0c04f9c0 2024-04-01T01:56:01.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.474+0000 7f49fb7fe640 1 -- 172.21.15.50:0/1067706483 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a040072f0 con 0x7f4a0c04f9c0 2024-04-01T01:56:01.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.474+0000 7fded7fff640 1 -- 172.21.15.50:0/1533429182 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdec0004d50 msgr2=0x7fdec00051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:01.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.474+0000 7fded7fff640 1 --2- 172.21.15.50:0/1533429182 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdec0004d50 0x7fdec00051d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fded0009fc0 tx=0x7fded001cc80 comp rx=0 tx=0).stop 2024-04-01T01:56:01.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.474+0000 7fded77fe640 1 -- 172.21.15.50:0/1533429182 reap_dead start 2024-04-01T01:56:01.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.474+0000 7fded7fff640 1 -- 172.21.15.50:0/1533429182 shutdown_connections 2024-04-01T01:56:01.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.474+0000 7fded7fff640 1 -- 172.21.15.50:0/1533429182 >> 172.21.15.50:0/1533429182 conn(0x7fded80c8f10 msgr2=0x7fded80c92f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:56:01.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.474+0000 7fded7fff640 1 -- 172.21.15.50:0/1533429182 shutdown_connections 2024-04-01T01:56:01.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.474+0000 7fded7fff640 1 -- 172.21.15.50:0/1533429182 wait complete. 2024-04-01T01:56:01.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.474+0000 7f49fb7fe640 1 -- 172.21.15.50:0/1067706483 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 87103+0+0 (secure 0 0 0) 0x7f4a0401a070 con 0x7f4a0c04f9c0 2024-04-01T01:56:01.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.474+0000 7f49fb7fe640 1 --2- 172.21.15.50:0/1067706483 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f4a00067450 0x7f4a00069910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:01.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.474+0000 7f4a127fc640 1 --2- 172.21.15.50:0/1067706483 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f4a00067450 0x7f4a00069910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:01.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.474+0000 7f4a127fc640 1 --2- 172.21.15.50:0/1067706483 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f4a00067450 0x7f4a00069910 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4a0c0379d0 tx=0x7f4a08009060 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:56:01.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.458+0000 7faad39c7640 1 Processor -- start 2024-04-01T01:56:01.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.478+0000 7fded7fff640 1 Processor -- start 2024-04-01T01:56:01.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.458+0000 7faad39c7640 1 -- start start 2024-04-01T01:56:01.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.478+0000 7fded7fff640 1 -- start start 2024-04-01T01:56:01.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.478+0000 7f49fb7fe640 1 -- 172.21.15.50:0/1067706483 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f4a04089060 con 0x7f4a0c04f9c0 2024-04-01T01:56:01.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.462+0000 7faad39c7640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7faacc164040 0x7faacc16a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:01.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.462+0000 7faad39c7640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faacc1674b0 0x7faacc0c7540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:01.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.462+0000 7faad39c7640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7faacc0c6270 0x7faacc0c6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:01.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.462+0000 7faad39c7640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7faacc0c8a70 con 0x7faacc0c6270 2024-04-01T01:56:01.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.462+0000 7faad39c7640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7faacc16af60 con 0x7faacc164040 2024-04-01T01:56:01.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.462+0000 7faad39c7640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7faacc16a6c0 con 0x7faacc1674b0 2024-04-01T01:56:01.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.462+0000 7faad1f64640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7faacc0c6270 0x7faacc0c6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:01.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.462+0000 7faad1f64640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7faacc0c6270 0x7faacc0c6700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50726/0 (socket says 172.21.15.50:50726) 2024-04-01T01:56:01.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.462+0000 7faad1f64640 1 -- 172.21.15.50:0/4047681239 learned_addr learned my addr 172.21.15.50:0/4047681239 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T01:56:01.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.462+0000 7faad1763640 1 --2- 172.21.15.50:0/4047681239 >> v2:172.21.15.97:3300/0 conn(0x7faacc164040 0x7faacc16a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:01.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.462+0000 7faad0f62640 1 --2- 172.21.15.50:0/4047681239 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faacc1674b0 0x7faacc0c7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:01.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.474+0000 7faad1f64640 1 -- 172.21.15.50:0/4047681239 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faacc1674b0 msgr2=0x7faacc0c7540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:56:01.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.474+0000 7faad1f64640 1 --2- 172.21.15.50:0/4047681239 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faacc1674b0 0x7faacc0c7540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:01.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.474+0000 7faad1f64640 1 -- 172.21.15.50:0/4047681239 >> v2:172.21.15.97:3300/0 conn(0x7faacc164040 msgr2=0x7faacc16a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:56:01.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.474+0000 7faad1f64640 1 --2- 172.21.15.50:0/4047681239 >> v2:172.21.15.97:3300/0 conn(0x7faacc164040 0x7faacc16a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:01.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.474+0000 7faad1f64640 1 -- 172.21.15.50:0/4047681239 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faacc16a9a0 con 0x7faacc0c6270 2024-04-01T01:56:01.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.478+0000 7faad1f64640 1 --2- 172.21.15.50:0/4047681239 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faacc0c6270 0x7faacc0c6700 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7faacc0c5f90 tx=0x7faac4030560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4727909dd0a333d server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:56:01.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.478+0000 7fded7fff640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdec0004d50 0x7fded8158c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:01.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.478+0000 7fded7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fded814b490 0x7fded8159140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:01.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.478+0000 7fded67fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fded814b490 0x7fded8159140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:01.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.478+0000 7fded6ffd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdec0004d50 0x7fded8158c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:01.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.478+0000 7fded6ffd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdec0004d50 0x7fded8158c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.50:54442/0 (socket says 172.21.15.50:54442) 2024-04-01T01:56:01.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.478+0000 7fded67fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fded814b490 0x7fded8159140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50764/0 (socket says 172.21.15.50:50764) 2024-04-01T01:56:01.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.478+0000 7fded7fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fded81547b0 0x7fded81eec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:01.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.478+0000 7fded6ffd640 1 -- 172.21.15.50:0/3949520914 learned_addr learned my addr 172.21.15.50:0/3949520914 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T01:56:01.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.478+0000 7fded7fff640 1 -- 172.21.15.50:0/3949520914 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fded81510f0 con 0x7fded814b490 2024-04-01T01:56:01.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.478+0000 7fded7fff640 1 -- 172.21.15.50:0/3949520914 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fded80c3e00 con 0x7fded81547b0 2024-04-01T01:56:01.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.478+0000 7fded7fff640 1 -- 172.21.15.50:0/3949520914 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fded8151270 con 0x7fdec0004d50 2024-04-01T01:56:01.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.478+0000 7fded77fe640 1 --2- 172.21.15.50:0/3949520914 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fded81547b0 0x7fded81eec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:01.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.478+0000 7fded67fc640 1 -- 172.21.15.50:0/3949520914 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdec0004d50 msgr2=0x7fded8158c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:01.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.478+0000 7fded67fc640 1 --2- 172.21.15.50:0/3949520914 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdec0004d50 0x7fded8158c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:01.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.478+0000 7fded67fc640 1 -- 172.21.15.50:0/3949520914 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fded81547b0 msgr2=0x7fded81eec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:01.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.478+0000 7fded67fc640 1 --2- 172.21.15.50:0/3949520914 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fded81547b0 0x7fded81eec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:01.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.478+0000 7fded67fc640 1 -- 172.21.15.50:0/3949520914 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fded8155bb0 con 0x7fded814b490 2024-04-01T01:56:01.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.478+0000 7fded67fc640 1 --2- 172.21.15.50:0/3949520914 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fded814b490 0x7fded8159140 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fded80c71c0 tx=0x7fdecc011d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:56:01.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.482+0000 7f49fb7fe640 1 -- 172.21.15.50:0/1067706483 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+176632 (secure 0 0 0) 0x7f4a04054db0 con 0x7f4a0c04f9c0 2024-04-01T01:56:01.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.482+0000 7faac3fff640 1 -- 172.21.15.50:0/4047681239 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faac40092d0 con 0x7faacc0c6270 2024-04-01T01:56:01.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.482+0000 7fdebf7fe640 1 -- 172.21.15.50:0/3949520914 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdecc019070 con 0x7fded814b490 2024-04-01T01:56:01.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.482+0000 7fded7fff640 1 -- 172.21.15.50:0/3949520914 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fded8158520 con 0x7fded814b490 2024-04-01T01:56:01.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.482+0000 7fded7fff640 1 -- 172.21.15.50:0/3949520914 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fded8158240 con 0x7fded814b490 2024-04-01T01:56:01.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.482+0000 7faac3fff640 1 -- 172.21.15.50:0/4047681239 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faac4009470 con 0x7faacc0c6270 2024-04-01T01:56:01.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.486+0000 7faad39c7640 1 -- 172.21.15.50:0/4047681239 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faacc0c6270 msgr2=0x7faacc0c6700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:01.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.486+0000 7faad39c7640 1 --2- 172.21.15.50:0/4047681239 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faacc0c6270 0x7faacc0c6700 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7faacc0c5f90 tx=0x7faac4030560 comp rx=0 tx=0).stop 2024-04-01T01:56:01.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.486+0000 7faad39c7640 1 -- 172.21.15.50:0/4047681239 shutdown_connections 2024-04-01T01:56:01.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.486+0000 7faad39c7640 1 --2- 172.21.15.50:0/4047681239 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faacc0c6270 0x7faacc0c6700 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:01.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.486+0000 7faad39c7640 1 --2- 172.21.15.50:0/4047681239 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faacc1674b0 0x7faacc0c7540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:01.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.486+0000 7faad39c7640 1 --2- 172.21.15.50:0/4047681239 >> v2:172.21.15.97:3300/0 conn(0x7faacc164040 0x7faacc16a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:01.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.486+0000 7faad39c7640 1 -- 172.21.15.50:0/4047681239 >> 172.21.15.50:0/4047681239 conn(0x7faacc067560 msgr2=0x7faacc06b220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:56:01.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.486+0000 7fdebf7fe640 1 -- 172.21.15.50:0/3949520914 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdecc004240 con 0x7fded814b490 2024-04-01T01:56:01.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.486+0000 7faad39c7640 1 -- 172.21.15.50:0/4047681239 shutdown_connections 2024-04-01T01:56:01.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.486+0000 7fdebf7fe640 1 -- 172.21.15.50:0/3949520914 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdecc023060 con 0x7fded814b490 2024-04-01T01:56:01.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.486+0000 7faad39c7640 1 -- 172.21.15.50:0/4047681239 wait complete. 2024-04-01T01:56:01.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.486+0000 7faad39c7640 1 Processor -- start 2024-04-01T01:56:01.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.486+0000 7fdebf7fe640 1 -- 172.21.15.50:0/3949520914 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 87103+0+0 (secure 0 0 0) 0x7fdecc01c070 con 0x7fded814b490 2024-04-01T01:56:01.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.486+0000 7faad39c7640 1 -- start start 2024-04-01T01:56:01.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.486+0000 7fdebf7fe640 1 --2- 172.21.15.50:0/3949520914 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fdec40673f0 0x7fdec40698b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:01.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.486+0000 7fdebf7fe640 1 -- 172.21.15.50:0/3949520914 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fdecc085a00 con 0x7fded814b490 2024-04-01T01:56:01.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.490+0000 7fded6ffd640 1 --2- 172.21.15.50:0/3949520914 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fdec40673f0 0x7fdec40698b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:01.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.490+0000 7faad39c7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faacc0c6270 0x7faacc0c9970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:01.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.490+0000 7faad39c7640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faacc164040 0x7faacc1693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:01.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.490+0000 7faad39c7640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faacc1674b0 0x7faacc169920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:01.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.490+0000 7faad39c7640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7faacc166f90 con 0x7faacc0c6270 2024-04-01T01:56:01.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.490+0000 7faad39c7640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7faacc166cb0 con 0x7faacc1674b0 2024-04-01T01:56:01.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.490+0000 7faad39c7640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7faacc0c7a80 con 0x7faacc164040 2024-04-01T01:56:01.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.490+0000 7faad1763640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faacc0c6270 0x7faacc0c9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:01.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.490+0000 7faad1763640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faacc0c6270 0x7faacc0c9970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50770/0 (socket says 172.21.15.50:50770) 2024-04-01T01:56:01.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.490+0000 7faad1763640 1 -- 172.21.15.50:0/866094041 learned_addr learned my addr 172.21.15.50:0/866094041 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T01:56:01.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.490+0000 7faad1f64640 1 --2- 172.21.15.50:0/866094041 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faacc1674b0 0x7faacc169920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:01.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.490+0000 7faad0f62640 1 --2- 172.21.15.50:0/866094041 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faacc164040 0x7faacc1693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:01.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.490+0000 7fded6ffd640 1 --2- 172.21.15.50:0/3949520914 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fdec40673f0 0x7fdec40698b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fdec8000c10 tx=0x7fdec8001740 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:56:01.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.490+0000 7faad1763640 1 -- 172.21.15.50:0/866094041 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faacc164040 msgr2=0x7faacc1693e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:01.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.490+0000 7faad1763640 1 --2- 172.21.15.50:0/866094041 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faacc164040 0x7faacc1693e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:01.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.490+0000 7faad1763640 1 -- 172.21.15.50:0/866094041 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faacc1674b0 msgr2=0x7faacc169920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:01.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.490+0000 7faad1763640 1 --2- 172.21.15.50:0/866094041 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faacc1674b0 0x7faacc169920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:01.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.490+0000 7faad1763640 1 -- 172.21.15.50:0/866094041 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faacc0c27a0 con 0x7faacc0c6270 2024-04-01T01:56:01.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.490+0000 7faad1763640 1 --2- 172.21.15.50:0/866094041 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faacc0c6270 0x7faacc0c9970 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7faabc00ba30 tx=0x7faabc00bef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:56:01.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.490+0000 7faac1ffb640 1 -- 172.21.15.50:0/866094041 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faabc008aa0 con 0x7faacc0c6270 2024-04-01T01:56:01.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.490+0000 7faad39c7640 1 -- 172.21.15.50:0/866094041 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faacc160460 con 0x7faacc0c6270 2024-04-01T01:56:01.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.490+0000 7faad39c7640 1 -- 172.21.15.50:0/866094041 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faacc0cb020 con 0x7faacc0c6270 2024-04-01T01:56:01.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.490+0000 7faac1ffb640 1 -- 172.21.15.50:0/866094041 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faabc008c40 con 0x7faacc0c6270 2024-04-01T01:56:01.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.490+0000 7faac1ffb640 1 -- 172.21.15.50:0/866094041 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faabc015400 con 0x7faacc0c6270 2024-04-01T01:56:01.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.490+0000 7fded7fff640 1 -- 172.21.15.50:0/3949520914 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdeb80052a0 con 0x7fded814b490 2024-04-01T01:56:01.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.490+0000 7faad39c7640 1 -- 172.21.15.50:0/866094041 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faaac0052a0 con 0x7faacc0c6270 2024-04-01T01:56:01.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.490+0000 7faac1ffb640 1 -- 172.21.15.50:0/866094041 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 87103+0+0 (secure 0 0 0) 0x7faabc015620 con 0x7faacc0c6270 2024-04-01T01:56:01.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.494+0000 7faac1ffb640 1 --2- 172.21.15.50:0/866094041 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7faab8067560 0x7faab8069a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:01.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.494+0000 7faad0f62640 1 --2- 172.21.15.50:0/866094041 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7faab8067560 0x7faab8069a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:01.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.494+0000 7faad0f62640 1 --2- 172.21.15.50:0/866094041 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7faab8067560 0x7faab8069a20 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7faacc08ba50 tx=0x7faac8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:56:01.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.498+0000 7faac1ffb640 1 -- 172.21.15.50:0/866094041 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7faabc053590 con 0x7faacc0c6270 2024-04-01T01:56:01.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.502+0000 7fdebf7fe640 1 -- 172.21.15.50:0/3949520914 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+176632 (secure 0 0 0) 0x7fdecc0560d0 con 0x7fded814b490 2024-04-01T01:56:01.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.510+0000 7faac1ffb640 1 -- 172.21.15.50:0/866094041 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+176632 (secure 0 0 0) 0x7faabc055bf0 con 0x7faacc0c6270 2024-04-01T01:56:01.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.514+0000 7f5749356640 1 Processor -- start 2024-04-01T01:56:01.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.514+0000 7f5749356640 1 -- start start 2024-04-01T01:56:01.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.514+0000 7f5749356640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5744158230 0x7f57440c5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:01.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.514+0000 7f5749356640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57440726a0 con 0x7f57440c83e0 2024-04-01T01:56:01.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.514+0000 7f5749356640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5744072940 con 0x7f5744071190 2024-04-01T01:56:01.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.514+0000 7f5749356640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f5744072360 con 0x7f5744158230 2024-04-01T01:56:01.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.514+0000 7f5742ffd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5744158230 0x7f57440c5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:01.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.514+0000 7f57437fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f57440c83e0 0x7f5744168950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44698/0 (socket says 172.21.15.50:44698) 2024-04-01T01:56:01.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.514+0000 7f57437fe640 1 -- 172.21.15.50:0/3749048474 learned_addr learned my addr 172.21.15.50:0/3749048474 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-04-01T01:56:01.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.514+0000 7f5742ffd640 1 -- 172.21.15.50:0/3749048474 >> v1:172.21.15.97:6789/0 conn(0x7f5744071190 legacy=0x7f57440c7cd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-01T01:56:01.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.514+0000 7f5742ffd640 1 -- 172.21.15.50:0/3749048474 >> v1:172.21.15.50:6789/0 conn(0x7f57440c83e0 legacy=0x7f5744168950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:01.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.514+0000 7f5742ffd640 1 -- 172.21.15.50:0/3749048474 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57440c6940 con 0x7f5744158230 2024-04-01T01:56:01.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.518+0000 7f5742ffd640 1 --2- 172.21.15.50:0/3749048474 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5744158230 0x7f57440c5fa0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f573c009dc0 tx=0x7f573c01c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=976e99de5eb7bcb1 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:56:01.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.518+0000 7f5741ffb640 1 -- 172.21.15.50:0/3749048474 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f573c0b2070 con 0x7f5744158230 2024-04-01T01:56:01.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.518+0000 7f5741ffb640 1 -- 172.21.15.50:0/3749048474 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f573c0a5920 con 0x7f5744158230 2024-04-01T01:56:01.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.522+0000 7f5749356640 1 -- 172.21.15.50:0/3749048474 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5744158230 msgr2=0x7f57440c5fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:01.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.522+0000 7f5749356640 1 --2- 172.21.15.50:0/3749048474 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5744158230 0x7f57440c5fa0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f573c009dc0 tx=0x7f573c01c950 comp rx=0 tx=0).stop 2024-04-01T01:56:01.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.522+0000 7f5749356640 1 -- 172.21.15.50:0/3749048474 shutdown_connections 2024-04-01T01:56:01.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.522+0000 7f5749356640 1 --2- 172.21.15.50:0/3749048474 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5744158230 0x7f57440c5fa0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:01.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.522+0000 7f5749356640 1 -- 172.21.15.50:0/3749048474 >> 172.21.15.50:0/3749048474 conn(0x7f574406b220 msgr2=0x7f574406b630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:56:01.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.522+0000 7f5749356640 1 -- 172.21.15.50:0/3749048474 shutdown_connections 2024-04-01T01:56:01.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.522+0000 7f5749356640 1 -- 172.21.15.50:0/3749048474 wait complete. 2024-04-01T01:56:01.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.522+0000 7f5749356640 1 Processor -- start 2024-04-01T01:56:01.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.522+0000 7f5749356640 1 -- start start 2024-04-01T01:56:01.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.526+0000 7f5749356640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5744071190 0x7f57441466d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:01.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.526+0000 7f5749356640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57440c83e0 0x7f574414a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:01.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.526+0000 7f5749356640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5744158230 0x7f574415cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:01.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.526+0000 7f5749356640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f57440c7590 con 0x7f57440c83e0 2024-04-01T01:56:01.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.526+0000 7f5749356640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f57440c7410 con 0x7f5744158230 2024-04-01T01:56:01.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.526+0000 7f5749356640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f5744124d20 con 0x7f5744071190 2024-04-01T01:56:01.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.526+0000 7f57427fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57440c83e0 0x7f574414a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:01.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.526+0000 7f57437fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5744158230 0x7f574415cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:01.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.526+0000 7f57427fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57440c83e0 0x7f574414a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50784/0 (socket says 172.21.15.50:50784) 2024-04-01T01:56:01.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.526+0000 7f57427fc640 1 -- 172.21.15.50:0/1917730660 learned_addr learned my addr 172.21.15.50:0/1917730660 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T01:56:01.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.526+0000 7f5742ffd640 1 --2- 172.21.15.50:0/1917730660 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5744071190 0x7f57441466d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:01.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.526+0000 7f57427fc640 1 -- 172.21.15.50:0/1917730660 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5744071190 msgr2=0x7f57441466d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:01.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.526+0000 7f57427fc640 1 --2- 172.21.15.50:0/1917730660 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5744071190 0x7f57441466d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:01.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.526+0000 7f57427fc640 1 -- 172.21.15.50:0/1917730660 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5744158230 msgr2=0x7f574415cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:01.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.526+0000 7f57427fc640 1 --2- 172.21.15.50:0/1917730660 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5744158230 0x7f574415cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:01.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.526+0000 7f57427fc640 1 -- 172.21.15.50:0/1917730660 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57441485c0 con 0x7f57440c83e0 2024-04-01T01:56:01.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.526+0000 7f57437fe640 1 --2- 172.21.15.50:0/1917730660 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5744158230 0x7f574415cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T01:56:01.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.526+0000 7f57427fc640 1 --2- 172.21.15.50:0/1917730660 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57440c83e0 0x7f574414a5e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f573800b4a0 tx=0x7f573800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:56:01.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.526+0000 7f572b7fe640 1 -- 172.21.15.50:0/1917730660 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5738014070 con 0x7f57440c83e0 2024-04-01T01:56:01.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.526+0000 7f5749356640 1 -- 172.21.15.50:0/1917730660 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57441623d0 con 0x7f57440c83e0 2024-04-01T01:56:01.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.526+0000 7f5749356640 1 -- 172.21.15.50:0/1917730660 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57441620f0 con 0x7f57440c83e0 2024-04-01T01:56:01.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.526+0000 7f572b7fe640 1 -- 172.21.15.50:0/1917730660 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5738010610 con 0x7f57440c83e0 2024-04-01T01:56:01.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.526+0000 7f572b7fe640 1 -- 172.21.15.50:0/1917730660 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5738010a00 con 0x7f57440c83e0 2024-04-01T01:56:01.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.530+0000 7f572b7fe640 1 -- 172.21.15.50:0/1917730660 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 87103+0+0 (secure 0 0 0) 0x7f5738017070 con 0x7f57440c83e0 2024-04-01T01:56:01.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.530+0000 7f572b7fe640 1 --2- 172.21.15.50:0/1917730660 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f572c067640 0x7f572c069b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:01.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.530+0000 7f572b7fe640 1 -- 172.21.15.50:0/1917730660 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f5738089060 con 0x7f57440c83e0 2024-04-01T01:56:01.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.530+0000 7f5742ffd640 1 --2- 172.21.15.50:0/1917730660 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f572c067640 0x7f572c069b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:01.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.530+0000 7f5749356640 1 -- 172.21.15.50:0/1917730660 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57240052a0 con 0x7f57440c83e0 2024-04-01T01:56:01.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.530+0000 7f5742ffd640 1 --2- 172.21.15.50:0/1917730660 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f572c067640 0x7f572c069b00 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f573c0af000 tx=0x7f573c0a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:56:01.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.542+0000 7f572b7fe640 1 -- 172.21.15.50:0/1917730660 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+176632 (secure 0 0 0) 0x7f5738054c50 con 0x7f57440c83e0 2024-04-01T01:56:01.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.714+0000 7f0754e55640 1 -- 172.21.15.50:0/549347987 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f0734005590 con 0x7f07500c83e0 2024-04-01T01:56:01.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.714+0000 7f7b39532640 1 -- 172.21.15.50:0/1959115843 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f7b34151660 con 0x7f7b34153fc0 2024-04-01T01:56:01.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.714+0000 7f073effd640 1 -- 172.21.15.50:0/549347987 <== mon.2 v2:172.21.15.97:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0740058880 con 0x7f07500c83e0 2024-04-01T01:56:01.719 INFO:teuthology.orchestra.run.smithi050.stdout:64424509446 2024-04-01T01:56:01.719 INFO:teuthology.orchestra.run.smithi050.stdout:55834574855 2024-04-01T01:56:01.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.714+0000 7f7b30ff9640 1 -- 172.21.15.50:0/1959115843 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7b24059d50 con 0x7f7b34153fc0 2024-04-01T01:56:01.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.718+0000 7f073cff9640 1 -- 172.21.15.50:0/549347987 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f07300674f0 msgr2=0x7f07300699b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:01.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.718+0000 7f073cff9640 1 --2- 172.21.15.50:0/549347987 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f07300674f0 0x7f07300699b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f07440ad000 tx=0x7f0744004740 comp rx=0 tx=0).stop 2024-04-01T01:56:01.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.718+0000 7f073cff9640 1 -- 172.21.15.50:0/549347987 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f07500c83e0 msgr2=0x7f075013f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:01.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.718+0000 7f073cff9640 1 --2- 172.21.15.50:0/549347987 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f07500c83e0 0x7f075013f660 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0740009db0 tx=0x7f074000c430 comp rx=0 tx=0).stop 2024-04-01T01:56:01.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.718+0000 7f7b1a7fc640 1 -- 172.21.15.50:0/1959115843 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f7b20067470 msgr2=0x7f7b20069930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:01.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.718+0000 7f7b1a7fc640 1 --2- 172.21.15.50:0/1959115843 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f7b20067470 0x7f7b20069930 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7b28000f70 tx=0x7f7b2800b040 comp rx=0 tx=0).stop 2024-04-01T01:56:01.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.718+0000 7f7b1a7fc640 1 -- 172.21.15.50:0/1959115843 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b34153fc0 msgr2=0x7f7b340c9090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:01.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.718+0000 7f7b1a7fc640 1 --2- 172.21.15.50:0/1959115843 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b34153fc0 0x7f7b340c9090 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7b2400e850 tx=0x7f7b2400ed10 comp rx=0 tx=0).stop 2024-04-01T01:56:01.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.718+0000 7f073cff9640 1 -- 172.21.15.50:0/549347987 shutdown_connections 2024-04-01T01:56:01.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.718+0000 7f073cff9640 1 --2- 172.21.15.50:0/549347987 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f07300674f0 0x7f07300699b0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:01.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.718+0000 7f073cff9640 1 --2- 172.21.15.50:0/549347987 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f07501472a0 0x7f0750140ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:01.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.718+0000 7f073cff9640 1 --2- 172.21.15.50:0/549347987 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f07500c83e0 0x7f075013f660 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:01.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.718+0000 7f7b1a7fc640 1 -- 172.21.15.50:0/1959115843 shutdown_connections 2024-04-01T01:56:01.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.718+0000 7f7b1a7fc640 1 --2- 172.21.15.50:0/1959115843 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f7b20067470 0x7f7b20069930 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:01.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.718+0000 7f7b1a7fc640 1 --2- 172.21.15.50:0/1959115843 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b34153fc0 0x7f7b340c9090 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:01.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.718+0000 7f7b1a7fc640 1 --2- 172.21.15.50:0/1959115843 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7b340c7c10 0x7f7b341440c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:01.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.718+0000 7f073cff9640 1 --2- 172.21.15.50:0/549347987 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0750071190 0x7f07500cac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:01.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.718+0000 7f073cff9640 1 -- 172.21.15.50:0/549347987 >> 172.21.15.50:0/549347987 conn(0x7f075006b220 msgr2=0x7f07500c5150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:56:01.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.718+0000 7f7b1a7fc640 1 --2- 172.21.15.50:0/1959115843 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7b340c5fb0 0x7f7b34143b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:01.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.718+0000 7f7b1a7fc640 1 -- 172.21.15.50:0/1959115843 >> 172.21.15.50:0/1959115843 conn(0x7f7b3406b220 msgr2=0x7f7b340c8080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:56:01.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.718+0000 7f073cff9640 1 -- 172.21.15.50:0/549347987 shutdown_connections 2024-04-01T01:56:01.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.718+0000 7f7b1a7fc640 1 -- 172.21.15.50:0/1959115843 shutdown_connections 2024-04-01T01:56:01.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.718+0000 7f073cff9640 1 -- 172.21.15.50:0/549347987 wait complete. 2024-04-01T01:56:01.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.718+0000 7f7b1a7fc640 1 -- 172.21.15.50:0/1959115843 wait complete. 2024-04-01T01:56:01.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.730+0000 7f6998c95640 1 -- 172.21.15.50:0/4087269701 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f6974005590 con 0x7f698c04e770 2024-04-01T01:56:01.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.730+0000 7f697ffff640 1 -- 172.21.15.50:0/4087269701 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6994091bc0 con 0x7f698c04e770 2024-04-01T01:56:01.731 INFO:teuthology.orchestra.run.smithi050.stdout:64424509448 2024-04-01T01:56:01.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.734+0000 7f697dffb640 1 -- 172.21.15.50:0/4087269701 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f6978067520 msgr2=0x7f69780699e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:01.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.734+0000 7f697dffb640 1 --2- 172.21.15.50:0/4087269701 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f6978067520 0x7f69780699e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6980000c10 tx=0x7f6980009040 comp rx=0 tx=0).stop 2024-04-01T01:56:01.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.734+0000 7f697dffb640 1 -- 172.21.15.50:0/4087269701 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f698c04e770 msgr2=0x7f698c0d2330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:01.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.734+0000 7f697dffb640 1 --2- 172.21.15.50:0/4087269701 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f698c04e770 0x7f698c0d2330 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6994068020 tx=0x7f6984005840 comp rx=0 tx=0).stop 2024-04-01T01:56:01.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.734+0000 7f697dffb640 1 -- 172.21.15.50:0/4087269701 shutdown_connections 2024-04-01T01:56:01.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.734+0000 7f697dffb640 1 --2- 172.21.15.50:0/4087269701 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f6978067520 0x7f69780699e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:01.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.734+0000 7f697dffb640 1 --2- 172.21.15.50:0/4087269701 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f698c04e770 0x7f698c0d2330 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:01.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.734+0000 7f697dffb640 1 --2- 172.21.15.50:0/4087269701 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f698c009e50 0x7f698c04dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:01.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.734+0000 7f697dffb640 1 --2- 172.21.15.50:0/4087269701 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f698c050360 0x7f698c171240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:01.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.734+0000 7f697dffb640 1 -- 172.21.15.50:0/4087269701 >> 172.21.15.50:0/4087269701 conn(0x7f698c00c380 msgr2=0x7f698c0515f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:56:01.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.734+0000 7f697dffb640 1 -- 172.21.15.50:0/4087269701 shutdown_connections 2024-04-01T01:56:01.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.734+0000 7f697dffb640 1 -- 172.21.15.50:0/4087269701 wait complete. 2024-04-01T01:56:01.747 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.0 2024-04-01T01:56:01.748 DEBUG:teuthology.parallel:result is None 2024-04-01T01:56:01.749 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.5 2024-04-01T01:56:01.749 DEBUG:teuthology.parallel:result is None 2024-04-01T01:56:01.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.750+0000 7f148d5bd640 1 -- 172.21.15.50:0/784174987 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f1468005860 con 0x7f14880c6270 2024-04-01T01:56:01.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.754+0000 7f146f7fe640 1 -- 172.21.15.50:0/784174987 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f147c00f2e0 con 0x7f14880c6270 2024-04-01T01:56:01.754 INFO:teuthology.orchestra.run.smithi050.stdout:64424509447 2024-04-01T01:56:01.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.754+0000 7f148d5bd640 1 -- 172.21.15.50:0/784174987 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f1474067470 msgr2=0x7f1474069930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:01.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.754+0000 7f148d5bd640 1 --2- 172.21.15.50:0/784174987 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f1474067470 0x7f1474069930 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f14780ad000 tx=0x7f1478004740 comp rx=0 tx=0).stop 2024-04-01T01:56:01.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.754+0000 7f148d5bd640 1 -- 172.21.15.50:0/784174987 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14880c6270 msgr2=0x7f14881f9150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:01.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.754+0000 7f148d5bd640 1 --2- 172.21.15.50:0/784174987 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14880c6270 0x7f14881f9150 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f147c00b3e0 tx=0x7f147c00b8a0 comp rx=0 tx=0).stop 2024-04-01T01:56:01.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.754+0000 7f148d5bd640 1 -- 172.21.15.50:0/784174987 shutdown_connections 2024-04-01T01:56:01.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.754+0000 7f148d5bd640 1 --2- 172.21.15.50:0/784174987 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f1474067470 0x7f1474069930 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:01.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.754+0000 7f148d5bd640 1 --2- 172.21.15.50:0/784174987 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1488153f70 0x7f1488150c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:01.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.754+0000 7f148d5bd640 1 --2- 172.21.15.50:0/784174987 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14880c6270 0x7f14881f9150 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:01.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.754+0000 7f148d5bd640 1 --2- 172.21.15.50:0/784174987 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1488071790 0x7f14881f8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:01.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.754+0000 7f148d5bd640 1 -- 172.21.15.50:0/784174987 >> 172.21.15.50:0/784174987 conn(0x7f1488067560 msgr2=0x7f14880ca440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:56:01.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.754+0000 7f148d5bd640 1 -- 172.21.15.50:0/784174987 shutdown_connections 2024-04-01T01:56:01.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.754+0000 7f148d5bd640 1 -- 172.21.15.50:0/784174987 wait complete. 2024-04-01T01:56:01.761 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.4 2024-04-01T01:56:01.761 DEBUG:teuthology.parallel:result is None 2024-04-01T01:56:01.773 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.1 2024-04-01T01:56:01.773 DEBUG:teuthology.parallel:result is None 2024-04-01T01:56:01.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.782+0000 7fded7fff640 1 -- 172.21.15.50:0/3949520914 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fdeb8005860 con 0x7fded814b490 2024-04-01T01:56:01.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.782+0000 7fdebf7fe640 1 -- 172.21.15.50:0/3949520914 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fdecc05a170 con 0x7fded814b490 2024-04-01T01:56:01.783 INFO:teuthology.orchestra.run.smithi050.stdout:64424509447 2024-04-01T01:56:01.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.782+0000 7fded7fff640 1 -- 172.21.15.50:0/3949520914 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fdec40673f0 msgr2=0x7fdec40698b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:01.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.782+0000 7fded7fff640 1 --2- 172.21.15.50:0/3949520914 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fdec40673f0 0x7fdec40698b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fdec8000c10 tx=0x7fdec8001740 comp rx=0 tx=0).stop 2024-04-01T01:56:01.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.782+0000 7fded7fff640 1 -- 172.21.15.50:0/3949520914 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fded814b490 msgr2=0x7fded8159140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:01.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.782+0000 7fded7fff640 1 --2- 172.21.15.50:0/3949520914 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fded814b490 0x7fded8159140 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fded80c71c0 tx=0x7fdecc011d00 comp rx=0 tx=0).stop 2024-04-01T01:56:01.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.782+0000 7fded7fff640 1 -- 172.21.15.50:0/3949520914 shutdown_connections 2024-04-01T01:56:01.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.782+0000 7fded7fff640 1 --2- 172.21.15.50:0/3949520914 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fdec40673f0 0x7fdec40698b0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:01.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.782+0000 7fded7fff640 1 --2- 172.21.15.50:0/3949520914 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fded81547b0 0x7fded81eec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:01.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.782+0000 7fded7fff640 1 --2- 172.21.15.50:0/3949520914 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fded814b490 0x7fded8159140 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:01.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.782+0000 7fded7fff640 1 --2- 172.21.15.50:0/3949520914 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdec0004d50 0x7fded8158c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:01.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.782+0000 7fded7fff640 1 -- 172.21.15.50:0/3949520914 >> 172.21.15.50:0/3949520914 conn(0x7fded80c8f10 msgr2=0x7fded814fc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:56:01.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.782+0000 7fded7fff640 1 -- 172.21.15.50:0/3949520914 shutdown_connections 2024-04-01T01:56:01.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.782+0000 7fded7fff640 1 -- 172.21.15.50:0/3949520914 wait complete. 2024-04-01T01:56:01.800 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.7 2024-04-01T01:56:01.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.798+0000 7faad39c7640 1 -- 172.21.15.50:0/866094041 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7faaac005860 con 0x7faacc0c6270 2024-04-01T01:56:01.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.798+0000 7faac1ffb640 1 -- 172.21.15.50:0/866094041 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7faabc0554f0 con 0x7faacc0c6270 2024-04-01T01:56:01.801 DEBUG:teuthology.parallel:result is None 2024-04-01T01:56:01.801 INFO:teuthology.orchestra.run.smithi050.stdout:64424509446 2024-04-01T01:56:01.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.798+0000 7faad39c7640 1 -- 172.21.15.50:0/866094041 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7faab8067560 msgr2=0x7faab8069a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:01.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.798+0000 7faad39c7640 1 --2- 172.21.15.50:0/866094041 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7faab8067560 0x7faab8069a20 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7faacc08ba50 tx=0x7faac8008040 comp rx=0 tx=0).stop 2024-04-01T01:56:01.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.798+0000 7faad39c7640 1 -- 172.21.15.50:0/866094041 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faacc0c6270 msgr2=0x7faacc0c9970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:01.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.798+0000 7faad39c7640 1 --2- 172.21.15.50:0/866094041 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faacc0c6270 0x7faacc0c9970 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7faabc00ba30 tx=0x7faabc00bef0 comp rx=0 tx=0).stop 2024-04-01T01:56:01.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.798+0000 7faad39c7640 1 -- 172.21.15.50:0/866094041 shutdown_connections 2024-04-01T01:56:01.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.798+0000 7faad39c7640 1 --2- 172.21.15.50:0/866094041 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7faab8067560 0x7faab8069a20 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:01.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.798+0000 7faad39c7640 1 --2- 172.21.15.50:0/866094041 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faacc1674b0 0x7faacc169920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:01.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.798+0000 7faad39c7640 1 --2- 172.21.15.50:0/866094041 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faacc164040 0x7faacc1693e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:01.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.798+0000 7faad39c7640 1 --2- 172.21.15.50:0/866094041 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faacc0c6270 0x7faacc0c9970 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:01.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.798+0000 7faad39c7640 1 -- 172.21.15.50:0/866094041 >> 172.21.15.50:0/866094041 conn(0x7faacc067560 msgr2=0x7faacc071250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:56:01.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.798+0000 7faad39c7640 1 -- 172.21.15.50:0/866094041 shutdown_connections 2024-04-01T01:56:01.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.802+0000 7faad39c7640 1 -- 172.21.15.50:0/866094041 wait complete. 2024-04-01T01:56:01.817 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.3 2024-04-01T01:56:01.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.814+0000 7f4a13fff640 1 -- 172.21.15.50:0/1067706483 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f4a0c050db0 con 0x7f4a0c04f9c0 2024-04-01T01:56:01.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.814+0000 7f49fb7fe640 1 -- 172.21.15.50:0/1067706483 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4a04058e50 con 0x7f4a0c04f9c0 2024-04-01T01:56:01.818 DEBUG:teuthology.parallel:result is None 2024-04-01T01:56:01.818 INFO:teuthology.orchestra.run.smithi050.stdout:64424509447 2024-04-01T01:56:01.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.818+0000 7f4a13fff640 1 -- 172.21.15.50:0/1067706483 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f4a00067450 msgr2=0x7f4a00069910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:01.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.818+0000 7f4a13fff640 1 --2- 172.21.15.50:0/1067706483 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f4a00067450 0x7f4a00069910 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4a0c0379d0 tx=0x7f4a08009060 comp rx=0 tx=0).stop 2024-04-01T01:56:01.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.818+0000 7f4a13fff640 1 -- 172.21.15.50:0/1067706483 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a0c04f9c0 msgr2=0x7f4a0c008e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:01.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.818+0000 7f4a13fff640 1 --2- 172.21.15.50:0/1067706483 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a0c04f9c0 0x7f4a0c008e10 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4a0400c3f0 tx=0x7f4a0400c8b0 comp rx=0 tx=0).stop 2024-04-01T01:56:01.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.818+0000 7f4a13fff640 1 -- 172.21.15.50:0/1067706483 shutdown_connections 2024-04-01T01:56:01.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.818+0000 7f4a13fff640 1 --2- 172.21.15.50:0/1067706483 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f4a00067450 0x7f4a00069910 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:01.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.818+0000 7f4a13fff640 1 --2- 172.21.15.50:0/1067706483 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4a0c00a8c0 0x7f4a0c0cecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:01.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.818+0000 7f4a13fff640 1 --2- 172.21.15.50:0/1067706483 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4a0c0d90b0 0x7f4a0c0de360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:01.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.818+0000 7f4a13fff640 1 --2- 172.21.15.50:0/1067706483 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a0c04f9c0 0x7f4a0c008e10 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:01.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.818+0000 7f4a13fff640 1 -- 172.21.15.50:0/1067706483 >> 172.21.15.50:0/1067706483 conn(0x7f4a0c00c380 msgr2=0x7f4a0c00c760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:56:01.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.818+0000 7f4a13fff640 1 -- 172.21.15.50:0/1067706483 shutdown_connections 2024-04-01T01:56:01.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.818+0000 7f4a13fff640 1 -- 172.21.15.50:0/1067706483 wait complete. 2024-04-01T01:56:01.840 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.2 2024-04-01T01:56:01.840 DEBUG:teuthology.parallel:result is None 2024-04-01T01:56:01.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.854+0000 7f5749356640 1 -- 172.21.15.50:0/1917730660 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f5724005860 con 0x7f57440c83e0 2024-04-01T01:56:01.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.854+0000 7f572b7fe640 1 -- 172.21.15.50:0/1917730660 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5738058cf0 con 0x7f57440c83e0 2024-04-01T01:56:01.856 INFO:teuthology.orchestra.run.smithi050.stdout:60129542150 2024-04-01T01:56:01.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.854+0000 7f5749356640 1 -- 172.21.15.50:0/1917730660 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f572c067640 msgr2=0x7f572c069b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:01.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.854+0000 7f5749356640 1 --2- 172.21.15.50:0/1917730660 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f572c067640 0x7f572c069b00 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f573c0af000 tx=0x7f573c0a7070 comp rx=0 tx=0).stop 2024-04-01T01:56:01.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.854+0000 7f5749356640 1 -- 172.21.15.50:0/1917730660 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57440c83e0 msgr2=0x7f574414a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:01.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.854+0000 7f5749356640 1 --2- 172.21.15.50:0/1917730660 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57440c83e0 0x7f574414a5e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f573800b4a0 tx=0x7f573800b960 comp rx=0 tx=0).stop 2024-04-01T01:56:01.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.854+0000 7f5749356640 1 -- 172.21.15.50:0/1917730660 shutdown_connections 2024-04-01T01:56:01.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.854+0000 7f5749356640 1 --2- 172.21.15.50:0/1917730660 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f572c067640 0x7f572c069b00 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:01.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.854+0000 7f5749356640 1 --2- 172.21.15.50:0/1917730660 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5744158230 0x7f574415cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:01.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.854+0000 7f5749356640 1 --2- 172.21.15.50:0/1917730660 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57440c83e0 0x7f574414a5e0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:01.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.854+0000 7f5749356640 1 --2- 172.21.15.50:0/1917730660 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5744071190 0x7f57441466d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:01.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.854+0000 7f5749356640 1 -- 172.21.15.50:0/1917730660 >> 172.21.15.50:0/1917730660 conn(0x7f574406b220 msgr2=0x7f57440c33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:56:01.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.854+0000 7f5749356640 1 -- 172.21.15.50:0/1917730660 shutdown_connections 2024-04-01T01:56:01.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:01.854+0000 7f5749356640 1 -- 172.21.15.50:0/1917730660 wait complete. 2024-04-01T01:56:01.873 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.6 2024-04-01T01:56:01.873 DEBUG:teuthology.parallel:result is None 2024-04-01T01:56:01.873 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-01T01:56:01.873 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-01T01:56:02.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.030+0000 7fea8934e640 1 Processor -- start 2024-04-01T01:56:02.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.030+0000 7fea8934e640 1 -- start start 2024-04-01T01:56:02.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.030+0000 7fea8934e640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fea84151de0 0x7fea84157be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:02.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.030+0000 7fea8934e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fea840c2900 0x7fea840c5f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:02.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.030+0000 7fea8934e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea840c30d0 con 0x7fea84158120 2024-04-01T01:56:02.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.030+0000 7fea8934e640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fea8415b370 con 0x7fea840c2900 2024-04-01T01:56:02.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.030+0000 7fea8934e640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fea8415c0f0 con 0x7fea84151de0 2024-04-01T01:56:02.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.030+0000 7fea837fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fea84158120 0x7fea8406ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44702/0 (socket says 172.21.15.50:44702) 2024-04-01T01:56:02.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.030+0000 7fea837fe640 1 -- 172.21.15.50:0/3063490843 learned_addr learned my addr 172.21.15.50:0/3063490843 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-04-01T01:56:02.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.030+0000 7fea827fc640 1 --2- 172.21.15.50:0/3063490843 >> v2:172.21.15.50:3300/0 conn(0x7fea840c2900 0x7fea840c5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:02.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.030+0000 7fea82ffd640 1 --2- 172.21.15.50:0/3063490843 >> v2:172.21.15.97:3300/0 conn(0x7fea84151de0 0x7fea84157be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:02.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.030+0000 7fea81ffb640 1 -- 172.21.15.50:0/3063490843 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1112078636 0 0) 0x7fea840c30d0 con 0x7fea84158120 2024-04-01T01:56:02.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.030+0000 7fea81ffb640 1 -- 172.21.15.50:0/3063490843 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fea6c003530 con 0x7fea84158120 2024-04-01T01:56:02.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.030+0000 7fea827fc640 1 -- 172.21.15.50:0/3063490843 >> v2:172.21.15.97:3300/0 conn(0x7fea84151de0 msgr2=0x7fea84157be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:56:02.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.030+0000 7fea827fc640 1 --2- 172.21.15.50:0/3063490843 >> v2:172.21.15.97:3300/0 conn(0x7fea84151de0 0x7fea84157be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:02.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.030+0000 7fea827fc640 1 -- 172.21.15.50:0/3063490843 >> v1:172.21.15.50:6789/0 conn(0x7fea84158120 legacy=0x7fea8406ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:02.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.030+0000 7fea827fc640 1 -- 172.21.15.50:0/3063490843 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea840c2df0 con 0x7fea840c2900 2024-04-01T01:56:02.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.034+0000 7fea827fc640 1 --2- 172.21.15.50:0/3063490843 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea840c2900 0x7fea840c5f20 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fea8406bf50 tx=0x7fea7801ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84fb9bc0b170db18 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:56:02.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.034+0000 7fea81ffb640 1 -- 172.21.15.50:0/3063490843 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea780b5070 con 0x7fea840c2900 2024-04-01T01:56:02.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.034+0000 7fea81ffb640 1 -- 172.21.15.50:0/3063490843 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea780a8970 con 0x7fea840c2900 2024-04-01T01:56:02.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.034+0000 7fea81ffb640 1 -- 172.21.15.50:0/3063490843 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea780a8d40 con 0x7fea840c2900 2024-04-01T01:56:02.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.034+0000 7fea8934e640 1 -- 172.21.15.50:0/3063490843 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea840c2900 msgr2=0x7fea840c5f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:02.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.034+0000 7fea8934e640 1 --2- 172.21.15.50:0/3063490843 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea840c2900 0x7fea840c5f20 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fea8406bf50 tx=0x7fea7801ec70 comp rx=0 tx=0).stop 2024-04-01T01:56:02.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.034+0000 7fea8934e640 1 -- 172.21.15.50:0/3063490843 shutdown_connections 2024-04-01T01:56:02.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.034+0000 7fea8934e640 1 --2- 172.21.15.50:0/3063490843 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea840c2900 0x7fea840c5f20 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:02.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.034+0000 7fea8934e640 1 --2- 172.21.15.50:0/3063490843 >> v2:172.21.15.97:3300/0 conn(0x7fea84151de0 0x7fea84157be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:02.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.034+0000 7fea8934e640 1 -- 172.21.15.50:0/3063490843 >> 172.21.15.50:0/3063490843 conn(0x7fea84067560 msgr2=0x7fea8406b220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:56:02.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.034+0000 7fea8934e640 1 -- 172.21.15.50:0/3063490843 shutdown_connections 2024-04-01T01:56:02.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.034+0000 7fea8934e640 1 -- 172.21.15.50:0/3063490843 wait complete. 2024-04-01T01:56:02.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.034+0000 7fea8934e640 1 Processor -- start 2024-04-01T01:56:02.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.034+0000 7fea8934e640 1 -- start start 2024-04-01T01:56:02.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.034+0000 7fea8934e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea840c2900 0x7fea840c9300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:02.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.034+0000 7fea8934e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fea84151de0 0x7fea840718e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:02.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.034+0000 7fea8934e640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fea84158120 0x7fea8414d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:02.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.034+0000 7fea8934e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fea8415bbd0 con 0x7fea840c2900 2024-04-01T01:56:02.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.034+0000 7fea8934e640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fea8415b8f0 con 0x7fea84151de0 2024-04-01T01:56:02.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.034+0000 7fea8934e640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fea840c88a0 con 0x7fea84158120 2024-04-01T01:56:02.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.034+0000 7fea82ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea840c2900 0x7fea840c9300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:02.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.034+0000 7fea82ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea840c2900 0x7fea840c9300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50812/0 (socket says 172.21.15.50:50812) 2024-04-01T01:56:02.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.034+0000 7fea82ffd640 1 -- 172.21.15.50:0/2528257626 learned_addr learned my addr 172.21.15.50:0/2528257626 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T01:56:02.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.034+0000 7fea827fc640 1 --2- 172.21.15.50:0/2528257626 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fea84151de0 0x7fea840718e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:02.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.034+0000 7fea837fe640 1 --2- 172.21.15.50:0/2528257626 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fea84158120 0x7fea8414d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:02.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.034+0000 7fea82ffd640 1 -- 172.21.15.50:0/2528257626 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fea84158120 msgr2=0x7fea8414d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:02.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.034+0000 7fea82ffd640 1 --2- 172.21.15.50:0/2528257626 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fea84158120 0x7fea8414d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:02.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.034+0000 7fea82ffd640 1 -- 172.21.15.50:0/2528257626 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fea84151de0 msgr2=0x7fea840718e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:02.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.034+0000 7fea82ffd640 1 --2- 172.21.15.50:0/2528257626 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fea84151de0 0x7fea840718e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:02.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.034+0000 7fea82ffd640 1 -- 172.21.15.50:0/2528257626 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea8415a8f0 con 0x7fea840c2900 2024-04-01T01:56:02.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.034+0000 7fea82ffd640 1 --2- 172.21.15.50:0/2528257626 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea840c2900 0x7fea840c9300 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fea7400e960 tx=0x7fea7400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:56:02.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.034+0000 7fea6b7fe640 1 -- 172.21.15.50:0/2528257626 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea74017070 con 0x7fea840c2900 2024-04-01T01:56:02.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.034+0000 7fea6b7fe640 1 -- 172.21.15.50:0/2528257626 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea7400ca00 con 0x7fea840c2900 2024-04-01T01:56:02.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.034+0000 7fea8934e640 1 -- 172.21.15.50:0/2528257626 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea8415abb0 con 0x7fea840c2900 2024-04-01T01:56:02.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.034+0000 7fea6b7fe640 1 -- 172.21.15.50:0/2528257626 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea7400cdb0 con 0x7fea840c2900 2024-04-01T01:56:02.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.034+0000 7fea8934e640 1 -- 172.21.15.50:0/2528257626 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea841f2eb0 con 0x7fea840c2900 2024-04-01T01:56:02.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.038+0000 7fea8934e640 1 -- 172.21.15.50:0/2528257626 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea841f38b0 con 0x7fea840c2900 2024-04-01T01:56:02.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.038+0000 7fea6b7fe640 1 -- 172.21.15.50:0/2528257626 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 87103+0+0 (secure 0 0 0) 0x7fea7401a070 con 0x7fea840c2900 2024-04-01T01:56:02.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.038+0000 7fea6b7fe640 1 --2- 172.21.15.50:0/2528257626 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fea70067420 0x7fea700698e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:02.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.038+0000 7fea6b7fe640 1 -- 172.21.15.50:0/2528257626 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fea740857d0 con 0x7fea840c2900 2024-04-01T01:56:02.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.038+0000 7fea827fc640 1 --2- 172.21.15.50:0/2528257626 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fea70067420 0x7fea700698e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:02.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.038+0000 7fea827fc640 1 --2- 172.21.15.50:0/2528257626 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fea70067420 0x7fea700698e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fea780b2000 tx=0x7fea78008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:56:02.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.042+0000 7fea6b7fe640 1 -- 172.21.15.50:0/2528257626 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+176632 (secure 0 0 0) 0x7fea74056440 con 0x7fea840c2900 2024-04-01T01:56:02.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.190+0000 7fea8934e640 1 -- 172.21.15.50:0/2528257626 --> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fea84068230 con 0x7fea70067420 2024-04-01T01:56:02.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.210+0000 7fea6b7fe640 1 -- 172.21.15.50:0/2528257626 <== mgr.4103 v2:172.21.15.97:6832/1677467570 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251910 (secure 0 0 0) 0x7fea84068230 con 0x7fea70067420 2024-04-01T01:56:02.214 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-01T01:56:02.215 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-04-01T01:56:02.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.214+0000 7fea8934e640 1 -- 172.21.15.50:0/2528257626 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fea70067420 msgr2=0x7fea700698e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:02.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.214+0000 7fea8934e640 1 --2- 172.21.15.50:0/2528257626 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fea70067420 0x7fea700698e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fea780b2000 tx=0x7fea78008040 comp rx=0 tx=0).stop 2024-04-01T01:56:02.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.214+0000 7fea8934e640 1 -- 172.21.15.50:0/2528257626 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea840c2900 msgr2=0x7fea840c9300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:02.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.214+0000 7fea8934e640 1 --2- 172.21.15.50:0/2528257626 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea840c2900 0x7fea840c9300 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fea7400e960 tx=0x7fea7400ee20 comp rx=0 tx=0).stop 2024-04-01T01:56:02.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.214+0000 7fea8934e640 1 -- 172.21.15.50:0/2528257626 shutdown_connections 2024-04-01T01:56:02.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.214+0000 7fea8934e640 1 --2- 172.21.15.50:0/2528257626 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fea70067420 0x7fea700698e0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:02.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.214+0000 7fea8934e640 1 --2- 172.21.15.50:0/2528257626 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fea84158120 0x7fea8414d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:02.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.214+0000 7fea8934e640 1 --2- 172.21.15.50:0/2528257626 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fea84151de0 0x7fea840718e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:02.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.214+0000 7fea8934e640 1 --2- 172.21.15.50:0/2528257626 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea840c2900 0x7fea840c9300 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:02.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.214+0000 7fea8934e640 1 -- 172.21.15.50:0/2528257626 >> 172.21.15.50:0/2528257626 conn(0x7fea84067560 msgr2=0x7fea84150bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:56:02.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.214+0000 7fea8934e640 1 -- 172.21.15.50:0/2528257626 shutdown_connections 2024-04-01T01:56:02.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.214+0000 7fea8934e640 1 -- 172.21.15.50:0/2528257626 wait complete. 2024-04-01T01:56:02.230 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-04-01T01:56:02.066999+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":234636,"kb_used_data":1824,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754740084,"statfs":{"total":773094113280,"available":772853846016,"internally_reserved":0,"allocated":1867776,"data_stored":1762940,"data_compressed":66838,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.846855"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.485783+0000","last_change":"2024-04-01T01:55:49.279342+0000","last_active":"2024-04-01T01:55:50.485783+0000","last_peered":"2024-04-01T01:55:50.485783+0000","last_clean":"2024-04-01T01:55:50.485783+0000","last_became_active":"2024-04-01T01:55:49.279011+0000","last_became_peered":"2024-04-01T01:55:49.279011+0000","last_unstale":"2024-04-01T01:55:50.485783+0000","last_undegraded":"2024-04-01T01:55:50.485783+0000","last_fullsized":"2024-04-01T01:55:50.485783+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:56:11.350186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.227142+0000","last_change":"2024-04-01T01:55:49.247181+0000","last_active":"2024-04-01T01:55:50.227142+0000","last_peered":"2024-04-01T01:55:50.227142+0000","last_clean":"2024-04-01T01:55:50.227142+0000","last_became_active":"2024-04-01T01:55:49.246660+0000","last_became_peered":"2024-04-01T01:55:49.246660+0000","last_unstale":"2024-04-01T01:55:50.227142+0000","last_undegraded":"2024-04-01T01:55:50.227142+0000","last_fullsized":"2024-04-01T01:55:50.227142+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:27:12.089520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.226983+0000","last_change":"2024-04-01T01:55:49.240347+0000","last_active":"2024-04-01T01:55:50.226983+0000","last_peered":"2024-04-01T01:55:50.226983+0000","last_clean":"2024-04-01T01:55:50.226983+0000","last_became_active":"2024-04-01T01:55:49.239904+0000","last_became_peered":"2024-04-01T01:55:49.239904+0000","last_unstale":"2024-04-01T01:55:50.226983+0000","last_undegraded":"2024-04-01T01:55:50.226983+0000","last_fullsized":"2024-04-01T01:55:50.226983+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:37:43.280869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.667159+0000","last_change":"2024-04-01T01:55:49.279352+0000","last_active":"2024-04-01T01:55:50.667159+0000","last_peered":"2024-04-01T01:55:50.667159+0000","last_clean":"2024-04-01T01:55:50.667159+0000","last_became_active":"2024-04-01T01:55:49.279041+0000","last_became_peered":"2024-04-01T01:55:49.279041+0000","last_unstale":"2024-04-01T01:55:50.667159+0000","last_undegraded":"2024-04-01T01:55:50.667159+0000","last_fullsized":"2024-04-01T01:55:50.667159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:13:13.114168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.485298+0000","last_change":"2024-04-01T01:55:49.246874+0000","last_active":"2024-04-01T01:55:50.485298+0000","last_peered":"2024-04-01T01:55:50.485298+0000","last_clean":"2024-04-01T01:55:50.485298+0000","last_became_active":"2024-04-01T01:55:49.246152+0000","last_became_peered":"2024-04-01T01:55:49.246152+0000","last_unstale":"2024-04-01T01:55:50.485298+0000","last_undegraded":"2024-04-01T01:55:50.485298+0000","last_fullsized":"2024-04-01T01:55:50.485298+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:49:04.049108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.665855+0000","last_change":"2024-04-01T01:55:49.254029+0000","last_active":"2024-04-01T01:55:50.665855+0000","last_peered":"2024-04-01T01:55:50.665855+0000","last_clean":"2024-04-01T01:55:50.665855+0000","last_became_active":"2024-04-01T01:55:49.253348+0000","last_became_peered":"2024-04-01T01:55:49.253348+0000","last_unstale":"2024-04-01T01:55:50.665855+0000","last_undegraded":"2024-04-01T01:55:50.665855+0000","last_fullsized":"2024-04-01T01:55:50.665855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:33:56.754206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.484926+0000","last_change":"2024-04-01T01:55:49.247604+0000","last_active":"2024-04-01T01:55:50.484926+0000","last_peered":"2024-04-01T01:55:50.484926+0000","last_clean":"2024-04-01T01:55:50.484926+0000","last_became_active":"2024-04-01T01:55:49.247373+0000","last_became_peered":"2024-04-01T01:55:49.247373+0000","last_unstale":"2024-04-01T01:55:50.484926+0000","last_undegraded":"2024-04-01T01:55:50.484926+0000","last_fullsized":"2024-04-01T01:55:50.484926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:13:16.513095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.226492+0000","last_change":"2024-04-01T01:55:49.262994+0000","last_active":"2024-04-01T01:55:50.226492+0000","last_peered":"2024-04-01T01:55:50.226492+0000","last_clean":"2024-04-01T01:55:50.226492+0000","last_became_active":"2024-04-01T01:55:49.262736+0000","last_became_peered":"2024-04-01T01:55:49.262736+0000","last_unstale":"2024-04-01T01:55:50.226492+0000","last_undegraded":"2024-04-01T01:55:50.226492+0000","last_fullsized":"2024-04-01T01:55:50.226492+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:35:14.625545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.224583+0000","last_change":"2024-04-01T01:55:49.260244+0000","last_active":"2024-04-01T01:55:50.224583+0000","last_peered":"2024-04-01T01:55:50.224583+0000","last_clean":"2024-04-01T01:55:50.224583+0000","last_became_active":"2024-04-01T01:55:49.259745+0000","last_became_peered":"2024-04-01T01:55:49.259745+0000","last_unstale":"2024-04-01T01:55:50.224583+0000","last_undegraded":"2024-04-01T01:55:50.224583+0000","last_fullsized":"2024-04-01T01:55:50.224583+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:00:34.607980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.486080+0000","last_change":"2024-04-01T01:55:49.255260+0000","last_active":"2024-04-01T01:55:50.486080+0000","last_peered":"2024-04-01T01:55:50.486080+0000","last_clean":"2024-04-01T01:55:50.486080+0000","last_became_active":"2024-04-01T01:55:49.254408+0000","last_became_peered":"2024-04-01T01:55:49.254408+0000","last_unstale":"2024-04-01T01:55:50.486080+0000","last_undegraded":"2024-04-01T01:55:50.486080+0000","last_fullsized":"2024-04-01T01:55:50.486080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:02:41.829474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.485581+0000","last_change":"2024-04-01T01:55:49.271392+0000","last_active":"2024-04-01T01:55:50.485581+0000","last_peered":"2024-04-01T01:55:50.485581+0000","last_clean":"2024-04-01T01:55:50.485581+0000","last_became_active":"2024-04-01T01:55:49.270877+0000","last_became_peered":"2024-04-01T01:55:49.270877+0000","last_unstale":"2024-04-01T01:55:50.485581+0000","last_undegraded":"2024-04-01T01:55:50.485581+0000","last_fullsized":"2024-04-01T01:55:50.485581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:44:29.950624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.485029+0000","last_change":"2024-04-01T01:55:49.259816+0000","last_active":"2024-04-01T01:55:50.485029+0000","last_peered":"2024-04-01T01:55:50.485029+0000","last_clean":"2024-04-01T01:55:50.485029+0000","last_became_active":"2024-04-01T01:55:49.259193+0000","last_became_peered":"2024-04-01T01:55:49.259193+0000","last_unstale":"2024-04-01T01:55:50.485029+0000","last_undegraded":"2024-04-01T01:55:50.485029+0000","last_fullsized":"2024-04-01T01:55:50.485029+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:48:10.828398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.635725+0000","last_change":"2024-04-01T01:55:49.247878+0000","last_active":"2024-04-01T01:55:50.635725+0000","last_peered":"2024-04-01T01:55:50.635725+0000","last_clean":"2024-04-01T01:55:50.635725+0000","last_became_active":"2024-04-01T01:55:49.247436+0000","last_became_peered":"2024-04-01T01:55:49.247436+0000","last_unstale":"2024-04-01T01:55:50.635725+0000","last_undegraded":"2024-04-01T01:55:50.635725+0000","last_fullsized":"2024-04-01T01:55:50.635725+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:26:09.632757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.635921+0000","last_change":"2024-04-01T01:55:49.246266+0000","last_active":"2024-04-01T01:55:50.635921+0000","last_peered":"2024-04-01T01:55:50.635921+0000","last_clean":"2024-04-01T01:55:50.635921+0000","last_became_active":"2024-04-01T01:55:49.245650+0000","last_became_peered":"2024-04-01T01:55:49.245650+0000","last_unstale":"2024-04-01T01:55:50.635921+0000","last_undegraded":"2024-04-01T01:55:50.635921+0000","last_fullsized":"2024-04-01T01:55:50.635921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:14:32.577522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.225923+0000","last_change":"2024-04-01T01:55:49.248046+0000","last_active":"2024-04-01T01:55:50.225923+0000","last_peered":"2024-04-01T01:55:50.225923+0000","last_clean":"2024-04-01T01:55:50.225923+0000","last_became_active":"2024-04-01T01:55:49.247662+0000","last_became_peered":"2024-04-01T01:55:49.247662+0000","last_unstale":"2024-04-01T01:55:50.225923+0000","last_undegraded":"2024-04-01T01:55:50.225923+0000","last_fullsized":"2024-04-01T01:55:50.225923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:59:26.879090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.665743+0000","last_change":"2024-04-01T01:55:49.269484+0000","last_active":"2024-04-01T01:55:50.665743+0000","last_peered":"2024-04-01T01:55:50.665743+0000","last_clean":"2024-04-01T01:55:50.665743+0000","last_became_active":"2024-04-01T01:55:49.261839+0000","last_became_peered":"2024-04-01T01:55:49.261839+0000","last_unstale":"2024-04-01T01:55:50.665743+0000","last_undegraded":"2024-04-01T01:55:50.665743+0000","last_fullsized":"2024-04-01T01:55:50.665743+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:44:29.950624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.668406+0000","last_change":"2024-04-01T01:55:49.276113+0000","last_active":"2024-04-01T01:55:50.668406+0000","last_peered":"2024-04-01T01:55:50.668406+0000","last_clean":"2024-04-01T01:55:50.668406+0000","last_became_active":"2024-04-01T01:55:49.275727+0000","last_became_peered":"2024-04-01T01:55:49.275727+0000","last_unstale":"2024-04-01T01:55:50.668406+0000","last_undegraded":"2024-04-01T01:55:50.668406+0000","last_fullsized":"2024-04-01T01:55:50.668406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:50:59.209071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.665402+0000","last_change":"2024-04-01T01:55:49.252859+0000","last_active":"2024-04-01T01:55:50.665402+0000","last_peered":"2024-04-01T01:55:50.665402+0000","last_clean":"2024-04-01T01:55:50.665402+0000","last_became_active":"2024-04-01T01:55:49.252553+0000","last_became_peered":"2024-04-01T01:55:49.252553+0000","last_unstale":"2024-04-01T01:55:50.665402+0000","last_undegraded":"2024-04-01T01:55:50.665402+0000","last_fullsized":"2024-04-01T01:55:50.665402+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:13:13.114168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.667833+0000","last_change":"2024-04-01T01:55:49.260274+0000","last_active":"2024-04-01T01:55:50.667833+0000","last_peered":"2024-04-01T01:55:50.667833+0000","last_clean":"2024-04-01T01:55:50.667833+0000","last_became_active":"2024-04-01T01:55:49.259935+0000","last_became_peered":"2024-04-01T01:55:49.259935+0000","last_unstale":"2024-04-01T01:55:50.667833+0000","last_undegraded":"2024-04-01T01:55:50.667833+0000","last_fullsized":"2024-04-01T01:55:50.667833+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:24:55.348340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.485181+0000","last_change":"2024-04-01T01:55:49.259523+0000","last_active":"2024-04-01T01:55:50.485181+0000","last_peered":"2024-04-01T01:55:50.485181+0000","last_clean":"2024-04-01T01:55:50.485181+0000","last_became_active":"2024-04-01T01:55:49.258670+0000","last_became_peered":"2024-04-01T01:55:49.258670+0000","last_unstale":"2024-04-01T01:55:50.485181+0000","last_undegraded":"2024-04-01T01:55:50.485181+0000","last_fullsized":"2024-04-01T01:55:50.485181+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:08:54.832554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.226632+0000","last_change":"2024-04-01T01:55:49.243824+0000","last_active":"2024-04-01T01:55:50.226632+0000","last_peered":"2024-04-01T01:55:50.226632+0000","last_clean":"2024-04-01T01:55:50.226632+0000","last_became_active":"2024-04-01T01:55:49.243518+0000","last_became_peered":"2024-04-01T01:55:49.243518+0000","last_unstale":"2024-04-01T01:55:50.226632+0000","last_undegraded":"2024-04-01T01:55:50.226632+0000","last_fullsized":"2024-04-01T01:55:50.226632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:24:42.777720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.223859+0000","last_change":"2024-04-01T01:55:49.258207+0000","last_active":"2024-04-01T01:55:50.223859+0000","last_peered":"2024-04-01T01:55:50.223859+0000","last_clean":"2024-04-01T01:55:50.223859+0000","last_became_active":"2024-04-01T01:55:49.257576+0000","last_became_peered":"2024-04-01T01:55:49.257576+0000","last_unstale":"2024-04-01T01:55:50.223859+0000","last_undegraded":"2024-04-01T01:55:50.223859+0000","last_fullsized":"2024-04-01T01:55:50.223859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:13:13.114168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.226214+0000","last_change":"2024-04-01T01:55:49.250832+0000","last_active":"2024-04-01T01:55:50.226214+0000","last_peered":"2024-04-01T01:55:50.226214+0000","last_clean":"2024-04-01T01:55:50.226214+0000","last_became_active":"2024-04-01T01:55:49.250522+0000","last_became_peered":"2024-04-01T01:55:49.250522+0000","last_unstale":"2024-04-01T01:55:50.226214+0000","last_undegraded":"2024-04-01T01:55:50.226214+0000","last_fullsized":"2024-04-01T01:55:50.226214+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:47:04.592262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.665958+0000","last_change":"2024-04-01T01:55:49.270067+0000","last_active":"2024-04-01T01:55:50.665958+0000","last_peered":"2024-04-01T01:55:50.665958+0000","last_clean":"2024-04-01T01:55:50.665958+0000","last_became_active":"2024-04-01T01:55:49.269694+0000","last_became_peered":"2024-04-01T01:55:49.269694+0000","last_unstale":"2024-04-01T01:55:50.665958+0000","last_undegraded":"2024-04-01T01:55:50.665958+0000","last_fullsized":"2024-04-01T01:55:50.665958+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:21:46.367144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.227645+0000","last_change":"2024-04-01T01:55:49.243460+0000","last_active":"2024-04-01T01:55:50.227645+0000","last_peered":"2024-04-01T01:55:50.227645+0000","last_clean":"2024-04-01T01:55:50.227645+0000","last_became_active":"2024-04-01T01:55:49.243017+0000","last_became_peered":"2024-04-01T01:55:49.243017+0000","last_unstale":"2024-04-01T01:55:50.227645+0000","last_undegraded":"2024-04-01T01:55:50.227645+0000","last_fullsized":"2024-04-01T01:55:50.227645+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:20:18.156798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.667300+0000","last_change":"2024-04-01T01:55:49.280226+0000","last_active":"2024-04-01T01:55:50.667300+0000","last_peered":"2024-04-01T01:55:50.667300+0000","last_clean":"2024-04-01T01:55:50.667300+0000","last_became_active":"2024-04-01T01:55:49.279882+0000","last_became_peered":"2024-04-01T01:55:49.279882+0000","last_unstale":"2024-04-01T01:55:50.667300+0000","last_undegraded":"2024-04-01T01:55:50.667300+0000","last_fullsized":"2024-04-01T01:55:50.667300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:06:48.999905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.636174+0000","last_change":"2024-04-01T01:55:49.249890+0000","last_active":"2024-04-01T01:55:50.636174+0000","last_peered":"2024-04-01T01:55:50.636174+0000","last_clean":"2024-04-01T01:55:50.636174+0000","last_became_active":"2024-04-01T01:55:49.249588+0000","last_became_peered":"2024-04-01T01:55:49.249588+0000","last_unstale":"2024-04-01T01:55:50.636174+0000","last_undegraded":"2024-04-01T01:55:50.636174+0000","last_fullsized":"2024-04-01T01:55:50.636174+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:02:25.180455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.635657+0000","last_change":"2024-04-01T01:55:49.254529+0000","last_active":"2024-04-01T01:55:50.635657+0000","last_peered":"2024-04-01T01:55:50.635657+0000","last_clean":"2024-04-01T01:55:50.635657+0000","last_became_active":"2024-04-01T01:55:49.253726+0000","last_became_peered":"2024-04-01T01:55:49.253726+0000","last_unstale":"2024-04-01T01:55:50.635657+0000","last_undegraded":"2024-04-01T01:55:50.635657+0000","last_fullsized":"2024-04-01T01:55:50.635657+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:55:44.175129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.227405+0000","last_change":"2024-04-01T01:55:49.252043+0000","last_active":"2024-04-01T01:55:50.227405+0000","last_peered":"2024-04-01T01:55:50.227405+0000","last_clean":"2024-04-01T01:55:50.227405+0000","last_became_active":"2024-04-01T01:55:49.251760+0000","last_became_peered":"2024-04-01T01:55:49.251760+0000","last_unstale":"2024-04-01T01:55:50.227405+0000","last_undegraded":"2024-04-01T01:55:50.227405+0000","last_fullsized":"2024-04-01T01:55:50.227405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:12:25.325040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.666628+0000","last_change":"2024-04-01T01:55:49.270451+0000","last_active":"2024-04-01T01:55:50.666628+0000","last_peered":"2024-04-01T01:55:50.666628+0000","last_clean":"2024-04-01T01:55:50.666628+0000","last_became_active":"2024-04-01T01:55:49.269636+0000","last_became_peered":"2024-04-01T01:55:49.269636+0000","last_unstale":"2024-04-01T01:55:50.666628+0000","last_undegraded":"2024-04-01T01:55:50.666628+0000","last_fullsized":"2024-04-01T01:55:50.666628+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:11:14.234867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.664845+0000","last_change":"2024-04-01T01:55:49.266187+0000","last_active":"2024-04-01T01:55:50.664845+0000","last_peered":"2024-04-01T01:55:50.664845+0000","last_clean":"2024-04-01T01:55:50.664845+0000","last_became_active":"2024-04-01T01:55:49.265946+0000","last_became_peered":"2024-04-01T01:55:49.265946+0000","last_unstale":"2024-04-01T01:55:50.664845+0000","last_undegraded":"2024-04-01T01:55:50.664845+0000","last_fullsized":"2024-04-01T01:55:50.664845+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:37:46.890765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.665336+0000","last_change":"2024-04-01T01:55:49.273104+0000","last_active":"2024-04-01T01:55:50.665336+0000","last_peered":"2024-04-01T01:55:50.665336+0000","last_clean":"2024-04-01T01:55:50.665336+0000","last_became_active":"2024-04-01T01:55:49.272742+0000","last_became_peered":"2024-04-01T01:55:49.272742+0000","last_unstale":"2024-04-01T01:55:50.665336+0000","last_undegraded":"2024-04-01T01:55:50.665336+0000","last_fullsized":"2024-04-01T01:55:50.665336+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:37:46.890765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.224162+0000","last_change":"2024-04-01T01:55:49.241595+0000","last_active":"2024-04-01T01:55:50.224162+0000","last_peered":"2024-04-01T01:55:50.224162+0000","last_clean":"2024-04-01T01:55:50.224162+0000","last_became_active":"2024-04-01T01:55:49.238286+0000","last_became_peered":"2024-04-01T01:55:49.238286+0000","last_unstale":"2024-04-01T01:55:50.224162+0000","last_undegraded":"2024-04-01T01:55:50.224162+0000","last_fullsized":"2024-04-01T01:55:50.224162+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:06:48.999905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.226757+0000","last_change":"2024-04-01T01:55:48.225145+0000","last_active":"2024-04-01T01:55:50.226757+0000","last_peered":"2024-04-01T01:55:50.226757+0000","last_clean":"2024-04-01T01:55:50.226757+0000","last_became_active":"2024-04-01T01:55:48.224408+0000","last_became_peered":"2024-04-01T01:55:48.224408+0000","last_unstale":"2024-04-01T01:55:50.226757+0000","last_undegraded":"2024-04-01T01:55:50.226757+0000","last_fullsized":"2024-04-01T01:55:50.226757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:41:59.465915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.227045+0000","last_change":"2024-04-01T01:55:49.247771+0000","last_active":"2024-04-01T01:55:50.227045+0000","last_peered":"2024-04-01T01:55:50.227045+0000","last_clean":"2024-04-01T01:55:50.227045+0000","last_became_active":"2024-04-01T01:55:49.247496+0000","last_became_peered":"2024-04-01T01:55:49.247496+0000","last_unstale":"2024-04-01T01:55:50.227045+0000","last_undegraded":"2024-04-01T01:55:50.227045+0000","last_fullsized":"2024-04-01T01:55:50.227045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:02:25.180455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.666773+0000","last_change":"2024-04-01T01:55:48.221934+0000","last_active":"2024-04-01T01:55:50.666773+0000","last_peered":"2024-04-01T01:55:50.666773+0000","last_clean":"2024-04-01T01:55:50.666773+0000","last_became_active":"2024-04-01T01:55:48.221614+0000","last_became_peered":"2024-04-01T01:55:48.221614+0000","last_unstale":"2024-04-01T01:55:50.666773+0000","last_undegraded":"2024-04-01T01:55:50.666773+0000","last_fullsized":"2024-04-01T01:55:50.666773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:06:47.990123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.635306+0000","last_change":"2024-04-01T01:55:48.217879+0000","last_active":"2024-04-01T01:55:50.635306+0000","last_peered":"2024-04-01T01:55:50.635306+0000","last_clean":"2024-04-01T01:55:50.635306+0000","last_became_active":"2024-04-01T01:55:48.216141+0000","last_became_peered":"2024-04-01T01:55:48.216141+0000","last_unstale":"2024-04-01T01:55:50.635306+0000","last_undegraded":"2024-04-01T01:55:50.635306+0000","last_fullsized":"2024-04-01T01:55:50.635306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:36:42.625449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.227275+0000","last_change":"2024-04-01T01:55:49.246424+0000","last_active":"2024-04-01T01:55:50.227275+0000","last_peered":"2024-04-01T01:55:50.227275+0000","last_clean":"2024-04-01T01:55:50.227275+0000","last_became_active":"2024-04-01T01:55:49.243823+0000","last_became_peered":"2024-04-01T01:55:49.243823+0000","last_unstale":"2024-04-01T01:55:50.227275+0000","last_undegraded":"2024-04-01T01:55:50.227275+0000","last_fullsized":"2024-04-01T01:55:50.227275+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:27:45.663474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.665864+0000","last_change":"2024-04-01T01:55:48.222831+0000","last_active":"2024-04-01T01:55:50.665864+0000","last_peered":"2024-04-01T01:55:50.665864+0000","last_clean":"2024-04-01T01:55:50.665864+0000","last_became_active":"2024-04-01T01:55:48.222535+0000","last_became_peered":"2024-04-01T01:55:48.222535+0000","last_unstale":"2024-04-01T01:55:50.665864+0000","last_undegraded":"2024-04-01T01:55:50.665864+0000","last_fullsized":"2024-04-01T01:55:50.665864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:49:34.960786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.227957+0000","last_change":"2024-04-01T01:55:49.231967+0000","last_active":"2024-04-01T01:55:50.227957+0000","last_peered":"2024-04-01T01:55:50.227957+0000","last_clean":"2024-04-01T01:55:50.227957+0000","last_became_active":"2024-04-01T01:55:49.230659+0000","last_became_peered":"2024-04-01T01:55:49.230659+0000","last_unstale":"2024-04-01T01:55:50.227957+0000","last_undegraded":"2024-04-01T01:55:50.227957+0000","last_fullsized":"2024-04-01T01:55:50.227957+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:57:31.843504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.224697+0000","last_change":"2024-04-01T01:55:48.216724+0000","last_active":"2024-04-01T01:55:50.224697+0000","last_peered":"2024-04-01T01:55:50.224697+0000","last_clean":"2024-04-01T01:55:50.224697+0000","last_became_active":"2024-04-01T01:55:48.216318+0000","last_became_peered":"2024-04-01T01:55:48.216318+0000","last_unstale":"2024-04-01T01:55:50.224697+0000","last_undegraded":"2024-04-01T01:55:50.224697+0000","last_fullsized":"2024-04-01T01:55:50.224697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:25:51.219789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.667408+0000","last_change":"2024-04-01T01:55:49.280230+0000","last_active":"2024-04-01T01:55:50.667408+0000","last_peered":"2024-04-01T01:55:50.667408+0000","last_clean":"2024-04-01T01:55:50.667408+0000","last_became_active":"2024-04-01T01:55:49.279866+0000","last_became_peered":"2024-04-01T01:55:49.279866+0000","last_unstale":"2024-04-01T01:55:50.667408+0000","last_undegraded":"2024-04-01T01:55:50.667408+0000","last_fullsized":"2024-04-01T01:55:50.667408+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:00:34.607980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.485507+0000","last_change":"2024-04-01T01:55:48.213879+0000","last_active":"2024-04-01T01:55:50.485507+0000","last_peered":"2024-04-01T01:55:50.485507+0000","last_clean":"2024-04-01T01:55:50.485507+0000","last_became_active":"2024-04-01T01:55:48.213610+0000","last_became_peered":"2024-04-01T01:55:48.213610+0000","last_unstale":"2024-04-01T01:55:50.485507+0000","last_undegraded":"2024-04-01T01:55:50.485507+0000","last_fullsized":"2024-04-01T01:55:50.485507+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:33:55.744424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.228364+0000","last_change":"2024-04-01T01:55:49.261532+0000","last_active":"2024-04-01T01:55:50.228364+0000","last_peered":"2024-04-01T01:55:50.228364+0000","last_clean":"2024-04-01T01:55:50.228364+0000","last_became_active":"2024-04-01T01:55:49.261260+0000","last_became_peered":"2024-04-01T01:55:49.261260+0000","last_unstale":"2024-04-01T01:55:50.228364+0000","last_undegraded":"2024-04-01T01:55:50.228364+0000","last_fullsized":"2024-04-01T01:55:50.228364+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:30:02.149564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.665057+0000","last_change":"2024-04-01T01:55:48.227054+0000","last_active":"2024-04-01T01:55:50.665057+0000","last_peered":"2024-04-01T01:55:50.665057+0000","last_clean":"2024-04-01T01:55:50.665057+0000","last_became_active":"2024-04-01T01:55:48.226061+0000","last_became_peered":"2024-04-01T01:55:48.226061+0000","last_unstale":"2024-04-01T01:55:50.665057+0000","last_undegraded":"2024-04-01T01:55:50.665057+0000","last_fullsized":"2024-04-01T01:55:50.665057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:18:27.840431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.666111+0000","last_change":"2024-04-01T01:55:49.261662+0000","last_active":"2024-04-01T01:55:50.666111+0000","last_peered":"2024-04-01T01:55:50.666111+0000","last_clean":"2024-04-01T01:55:50.666111+0000","last_became_active":"2024-04-01T01:55:49.261286+0000","last_became_peered":"2024-04-01T01:55:49.261286+0000","last_unstale":"2024-04-01T01:55:50.666111+0000","last_undegraded":"2024-04-01T01:55:50.666111+0000","last_fullsized":"2024-04-01T01:55:50.666111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:56:11.350186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.667035+0000","last_change":"2024-04-01T01:55:48.219739+0000","last_active":"2024-04-01T01:55:50.667035+0000","last_peered":"2024-04-01T01:55:50.667035+0000","last_clean":"2024-04-01T01:55:50.667035+0000","last_became_active":"2024-04-01T01:55:48.219107+0000","last_became_peered":"2024-04-01T01:55:48.219107+0000","last_unstale":"2024-04-01T01:55:50.667035+0000","last_undegraded":"2024-04-01T01:55:50.667035+0000","last_fullsized":"2024-04-01T01:55:50.667035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:14:12.790111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.485917+0000","last_change":"2024-04-01T01:55:49.255056+0000","last_active":"2024-04-01T01:55:50.485917+0000","last_peered":"2024-04-01T01:55:50.485917+0000","last_clean":"2024-04-01T01:55:50.485917+0000","last_became_active":"2024-04-01T01:55:49.247910+0000","last_became_peered":"2024-04-01T01:55:49.247910+0000","last_unstale":"2024-04-01T01:55:50.485917+0000","last_undegraded":"2024-04-01T01:55:50.485917+0000","last_fullsized":"2024-04-01T01:55:50.485917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T13:02:55.577616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.665142+0000","last_change":"2024-04-01T01:55:48.215613+0000","last_active":"2024-04-01T01:55:50.665142+0000","last_peered":"2024-04-01T01:55:50.665142+0000","last_clean":"2024-04-01T01:55:50.665142+0000","last_became_active":"2024-04-01T01:55:48.214669+0000","last_became_peered":"2024-04-01T01:55:48.214669+0000","last_unstale":"2024-04-01T01:55:50.665142+0000","last_undegraded":"2024-04-01T01:55:50.665142+0000","last_fullsized":"2024-04-01T01:55:50.665142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:25:51.219789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.635349+0000","last_change":"2024-04-01T01:55:49.270153+0000","last_active":"2024-04-01T01:55:50.635349+0000","last_peered":"2024-04-01T01:55:50.635349+0000","last_clean":"2024-04-01T01:55:50.635349+0000","last_became_active":"2024-04-01T01:55:49.269840+0000","last_became_peered":"2024-04-01T01:55:49.269840+0000","last_unstale":"2024-04-01T01:55:50.635349+0000","last_undegraded":"2024-04-01T01:55:50.635349+0000","last_fullsized":"2024-04-01T01:55:50.635349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:00:34.607980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.667049+0000","last_change":"2024-04-01T01:55:48.214783+0000","last_active":"2024-04-01T01:55:50.667049+0000","last_peered":"2024-04-01T01:55:50.667049+0000","last_clean":"2024-04-01T01:55:50.667049+0000","last_became_active":"2024-04-01T01:55:48.213463+0000","last_became_peered":"2024-04-01T01:55:48.213463+0000","last_unstale":"2024-04-01T01:55:50.667049+0000","last_undegraded":"2024-04-01T01:55:50.667049+0000","last_fullsized":"2024-04-01T01:55:50.667049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:00:33.598198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.666568+0000","last_change":"2024-04-01T01:55:49.274841+0000","last_active":"2024-04-01T01:55:50.666568+0000","last_peered":"2024-04-01T01:55:50.666568+0000","last_clean":"2024-04-01T01:55:50.666568+0000","last_became_active":"2024-04-01T01:55:49.274430+0000","last_became_peered":"2024-04-01T01:55:49.274430+0000","last_unstale":"2024-04-01T01:55:50.666568+0000","last_undegraded":"2024-04-01T01:55:50.666568+0000","last_fullsized":"2024-04-01T01:55:50.666568+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T13:25:36.254927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.484812+0000","last_change":"2024-04-01T01:55:48.210944+0000","last_active":"2024-04-01T01:55:50.484812+0000","last_peered":"2024-04-01T01:55:50.484812+0000","last_clean":"2024-04-01T01:55:50.484812+0000","last_became_active":"2024-04-01T01:55:48.210616+0000","last_became_peered":"2024-04-01T01:55:48.210616+0000","last_unstale":"2024-04-01T01:55:50.484812+0000","last_undegraded":"2024-04-01T01:55:50.484812+0000","last_fullsized":"2024-04-01T01:55:50.484812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:38:32.247471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.223513+0000","last_change":"2024-04-01T01:55:49.239528+0000","last_active":"2024-04-01T01:55:50.223513+0000","last_peered":"2024-04-01T01:55:50.223513+0000","last_clean":"2024-04-01T01:55:50.223513+0000","last_became_active":"2024-04-01T01:55:49.238805+0000","last_became_peered":"2024-04-01T01:55:49.238805+0000","last_unstale":"2024-04-01T01:55:50.223513+0000","last_undegraded":"2024-04-01T01:55:50.223513+0000","last_fullsized":"2024-04-01T01:55:50.223513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:37:46.890765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.226599+0000","last_change":"2024-04-01T01:55:48.211677+0000","last_active":"2024-04-01T01:55:50.226599+0000","last_peered":"2024-04-01T01:55:50.226599+0000","last_clean":"2024-04-01T01:55:50.226599+0000","last_became_active":"2024-04-01T01:55:48.210893+0000","last_became_peered":"2024-04-01T01:55:48.210893+0000","last_unstale":"2024-04-01T01:55:50.226599+0000","last_undegraded":"2024-04-01T01:55:50.226599+0000","last_fullsized":"2024-04-01T01:55:50.226599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:04:19.568533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.666123+0000","last_change":"2024-04-01T01:55:49.261872+0000","last_active":"2024-04-01T01:55:50.666123+0000","last_peered":"2024-04-01T01:55:50.666123+0000","last_clean":"2024-04-01T01:55:50.666123+0000","last_became_active":"2024-04-01T01:55:49.261517+0000","last_became_peered":"2024-04-01T01:55:49.261517+0000","last_unstale":"2024-04-01T01:55:50.666123+0000","last_undegraded":"2024-04-01T01:55:50.666123+0000","last_fullsized":"2024-04-01T01:55:50.666123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T13:02:55.577616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.485838+0000","last_change":"2024-04-01T01:55:48.198687+0000","last_active":"2024-04-01T01:55:50.485838+0000","last_peered":"2024-04-01T01:55:50.485838+0000","last_clean":"2024-04-01T01:55:50.485838+0000","last_became_active":"2024-04-01T01:55:48.198319+0000","last_became_peered":"2024-04-01T01:55:48.198319+0000","last_unstale":"2024-04-01T01:55:50.485838+0000","last_undegraded":"2024-04-01T01:55:50.485838+0000","last_fullsized":"2024-04-01T01:55:50.485838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:37:45.880984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.667742+0000","last_change":"2024-04-01T01:55:49.272424+0000","last_active":"2024-04-01T01:55:50.667742+0000","last_peered":"2024-04-01T01:55:50.667742+0000","last_clean":"2024-04-01T01:55:50.667742+0000","last_became_active":"2024-04-01T01:55:49.265670+0000","last_became_peered":"2024-04-01T01:55:49.265670+0000","last_unstale":"2024-04-01T01:55:50.667742+0000","last_undegraded":"2024-04-01T01:55:50.667742+0000","last_fullsized":"2024-04-01T01:55:50.667742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:26:09.632757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.227729+0000","last_change":"2024-04-01T01:55:48.219312+0000","last_active":"2024-04-01T01:55:50.227729+0000","last_peered":"2024-04-01T01:55:50.227729+0000","last_clean":"2024-04-01T01:55:50.227729+0000","last_became_active":"2024-04-01T01:55:48.218562+0000","last_became_peered":"2024-04-01T01:55:48.218562+0000","last_unstale":"2024-04-01T01:55:50.227729+0000","last_undegraded":"2024-04-01T01:55:50.227729+0000","last_fullsized":"2024-04-01T01:55:50.227729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:38:32.247471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.485763+0000","last_change":"2024-04-01T01:55:49.268041+0000","last_active":"2024-04-01T01:55:50.485763+0000","last_peered":"2024-04-01T01:55:50.485763+0000","last_clean":"2024-04-01T01:55:50.485763+0000","last_became_active":"2024-04-01T01:55:49.267502+0000","last_became_peered":"2024-04-01T01:55:49.267502+0000","last_unstale":"2024-04-01T01:55:50.485763+0000","last_undegraded":"2024-04-01T01:55:50.485763+0000","last_fullsized":"2024-04-01T01:55:50.485763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:21:46.367144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.227260+0000","last_change":"2024-04-01T01:55:48.216662+0000","last_active":"2024-04-01T01:55:50.227260+0000","last_peered":"2024-04-01T01:55:50.227260+0000","last_clean":"2024-04-01T01:55:50.227260+0000","last_became_active":"2024-04-01T01:55:48.215852+0000","last_became_peered":"2024-04-01T01:55:48.215852+0000","last_unstale":"2024-04-01T01:55:50.227260+0000","last_undegraded":"2024-04-01T01:55:50.227260+0000","last_fullsized":"2024-04-01T01:55:50.227260+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:25:39.713293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.485456+0000","last_change":"2024-04-01T01:55:49.256142+0000","last_active":"2024-04-01T01:55:50.485456+0000","last_peered":"2024-04-01T01:55:50.485456+0000","last_clean":"2024-04-01T01:55:50.485456+0000","last_became_active":"2024-04-01T01:55:49.255781+0000","last_became_peered":"2024-04-01T01:55:49.255781+0000","last_unstale":"2024-04-01T01:55:50.485456+0000","last_undegraded":"2024-04-01T01:55:50.485456+0000","last_fullsized":"2024-04-01T01:55:50.485456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:10:23.571126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.635926+0000","last_change":"2024-04-01T01:55:48.219851+0000","last_active":"2024-04-01T01:55:50.635926+0000","last_peered":"2024-04-01T01:55:50.635926+0000","last_clean":"2024-04-01T01:55:50.635926+0000","last_became_active":"2024-04-01T01:55:48.215898+0000","last_became_peered":"2024-04-01T01:55:48.215898+0000","last_unstale":"2024-04-01T01:55:50.635926+0000","last_undegraded":"2024-04-01T01:55:50.635926+0000","last_fullsized":"2024-04-01T01:55:50.635926+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:18:27.840431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.667778+0000","last_change":"2024-04-01T01:55:49.275452+0000","last_active":"2024-04-01T01:55:50.667778+0000","last_peered":"2024-04-01T01:55:50.667778+0000","last_clean":"2024-04-01T01:55:50.667778+0000","last_became_active":"2024-04-01T01:55:49.274600+0000","last_became_peered":"2024-04-01T01:55:49.274600+0000","last_unstale":"2024-04-01T01:55:50.667778+0000","last_undegraded":"2024-04-01T01:55:50.667778+0000","last_fullsized":"2024-04-01T01:55:50.667778+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:19:24.052574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.223321+0000","last_change":"2024-04-01T01:55:43.145201+0000","last_active":"2024-04-01T01:55:50.223321+0000","last_peered":"2024-04-01T01:55:50.223321+0000","last_clean":"2024-04-01T01:55:50.223321+0000","last_became_active":"2024-04-01T01:55:43.144882+0000","last_became_peered":"2024-04-01T01:55:43.144882+0000","last_unstale":"2024-04-01T01:55:50.223321+0000","last_undegraded":"2024-04-01T01:55:50.223321+0000","last_fullsized":"2024-04-01T01:55:50.223321+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:42.134502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:42.134502+0000","last_clean_scrub_stamp":"2024-04-01T01:55:42.134502+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:02:26.589535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.666696+0000","last_change":"2024-04-01T01:55:48.207222+0000","last_active":"2024-04-01T01:55:50.666696+0000","last_peered":"2024-04-01T01:55:50.666696+0000","last_clean":"2024-04-01T01:55:50.666696+0000","last_became_active":"2024-04-01T01:55:48.206293+0000","last_became_peered":"2024-04-01T01:55:48.206293+0000","last_unstale":"2024-04-01T01:55:50.666696+0000","last_undegraded":"2024-04-01T01:55:50.666696+0000","last_fullsized":"2024-04-01T01:55:50.666696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:37:45.880984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.226523+0000","last_change":"2024-04-01T01:55:49.273517+0000","last_active":"2024-04-01T01:55:50.226523+0000","last_peered":"2024-04-01T01:55:50.226523+0000","last_clean":"2024-04-01T01:55:50.226523+0000","last_became_active":"2024-04-01T01:55:49.273197+0000","last_became_peered":"2024-04-01T01:55:49.273197+0000","last_unstale":"2024-04-01T01:55:50.226523+0000","last_undegraded":"2024-04-01T01:55:50.226523+0000","last_fullsized":"2024-04-01T01:55:50.226523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:14:32.577522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.666134+0000","last_change":"2024-04-01T01:55:48.214341+0000","last_active":"2024-04-01T01:55:50.666134+0000","last_peered":"2024-04-01T01:55:50.666134+0000","last_clean":"2024-04-01T01:55:50.666134+0000","last_became_active":"2024-04-01T01:55:48.213914+0000","last_became_peered":"2024-04-01T01:55:48.213914+0000","last_unstale":"2024-04-01T01:55:50.666134+0000","last_undegraded":"2024-04-01T01:55:50.666134+0000","last_fullsized":"2024-04-01T01:55:50.666134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:09:28.276592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.636256+0000","last_change":"2024-04-01T01:55:49.272106+0000","last_active":"2024-04-01T01:55:50.636256+0000","last_peered":"2024-04-01T01:55:50.636256+0000","last_clean":"2024-04-01T01:55:50.636256+0000","last_became_active":"2024-04-01T01:55:49.271821+0000","last_became_peered":"2024-04-01T01:55:49.271821+0000","last_unstale":"2024-04-01T01:55:50.636256+0000","last_undegraded":"2024-04-01T01:55:50.636256+0000","last_fullsized":"2024-04-01T01:55:50.636256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T13:22:31.821166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.664742+0000","last_change":"2024-04-01T01:55:48.218296+0000","last_active":"2024-04-01T01:55:50.664742+0000","last_peered":"2024-04-01T01:55:50.664742+0000","last_clean":"2024-04-01T01:55:50.664742+0000","last_became_active":"2024-04-01T01:55:48.217516+0000","last_became_peered":"2024-04-01T01:55:48.217516+0000","last_unstale":"2024-04-01T01:55:50.664742+0000","last_undegraded":"2024-04-01T01:55:50.664742+0000","last_fullsized":"2024-04-01T01:55:50.664742+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:36:42.625449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.226891+0000","last_change":"2024-04-01T01:55:49.246734+0000","last_active":"2024-04-01T01:55:50.226891+0000","last_peered":"2024-04-01T01:55:50.226891+0000","last_clean":"2024-04-01T01:55:50.226891+0000","last_became_active":"2024-04-01T01:55:49.246152+0000","last_became_peered":"2024-04-01T01:55:49.246152+0000","last_unstale":"2024-04-01T01:55:50.226891+0000","last_undegraded":"2024-04-01T01:55:50.226891+0000","last_fullsized":"2024-04-01T01:55:50.226891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:52:34.992185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.667221+0000","last_change":"2024-04-01T01:55:48.222956+0000","last_active":"2024-04-01T01:55:50.667221+0000","last_peered":"2024-04-01T01:55:50.667221+0000","last_clean":"2024-04-01T01:55:50.667221+0000","last_became_active":"2024-04-01T01:55:48.222414+0000","last_became_peered":"2024-04-01T01:55:48.222414+0000","last_unstale":"2024-04-01T01:55:50.667221+0000","last_undegraded":"2024-04-01T01:55:50.667221+0000","last_fullsized":"2024-04-01T01:55:50.667221+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:26:08.622975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.485388+0000","last_change":"2024-04-01T01:55:49.247633+0000","last_active":"2024-04-01T01:55:50.485388+0000","last_peered":"2024-04-01T01:55:50.485388+0000","last_clean":"2024-04-01T01:55:50.485388+0000","last_became_active":"2024-04-01T01:55:49.247285+0000","last_became_peered":"2024-04-01T01:55:49.247285+0000","last_unstale":"2024-04-01T01:55:50.485388+0000","last_undegraded":"2024-04-01T01:55:50.485388+0000","last_fullsized":"2024-04-01T01:55:50.485388+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:15:01.912111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.226200+0000","last_change":"2024-04-01T01:55:48.226323+0000","last_active":"2024-04-01T01:55:50.226200+0000","last_peered":"2024-04-01T01:55:50.226200+0000","last_clean":"2024-04-01T01:55:50.226200+0000","last_became_active":"2024-04-01T01:55:48.225487+0000","last_became_peered":"2024-04-01T01:55:48.225487+0000","last_unstale":"2024-04-01T01:55:50.226200+0000","last_undegraded":"2024-04-01T01:55:50.226200+0000","last_fullsized":"2024-04-01T01:55:50.226200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:13:17.832963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.667602+0000","last_change":"2024-04-01T01:55:49.265542+0000","last_active":"2024-04-01T01:55:50.667602+0000","last_peered":"2024-04-01T01:55:50.667602+0000","last_clean":"2024-04-01T01:55:50.667602+0000","last_became_active":"2024-04-01T01:55:49.264914+0000","last_became_peered":"2024-04-01T01:55:49.264914+0000","last_unstale":"2024-04-01T01:55:50.667602+0000","last_undegraded":"2024-04-01T01:55:50.667602+0000","last_fullsized":"2024-04-01T01:55:50.667602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:55:44.175129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.667910+0000","last_change":"2024-04-01T01:55:48.227292+0000","last_active":"2024-04-01T01:55:50.667910+0000","last_peered":"2024-04-01T01:55:50.667910+0000","last_clean":"2024-04-01T01:55:50.667910+0000","last_became_active":"2024-04-01T01:55:48.226948+0000","last_became_peered":"2024-04-01T01:55:48.226948+0000","last_unstale":"2024-04-01T01:55:50.667910+0000","last_undegraded":"2024-04-01T01:55:50.667910+0000","last_fullsized":"2024-04-01T01:55:50.667910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:55:43.165347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.636006+0000","last_change":"2024-04-01T01:55:49.244171+0000","last_active":"2024-04-01T01:55:50.636006+0000","last_peered":"2024-04-01T01:55:50.636006+0000","last_clean":"2024-04-01T01:55:50.636006+0000","last_became_active":"2024-04-01T01:55:49.241632+0000","last_became_peered":"2024-04-01T01:55:49.241632+0000","last_unstale":"2024-04-01T01:55:50.636006+0000","last_undegraded":"2024-04-01T01:55:50.636006+0000","last_fullsized":"2024-04-01T01:55:50.636006+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:24:42.777720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.228150+0000","last_change":"2024-04-01T01:55:48.204432+0000","last_active":"2024-04-01T01:55:50.228150+0000","last_peered":"2024-04-01T01:55:50.228150+0000","last_clean":"2024-04-01T01:55:50.228150+0000","last_became_active":"2024-04-01T01:55:48.203576+0000","last_became_peered":"2024-04-01T01:55:48.203576+0000","last_unstale":"2024-04-01T01:55:50.228150+0000","last_undegraded":"2024-04-01T01:55:50.228150+0000","last_fullsized":"2024-04-01T01:55:50.228150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:49:34.960786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.227962+0000","last_change":"2024-04-01T01:55:49.244993+0000","last_active":"2024-04-01T01:55:50.227962+0000","last_peered":"2024-04-01T01:55:50.227962+0000","last_clean":"2024-04-01T01:55:50.227962+0000","last_became_active":"2024-04-01T01:55:49.244632+0000","last_became_peered":"2024-04-01T01:55:49.244632+0000","last_unstale":"2024-04-01T01:55:50.227962+0000","last_undegraded":"2024-04-01T01:55:50.227962+0000","last_fullsized":"2024-04-01T01:55:50.227962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:30:26.148968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.668315+0000","last_change":"2024-04-01T01:55:48.221282+0000","last_active":"2024-04-01T01:55:50.668315+0000","last_peered":"2024-04-01T01:55:50.668315+0000","last_clean":"2024-04-01T01:55:50.668315+0000","last_became_active":"2024-04-01T01:55:48.220889+0000","last_became_peered":"2024-04-01T01:55:48.220889+0000","last_unstale":"2024-04-01T01:55:50.668315+0000","last_undegraded":"2024-04-01T01:55:50.668315+0000","last_fullsized":"2024-04-01T01:55:50.668315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:13:12.104386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.227472+0000","last_change":"2024-04-01T01:55:49.251927+0000","last_active":"2024-04-01T01:55:50.227472+0000","last_peered":"2024-04-01T01:55:50.227472+0000","last_clean":"2024-04-01T01:55:50.227472+0000","last_became_active":"2024-04-01T01:55:49.251641+0000","last_became_peered":"2024-04-01T01:55:49.251641+0000","last_unstale":"2024-04-01T01:55:50.227472+0000","last_undegraded":"2024-04-01T01:55:50.227472+0000","last_fullsized":"2024-04-01T01:55:50.227472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T13:22:31.821166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.484332+0000","last_change":"2024-04-01T01:55:48.204161+0000","last_active":"2024-04-01T01:55:50.484332+0000","last_peered":"2024-04-01T01:55:50.484332+0000","last_clean":"2024-04-01T01:55:50.484332+0000","last_became_active":"2024-04-01T01:55:48.203828+0000","last_became_peered":"2024-04-01T01:55:48.203828+0000","last_unstale":"2024-04-01T01:55:50.484332+0000","last_undegraded":"2024-04-01T01:55:50.484332+0000","last_fullsized":"2024-04-01T01:55:50.484332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:04:19.568533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.666187+0000","last_change":"2024-04-01T01:55:49.259699+0000","last_active":"2024-04-01T01:55:50.666187+0000","last_peered":"2024-04-01T01:55:50.666187+0000","last_clean":"2024-04-01T01:55:50.666187+0000","last_became_active":"2024-04-01T01:55:49.259332+0000","last_became_peered":"2024-04-01T01:55:49.259332+0000","last_unstale":"2024-04-01T01:55:50.666187+0000","last_undegraded":"2024-04-01T01:55:50.666187+0000","last_fullsized":"2024-04-01T01:55:50.666187+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:02:41.829474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.227810+0000","last_change":"2024-04-01T01:55:48.206742+0000","last_active":"2024-04-01T01:55:50.227810+0000","last_peered":"2024-04-01T01:55:50.227810+0000","last_clean":"2024-04-01T01:55:50.227810+0000","last_became_active":"2024-04-01T01:55:48.206027+0000","last_became_peered":"2024-04-01T01:55:48.206027+0000","last_unstale":"2024-04-01T01:55:50.227810+0000","last_undegraded":"2024-04-01T01:55:50.227810+0000","last_fullsized":"2024-04-01T01:55:50.227810+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:18:27.840431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.228142+0000","last_change":"2024-04-01T01:55:49.246379+0000","last_active":"2024-04-01T01:55:50.228142+0000","last_peered":"2024-04-01T01:55:50.228142+0000","last_clean":"2024-04-01T01:55:50.228142+0000","last_became_active":"2024-04-01T01:55:49.245774+0000","last_became_peered":"2024-04-01T01:55:49.245774+0000","last_unstale":"2024-04-01T01:55:50.228142+0000","last_undegraded":"2024-04-01T01:55:50.228142+0000","last_fullsized":"2024-04-01T01:55:50.228142+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:25:48.896071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.635697+0000","last_change":"2024-04-01T01:55:48.222218+0000","last_active":"2024-04-01T01:55:50.635697+0000","last_peered":"2024-04-01T01:55:50.635697+0000","last_clean":"2024-04-01T01:55:50.635697+0000","last_became_active":"2024-04-01T01:55:48.221148+0000","last_became_peered":"2024-04-01T01:55:48.221148+0000","last_unstale":"2024-04-01T01:55:50.635697+0000","last_undegraded":"2024-04-01T01:55:50.635697+0000","last_fullsized":"2024-04-01T01:55:50.635697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:25:51.219789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.665026+0000","last_change":"2024-04-01T01:55:49.249648+0000","last_active":"2024-04-01T01:55:50.665026+0000","last_peered":"2024-04-01T01:55:50.665026+0000","last_clean":"2024-04-01T01:55:50.665026+0000","last_became_active":"2024-04-01T01:55:49.248925+0000","last_became_peered":"2024-04-01T01:55:49.248925+0000","last_unstale":"2024-04-01T01:55:50.665026+0000","last_undegraded":"2024-04-01T01:55:50.665026+0000","last_fullsized":"2024-04-01T01:55:50.665026+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:33:56.754206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.666488+0000","last_change":"2024-04-01T01:55:48.207522+0000","last_active":"2024-04-01T01:55:50.666488+0000","last_peered":"2024-04-01T01:55:50.666488+0000","last_clean":"2024-04-01T01:55:50.666488+0000","last_became_active":"2024-04-01T01:55:48.206856+0000","last_became_peered":"2024-04-01T01:55:48.206856+0000","last_unstale":"2024-04-01T01:55:50.666488+0000","last_undegraded":"2024-04-01T01:55:50.666488+0000","last_fullsized":"2024-04-01T01:55:50.666488+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:33:55.744424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.667078+0000","last_change":"2024-04-01T01:55:49.274489+0000","last_active":"2024-04-01T01:55:50.667078+0000","last_peered":"2024-04-01T01:55:50.667078+0000","last_clean":"2024-04-01T01:55:50.667078+0000","last_became_active":"2024-04-01T01:55:49.270254+0000","last_became_peered":"2024-04-01T01:55:49.270254+0000","last_unstale":"2024-04-01T01:55:50.667078+0000","last_undegraded":"2024-04-01T01:55:50.667078+0000","last_fullsized":"2024-04-01T01:55:50.667078+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T13:09:00.491227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.666309+0000","last_change":"2024-04-01T01:55:49.275782+0000","last_active":"2024-04-01T01:55:50.666309+0000","last_peered":"2024-04-01T01:55:50.666309+0000","last_clean":"2024-04-01T01:55:50.666309+0000","last_became_active":"2024-04-01T01:55:49.275050+0000","last_became_peered":"2024-04-01T01:55:49.275050+0000","last_unstale":"2024-04-01T01:55:50.666309+0000","last_undegraded":"2024-04-01T01:55:50.666309+0000","last_fullsized":"2024-04-01T01:55:50.666309+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:26:15.406856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.485245+0000","last_change":"2024-04-01T01:55:48.223704+0000","last_active":"2024-04-01T01:55:50.485245+0000","last_peered":"2024-04-01T01:55:50.485245+0000","last_clean":"2024-04-01T01:55:50.485245+0000","last_became_active":"2024-04-01T01:55:48.223220+0000","last_became_peered":"2024-04-01T01:55:48.223220+0000","last_unstale":"2024-04-01T01:55:50.485245+0000","last_undegraded":"2024-04-01T01:55:50.485245+0000","last_fullsized":"2024-04-01T01:55:50.485245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:49:34.960786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.223741+0000","last_change":"2024-04-01T01:55:49.264857+0000","last_active":"2024-04-01T01:55:50.223741+0000","last_peered":"2024-04-01T01:55:50.223741+0000","last_clean":"2024-04-01T01:55:50.223741+0000","last_became_active":"2024-04-01T01:55:49.258478+0000","last_became_peered":"2024-04-01T01:55:49.258478+0000","last_unstale":"2024-04-01T01:55:50.223741+0000","last_undegraded":"2024-04-01T01:55:50.223741+0000","last_fullsized":"2024-04-01T01:55:50.223741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:33:56.754206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.485995+0000","last_change":"2024-04-01T01:55:48.218370+0000","last_active":"2024-04-01T01:55:50.485995+0000","last_peered":"2024-04-01T01:55:50.485995+0000","last_clean":"2024-04-01T01:55:50.485995+0000","last_became_active":"2024-04-01T01:55:48.217755+0000","last_became_peered":"2024-04-01T01:55:48.217755+0000","last_unstale":"2024-04-01T01:55:50.485995+0000","last_undegraded":"2024-04-01T01:55:50.485995+0000","last_fullsized":"2024-04-01T01:55:50.485995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:09:28.276592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.228017+0000","last_change":"2024-04-01T01:55:49.243377+0000","last_active":"2024-04-01T01:55:50.228017+0000","last_peered":"2024-04-01T01:55:50.228017+0000","last_clean":"2024-04-01T01:55:50.228017+0000","last_became_active":"2024-04-01T01:55:49.242851+0000","last_became_peered":"2024-04-01T01:55:49.242851+0000","last_unstale":"2024-04-01T01:55:50.228017+0000","last_undegraded":"2024-04-01T01:55:50.228017+0000","last_fullsized":"2024-04-01T01:55:50.228017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:48:38.596647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.227487+0000","last_change":"2024-04-01T01:55:48.213862+0000","last_active":"2024-04-01T01:55:50.227487+0000","last_peered":"2024-04-01T01:55:50.227487+0000","last_clean":"2024-04-01T01:55:50.227487+0000","last_became_active":"2024-04-01T01:55:48.213122+0000","last_became_peered":"2024-04-01T01:55:48.213122+0000","last_unstale":"2024-04-01T01:55:50.227487+0000","last_undegraded":"2024-04-01T01:55:50.227487+0000","last_fullsized":"2024-04-01T01:55:50.227487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:59:23.563864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.227575+0000","last_change":"2024-04-01T01:55:49.252273+0000","last_active":"2024-04-01T01:55:50.227575+0000","last_peered":"2024-04-01T01:55:50.227575+0000","last_clean":"2024-04-01T01:55:50.227575+0000","last_became_active":"2024-04-01T01:55:49.251963+0000","last_became_peered":"2024-04-01T01:55:49.251963+0000","last_unstale":"2024-04-01T01:55:50.227575+0000","last_undegraded":"2024-04-01T01:55:50.227575+0000","last_fullsized":"2024-04-01T01:55:50.227575+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:56:18.086766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.227756+0000","last_change":"2024-04-01T01:55:48.225858+0000","last_active":"2024-04-01T01:55:50.227756+0000","last_peered":"2024-04-01T01:55:50.227756+0000","last_clean":"2024-04-01T01:55:50.227756+0000","last_became_active":"2024-04-01T01:55:48.224494+0000","last_became_peered":"2024-04-01T01:55:48.224494+0000","last_unstale":"2024-04-01T01:55:50.227756+0000","last_undegraded":"2024-04-01T01:55:50.227756+0000","last_fullsized":"2024-04-01T01:55:50.227756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:09:28.276592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66838,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509447,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509448,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":74457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31388,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340452,"statfs":{"total":96636764160,"available":96604622848,"internally_reserved":0,"allocated":212992,"data_stored":72755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":221184,"data_stored":73785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509447,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31456,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340384,"statfs":{"total":96636764160,"available":96604553216,"internally_reserved":0,"allocated":278528,"data_stored":662611,"data_compressed":33419,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509446,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":217088,"data_stored":72229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542150,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":72173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":282624,"data_stored":662633,"data_compressed":33419,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33419,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33419,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-01T01:56:02.234 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-01T01:56:02.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.398+0000 7f801d400640 1 Processor -- start 2024-04-01T01:56:02.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.398+0000 7f801d400640 1 -- start start 2024-04-01T01:56:02.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.398+0000 7f801d400640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f80180c3e70 0x7f80180c6c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:02.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.398+0000 7f801d400640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f80180c7850 0x7f8018071250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:02.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.398+0000 7f801d400640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8018156cc0 con 0x7f80181502a0 2024-04-01T01:56:02.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.398+0000 7f801d400640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f80180c7ca0 con 0x7f80180c7850 2024-04-01T01:56:02.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.398+0000 7f801d400640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f80180c5ea0 con 0x7f80180c3e70 2024-04-01T01:56:02.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.398+0000 7f8016ffd640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f80181502a0 0x7f801806ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44708/0 (socket says 172.21.15.50:44708) 2024-04-01T01:56:02.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.398+0000 7f8016ffd640 1 -- 172.21.15.50:0/1520968132 learned_addr learned my addr 172.21.15.50:0/1520968132 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-04-01T01:56:02.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.398+0000 7f80167fc640 1 --2- 172.21.15.50:0/1520968132 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f80180c3e70 0x7f80180c6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:02.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.398+0000 7f8015ffb640 1 -- 172.21.15.50:0/1520968132 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1292591469 0 0) 0x7f8018156cc0 con 0x7f80181502a0 2024-04-01T01:56:02.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.398+0000 7f80177fe640 1 --2- 172.21.15.50:0/1520968132 >> v2:172.21.15.97:3300/0 conn(0x7f80180c7850 0x7f8018071250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:02.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.398+0000 7f8015ffb640 1 -- 172.21.15.50:0/1520968132 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8000003530 con 0x7f80181502a0 2024-04-01T01:56:02.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.398+0000 7f8015ffb640 1 -- 172.21.15.50:0/1520968132 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2140499322 0 0) 0x7f8000003530 con 0x7f80181502a0 2024-04-01T01:56:02.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.398+0000 7f8015ffb640 1 -- 172.21.15.50:0/1520968132 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f80180c3e70 msgr2=0x7f80180c6c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:56:02.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.398+0000 7f8015ffb640 1 --2- 172.21.15.50:0/1520968132 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f80180c3e70 0x7f80180c6c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:02.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.398+0000 7f8015ffb640 1 -- 172.21.15.50:0/1520968132 >> v2:172.21.15.97:3300/0 conn(0x7f80180c7850 msgr2=0x7f8018071250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:56:02.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.398+0000 7f8015ffb640 1 --2- 172.21.15.50:0/1520968132 >> v2:172.21.15.97:3300/0 conn(0x7f80180c7850 0x7f8018071250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:02.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.398+0000 7f8015ffb640 1 -- 172.21.15.50:0/1520968132 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80180c6180 con 0x7f80181502a0 2024-04-01T01:56:02.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.398+0000 7f8015ffb640 1 -- 172.21.15.50:0/1520968132 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2779672543 0 0) 0x7f8008001680 con 0x7f80181502a0 2024-04-01T01:56:02.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.398+0000 7f8015ffb640 1 -- 172.21.15.50:0/1520968132 >> v1:172.21.15.50:6789/0 conn(0x7f80181502a0 legacy=0x7f801806ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:02.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.398+0000 7f8015ffb640 1 --2- 172.21.15.50:0/1520968132 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f80000039c0 0x7f8000003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:02.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.398+0000 7f8015ffb640 1 --2- 172.21.15.50:0/1520968132 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8000004810 0x7f8000004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:02.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.398+0000 7f8015ffb640 1 --2- 172.21.15.50:0/1520968132 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f80180c3e70 0x7f80000051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:02.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.398+0000 7f8015ffb640 1 -- 172.21.15.50:0/1520968132 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f80180c5ea0 con 0x7f80000039c0 2024-04-01T01:56:02.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.398+0000 7f8015ffb640 1 -- 172.21.15.50:0/1520968132 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f800000b9d0 con 0x7f8000004810 2024-04-01T01:56:02.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.398+0000 7f8015ffb640 1 -- 172.21.15.50:0/1520968132 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f800000bb50 con 0x7f80180c3e70 2024-04-01T01:56:02.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.398+0000 7f8016ffd640 1 --2- 172.21.15.50:0/1520968132 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f80000039c0 0x7f8000003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:02.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.398+0000 7f80177fe640 1 --2- 172.21.15.50:0/1520968132 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f80180c3e70 0x7f80000051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:02.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.398+0000 7f80167fc640 1 --2- 172.21.15.50:0/1520968132 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8000004810 0x7f8000004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:02.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.398+0000 7f8016ffd640 1 -- 172.21.15.50:0/1520968132 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f80180c3e70 msgr2=0x7f80000051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:56:02.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.398+0000 7f8016ffd640 1 --2- 172.21.15.50:0/1520968132 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f80180c3e70 0x7f80000051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:02.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.398+0000 7f8016ffd640 1 -- 172.21.15.50:0/1520968132 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8000004810 msgr2=0x7f8000004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:56:02.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.398+0000 7f8016ffd640 1 --2- 172.21.15.50:0/1520968132 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8000004810 0x7f8000004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:02.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.398+0000 7f8016ffd640 1 -- 172.21.15.50:0/1520968132 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8000003530 con 0x7f80000039c0 2024-04-01T01:56:02.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.398+0000 7f80167fc640 1 --2- 172.21.15.50:0/1520968132 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8000004810 0x7f8000004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T01:56:02.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.402+0000 7f8016ffd640 1 --2- 172.21.15.50:0/1520968132 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f80000039c0 0x7f8000003de0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f800800c240 tx=0x7f800801f410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d10c8fd7db537d6 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:56:02.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.402+0000 7f8015ffb640 1 -- 172.21.15.50:0/1520968132 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8008007d40 con 0x7f80000039c0 2024-04-01T01:56:02.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.402+0000 7f8015ffb640 1 -- 172.21.15.50:0/1520968132 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8008005b00 con 0x7f80000039c0 2024-04-01T01:56:02.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.402+0000 7f8015ffb640 1 -- 172.21.15.50:0/1520968132 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8008007070 con 0x7f80000039c0 2024-04-01T01:56:02.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.402+0000 7f801d400640 1 -- 172.21.15.50:0/1520968132 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f80000039c0 msgr2=0x7f8000003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:02.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.402+0000 7f801d400640 1 --2- 172.21.15.50:0/1520968132 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f80000039c0 0x7f8000003de0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f800800c240 tx=0x7f800801f410 comp rx=0 tx=0).stop 2024-04-01T01:56:02.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.402+0000 7f80177fe640 1 -- 172.21.15.50:0/1520968132 reap_dead start 2024-04-01T01:56:02.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.402+0000 7f801d400640 1 -- 172.21.15.50:0/1520968132 shutdown_connections 2024-04-01T01:56:02.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.402+0000 7f801d400640 1 -- 172.21.15.50:0/1520968132 >> 172.21.15.50:0/1520968132 conn(0x7f8018067560 msgr2=0x7f801806b220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:56:02.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.402+0000 7f801d400640 1 -- 172.21.15.50:0/1520968132 shutdown_connections 2024-04-01T01:56:02.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.402+0000 7f801d400640 1 -- 172.21.15.50:0/1520968132 wait complete. 2024-04-01T01:56:02.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.402+0000 7f801d400640 1 Processor -- start 2024-04-01T01:56:02.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.402+0000 7f801d400640 1 -- start start 2024-04-01T01:56:02.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.402+0000 7f801d400640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f80000039c0 0x7f8018141740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:02.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.402+0000 7f801d400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f80181426f0 0x7f8018138db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:02.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.402+0000 7f801d400640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f80180c4b30 0x7f80181379e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:02.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.402+0000 7f801d400640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8018156fa0 con 0x7f80181426f0 2024-04-01T01:56:02.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.402+0000 7f801d400640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f80180c6740 con 0x7f80000039c0 2024-04-01T01:56:02.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.402+0000 7f801d400640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f80180c8c70 con 0x7f80180c4b30 2024-04-01T01:56:02.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.402+0000 7f80167fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f80181426f0 0x7f8018138db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:02.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.402+0000 7f80167fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f80181426f0 0x7f8018138db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50828/0 (socket says 172.21.15.50:50828) 2024-04-01T01:56:02.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.402+0000 7f80167fc640 1 -- 172.21.15.50:0/1969300882 learned_addr learned my addr 172.21.15.50:0/1969300882 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T01:56:02.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.402+0000 7f8016ffd640 1 --2- 172.21.15.50:0/1969300882 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f80000039c0 0x7f8018141740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:02.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.406+0000 7f80177fe640 1 --2- 172.21.15.50:0/1969300882 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f80180c4b30 0x7f80181379e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:02.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.406+0000 7f80167fc640 1 -- 172.21.15.50:0/1969300882 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f80180c4b30 msgr2=0x7f80181379e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:02.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.406+0000 7f80167fc640 1 --2- 172.21.15.50:0/1969300882 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f80180c4b30 0x7f80181379e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:02.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.406+0000 7f80167fc640 1 -- 172.21.15.50:0/1969300882 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f80000039c0 msgr2=0x7f8018141740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:02.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.406+0000 7f80167fc640 1 --2- 172.21.15.50:0/1969300882 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f80000039c0 0x7f8018141740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:02.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.406+0000 7f80167fc640 1 -- 172.21.15.50:0/1969300882 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f801814e880 con 0x7f80181426f0 2024-04-01T01:56:02.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.406+0000 7f80177fe640 1 --2- 172.21.15.50:0/1969300882 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f80180c4b30 0x7f80181379e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T01:56:02.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.406+0000 7f80167fc640 1 --2- 172.21.15.50:0/1969300882 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f80181426f0 0x7f8018138db0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f800c0108c0 tx=0x7f800c010d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:56:02.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.406+0000 7f7fff7fe640 1 -- 172.21.15.50:0/1969300882 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f800c00f040 con 0x7f80181426f0 2024-04-01T01:56:02.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.406+0000 7f7fff7fe640 1 -- 172.21.15.50:0/1969300882 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f800c00eb60 con 0x7f80181426f0 2024-04-01T01:56:02.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.406+0000 7f7fff7fe640 1 -- 172.21.15.50:0/1969300882 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f800c01c400 con 0x7f80181426f0 2024-04-01T01:56:02.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.406+0000 7f801d400640 1 -- 172.21.15.50:0/1969300882 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f801814eb60 con 0x7f80181426f0 2024-04-01T01:56:02.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.406+0000 7f801d400640 1 -- 172.21.15.50:0/1969300882 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f801814f120 con 0x7f80181426f0 2024-04-01T01:56:02.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.406+0000 7f801d400640 1 -- 172.21.15.50:0/1969300882 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8018068230 con 0x7f80181426f0 2024-04-01T01:56:02.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.406+0000 7f7fff7fe640 1 -- 172.21.15.50:0/1969300882 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 87103+0+0 (secure 0 0 0) 0x7f800c01c5a0 con 0x7f80181426f0 2024-04-01T01:56:02.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.406+0000 7f7fff7fe640 1 --2- 172.21.15.50:0/1969300882 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f8004067420 0x7f80040698e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:02.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.406+0000 7f7fff7fe640 1 -- 172.21.15.50:0/1969300882 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f800c085d80 con 0x7f80181426f0 2024-04-01T01:56:02.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.406+0000 7f8016ffd640 1 --2- 172.21.15.50:0/1969300882 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f8004067420 0x7f80040698e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:02.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.406+0000 7f8016ffd640 1 --2- 172.21.15.50:0/1969300882 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f8004067420 0x7f80040698e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f80080ae000 tx=0x7f80180c3d90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:56:02.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.410+0000 7f7fff7fe640 1 -- 172.21.15.50:0/1969300882 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+176632 (secure 0 0 0) 0x7f800c018030 con 0x7f80181426f0 2024-04-01T01:56:02.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.562+0000 7f801d400640 1 -- 172.21.15.50:0/1969300882 --> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f80180c7630 con 0x7f8004067420 2024-04-01T01:56:02.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.582+0000 7f7fff7fe640 1 -- 172.21.15.50:0/1969300882 <== mgr.4103 v2:172.21.15.97:6832/1677467570 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251910 (secure 0 0 0) 0x7f80080fe820 con 0x7f8004067420 2024-04-01T01:56:02.585 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-01T01:56:02.586 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-04-01T01:56:02.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.582+0000 7f801d400640 1 -- 172.21.15.50:0/1969300882 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f8004067420 msgr2=0x7f80040698e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:02.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.582+0000 7f801d400640 1 --2- 172.21.15.50:0/1969300882 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f8004067420 0x7f80040698e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f80080ae000 tx=0x7f80180c3d90 comp rx=0 tx=0).stop 2024-04-01T01:56:02.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.582+0000 7f801d400640 1 -- 172.21.15.50:0/1969300882 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f80181426f0 msgr2=0x7f8018138db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:02.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.582+0000 7f801d400640 1 --2- 172.21.15.50:0/1969300882 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f80181426f0 0x7f8018138db0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f800c0108c0 tx=0x7f800c010d80 comp rx=0 tx=0).stop 2024-04-01T01:56:02.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.582+0000 7f801d400640 1 -- 172.21.15.50:0/1969300882 shutdown_connections 2024-04-01T01:56:02.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.582+0000 7f801d400640 1 --2- 172.21.15.50:0/1969300882 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f8004067420 0x7f80040698e0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:02.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.582+0000 7f801d400640 1 --2- 172.21.15.50:0/1969300882 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f80180c4b30 0x7f80181379e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:02.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.582+0000 7f801d400640 1 --2- 172.21.15.50:0/1969300882 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f80181426f0 0x7f8018138db0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:02.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.582+0000 7f801d400640 1 --2- 172.21.15.50:0/1969300882 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f80000039c0 0x7f8018141740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:02.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.582+0000 7f801d400640 1 -- 172.21.15.50:0/1969300882 >> 172.21.15.50:0/1969300882 conn(0x7f8018067560 msgr2=0x7f8018072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:56:02.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.582+0000 7f801d400640 1 -- 172.21.15.50:0/1969300882 shutdown_connections 2024-04-01T01:56:02.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.582+0000 7f801d400640 1 -- 172.21.15.50:0/1969300882 wait complete. 2024-04-01T01:56:02.602 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-04-01T01:56:02.066999+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":234636,"kb_used_data":1824,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754740084,"statfs":{"total":773094113280,"available":772853846016,"internally_reserved":0,"allocated":1867776,"data_stored":1762940,"data_compressed":66838,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.846855"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.485783+0000","last_change":"2024-04-01T01:55:49.279342+0000","last_active":"2024-04-01T01:55:50.485783+0000","last_peered":"2024-04-01T01:55:50.485783+0000","last_clean":"2024-04-01T01:55:50.485783+0000","last_became_active":"2024-04-01T01:55:49.279011+0000","last_became_peered":"2024-04-01T01:55:49.279011+0000","last_unstale":"2024-04-01T01:55:50.485783+0000","last_undegraded":"2024-04-01T01:55:50.485783+0000","last_fullsized":"2024-04-01T01:55:50.485783+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:56:11.350186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.227142+0000","last_change":"2024-04-01T01:55:49.247181+0000","last_active":"2024-04-01T01:55:50.227142+0000","last_peered":"2024-04-01T01:55:50.227142+0000","last_clean":"2024-04-01T01:55:50.227142+0000","last_became_active":"2024-04-01T01:55:49.246660+0000","last_became_peered":"2024-04-01T01:55:49.246660+0000","last_unstale":"2024-04-01T01:55:50.227142+0000","last_undegraded":"2024-04-01T01:55:50.227142+0000","last_fullsized":"2024-04-01T01:55:50.227142+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:27:12.089520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.226983+0000","last_change":"2024-04-01T01:55:49.240347+0000","last_active":"2024-04-01T01:55:50.226983+0000","last_peered":"2024-04-01T01:55:50.226983+0000","last_clean":"2024-04-01T01:55:50.226983+0000","last_became_active":"2024-04-01T01:55:49.239904+0000","last_became_peered":"2024-04-01T01:55:49.239904+0000","last_unstale":"2024-04-01T01:55:50.226983+0000","last_undegraded":"2024-04-01T01:55:50.226983+0000","last_fullsized":"2024-04-01T01:55:50.226983+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:37:43.280869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.667159+0000","last_change":"2024-04-01T01:55:49.279352+0000","last_active":"2024-04-01T01:55:50.667159+0000","last_peered":"2024-04-01T01:55:50.667159+0000","last_clean":"2024-04-01T01:55:50.667159+0000","last_became_active":"2024-04-01T01:55:49.279041+0000","last_became_peered":"2024-04-01T01:55:49.279041+0000","last_unstale":"2024-04-01T01:55:50.667159+0000","last_undegraded":"2024-04-01T01:55:50.667159+0000","last_fullsized":"2024-04-01T01:55:50.667159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:13:13.114168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.485298+0000","last_change":"2024-04-01T01:55:49.246874+0000","last_active":"2024-04-01T01:55:50.485298+0000","last_peered":"2024-04-01T01:55:50.485298+0000","last_clean":"2024-04-01T01:55:50.485298+0000","last_became_active":"2024-04-01T01:55:49.246152+0000","last_became_peered":"2024-04-01T01:55:49.246152+0000","last_unstale":"2024-04-01T01:55:50.485298+0000","last_undegraded":"2024-04-01T01:55:50.485298+0000","last_fullsized":"2024-04-01T01:55:50.485298+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:49:04.049108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.665855+0000","last_change":"2024-04-01T01:55:49.254029+0000","last_active":"2024-04-01T01:55:50.665855+0000","last_peered":"2024-04-01T01:55:50.665855+0000","last_clean":"2024-04-01T01:55:50.665855+0000","last_became_active":"2024-04-01T01:55:49.253348+0000","last_became_peered":"2024-04-01T01:55:49.253348+0000","last_unstale":"2024-04-01T01:55:50.665855+0000","last_undegraded":"2024-04-01T01:55:50.665855+0000","last_fullsized":"2024-04-01T01:55:50.665855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:33:56.754206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.484926+0000","last_change":"2024-04-01T01:55:49.247604+0000","last_active":"2024-04-01T01:55:50.484926+0000","last_peered":"2024-04-01T01:55:50.484926+0000","last_clean":"2024-04-01T01:55:50.484926+0000","last_became_active":"2024-04-01T01:55:49.247373+0000","last_became_peered":"2024-04-01T01:55:49.247373+0000","last_unstale":"2024-04-01T01:55:50.484926+0000","last_undegraded":"2024-04-01T01:55:50.484926+0000","last_fullsized":"2024-04-01T01:55:50.484926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:13:16.513095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.226492+0000","last_change":"2024-04-01T01:55:49.262994+0000","last_active":"2024-04-01T01:55:50.226492+0000","last_peered":"2024-04-01T01:55:50.226492+0000","last_clean":"2024-04-01T01:55:50.226492+0000","last_became_active":"2024-04-01T01:55:49.262736+0000","last_became_peered":"2024-04-01T01:55:49.262736+0000","last_unstale":"2024-04-01T01:55:50.226492+0000","last_undegraded":"2024-04-01T01:55:50.226492+0000","last_fullsized":"2024-04-01T01:55:50.226492+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:35:14.625545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.224583+0000","last_change":"2024-04-01T01:55:49.260244+0000","last_active":"2024-04-01T01:55:50.224583+0000","last_peered":"2024-04-01T01:55:50.224583+0000","last_clean":"2024-04-01T01:55:50.224583+0000","last_became_active":"2024-04-01T01:55:49.259745+0000","last_became_peered":"2024-04-01T01:55:49.259745+0000","last_unstale":"2024-04-01T01:55:50.224583+0000","last_undegraded":"2024-04-01T01:55:50.224583+0000","last_fullsized":"2024-04-01T01:55:50.224583+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:00:34.607980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.486080+0000","last_change":"2024-04-01T01:55:49.255260+0000","last_active":"2024-04-01T01:55:50.486080+0000","last_peered":"2024-04-01T01:55:50.486080+0000","last_clean":"2024-04-01T01:55:50.486080+0000","last_became_active":"2024-04-01T01:55:49.254408+0000","last_became_peered":"2024-04-01T01:55:49.254408+0000","last_unstale":"2024-04-01T01:55:50.486080+0000","last_undegraded":"2024-04-01T01:55:50.486080+0000","last_fullsized":"2024-04-01T01:55:50.486080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:02:41.829474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.485581+0000","last_change":"2024-04-01T01:55:49.271392+0000","last_active":"2024-04-01T01:55:50.485581+0000","last_peered":"2024-04-01T01:55:50.485581+0000","last_clean":"2024-04-01T01:55:50.485581+0000","last_became_active":"2024-04-01T01:55:49.270877+0000","last_became_peered":"2024-04-01T01:55:49.270877+0000","last_unstale":"2024-04-01T01:55:50.485581+0000","last_undegraded":"2024-04-01T01:55:50.485581+0000","last_fullsized":"2024-04-01T01:55:50.485581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:44:29.950624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.485029+0000","last_change":"2024-04-01T01:55:49.259816+0000","last_active":"2024-04-01T01:55:50.485029+0000","last_peered":"2024-04-01T01:55:50.485029+0000","last_clean":"2024-04-01T01:55:50.485029+0000","last_became_active":"2024-04-01T01:55:49.259193+0000","last_became_peered":"2024-04-01T01:55:49.259193+0000","last_unstale":"2024-04-01T01:55:50.485029+0000","last_undegraded":"2024-04-01T01:55:50.485029+0000","last_fullsized":"2024-04-01T01:55:50.485029+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:48:10.828398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.635725+0000","last_change":"2024-04-01T01:55:49.247878+0000","last_active":"2024-04-01T01:55:50.635725+0000","last_peered":"2024-04-01T01:55:50.635725+0000","last_clean":"2024-04-01T01:55:50.635725+0000","last_became_active":"2024-04-01T01:55:49.247436+0000","last_became_peered":"2024-04-01T01:55:49.247436+0000","last_unstale":"2024-04-01T01:55:50.635725+0000","last_undegraded":"2024-04-01T01:55:50.635725+0000","last_fullsized":"2024-04-01T01:55:50.635725+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:26:09.632757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.635921+0000","last_change":"2024-04-01T01:55:49.246266+0000","last_active":"2024-04-01T01:55:50.635921+0000","last_peered":"2024-04-01T01:55:50.635921+0000","last_clean":"2024-04-01T01:55:50.635921+0000","last_became_active":"2024-04-01T01:55:49.245650+0000","last_became_peered":"2024-04-01T01:55:49.245650+0000","last_unstale":"2024-04-01T01:55:50.635921+0000","last_undegraded":"2024-04-01T01:55:50.635921+0000","last_fullsized":"2024-04-01T01:55:50.635921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:14:32.577522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.225923+0000","last_change":"2024-04-01T01:55:49.248046+0000","last_active":"2024-04-01T01:55:50.225923+0000","last_peered":"2024-04-01T01:55:50.225923+0000","last_clean":"2024-04-01T01:55:50.225923+0000","last_became_active":"2024-04-01T01:55:49.247662+0000","last_became_peered":"2024-04-01T01:55:49.247662+0000","last_unstale":"2024-04-01T01:55:50.225923+0000","last_undegraded":"2024-04-01T01:55:50.225923+0000","last_fullsized":"2024-04-01T01:55:50.225923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:59:26.879090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.665743+0000","last_change":"2024-04-01T01:55:49.269484+0000","last_active":"2024-04-01T01:55:50.665743+0000","last_peered":"2024-04-01T01:55:50.665743+0000","last_clean":"2024-04-01T01:55:50.665743+0000","last_became_active":"2024-04-01T01:55:49.261839+0000","last_became_peered":"2024-04-01T01:55:49.261839+0000","last_unstale":"2024-04-01T01:55:50.665743+0000","last_undegraded":"2024-04-01T01:55:50.665743+0000","last_fullsized":"2024-04-01T01:55:50.665743+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:44:29.950624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.668406+0000","last_change":"2024-04-01T01:55:49.276113+0000","last_active":"2024-04-01T01:55:50.668406+0000","last_peered":"2024-04-01T01:55:50.668406+0000","last_clean":"2024-04-01T01:55:50.668406+0000","last_became_active":"2024-04-01T01:55:49.275727+0000","last_became_peered":"2024-04-01T01:55:49.275727+0000","last_unstale":"2024-04-01T01:55:50.668406+0000","last_undegraded":"2024-04-01T01:55:50.668406+0000","last_fullsized":"2024-04-01T01:55:50.668406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:50:59.209071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.665402+0000","last_change":"2024-04-01T01:55:49.252859+0000","last_active":"2024-04-01T01:55:50.665402+0000","last_peered":"2024-04-01T01:55:50.665402+0000","last_clean":"2024-04-01T01:55:50.665402+0000","last_became_active":"2024-04-01T01:55:49.252553+0000","last_became_peered":"2024-04-01T01:55:49.252553+0000","last_unstale":"2024-04-01T01:55:50.665402+0000","last_undegraded":"2024-04-01T01:55:50.665402+0000","last_fullsized":"2024-04-01T01:55:50.665402+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:13:13.114168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.667833+0000","last_change":"2024-04-01T01:55:49.260274+0000","last_active":"2024-04-01T01:55:50.667833+0000","last_peered":"2024-04-01T01:55:50.667833+0000","last_clean":"2024-04-01T01:55:50.667833+0000","last_became_active":"2024-04-01T01:55:49.259935+0000","last_became_peered":"2024-04-01T01:55:49.259935+0000","last_unstale":"2024-04-01T01:55:50.667833+0000","last_undegraded":"2024-04-01T01:55:50.667833+0000","last_fullsized":"2024-04-01T01:55:50.667833+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:24:55.348340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.485181+0000","last_change":"2024-04-01T01:55:49.259523+0000","last_active":"2024-04-01T01:55:50.485181+0000","last_peered":"2024-04-01T01:55:50.485181+0000","last_clean":"2024-04-01T01:55:50.485181+0000","last_became_active":"2024-04-01T01:55:49.258670+0000","last_became_peered":"2024-04-01T01:55:49.258670+0000","last_unstale":"2024-04-01T01:55:50.485181+0000","last_undegraded":"2024-04-01T01:55:50.485181+0000","last_fullsized":"2024-04-01T01:55:50.485181+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:08:54.832554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.226632+0000","last_change":"2024-04-01T01:55:49.243824+0000","last_active":"2024-04-01T01:55:50.226632+0000","last_peered":"2024-04-01T01:55:50.226632+0000","last_clean":"2024-04-01T01:55:50.226632+0000","last_became_active":"2024-04-01T01:55:49.243518+0000","last_became_peered":"2024-04-01T01:55:49.243518+0000","last_unstale":"2024-04-01T01:55:50.226632+0000","last_undegraded":"2024-04-01T01:55:50.226632+0000","last_fullsized":"2024-04-01T01:55:50.226632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:24:42.777720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.223859+0000","last_change":"2024-04-01T01:55:49.258207+0000","last_active":"2024-04-01T01:55:50.223859+0000","last_peered":"2024-04-01T01:55:50.223859+0000","last_clean":"2024-04-01T01:55:50.223859+0000","last_became_active":"2024-04-01T01:55:49.257576+0000","last_became_peered":"2024-04-01T01:55:49.257576+0000","last_unstale":"2024-04-01T01:55:50.223859+0000","last_undegraded":"2024-04-01T01:55:50.223859+0000","last_fullsized":"2024-04-01T01:55:50.223859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:13:13.114168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.226214+0000","last_change":"2024-04-01T01:55:49.250832+0000","last_active":"2024-04-01T01:55:50.226214+0000","last_peered":"2024-04-01T01:55:50.226214+0000","last_clean":"2024-04-01T01:55:50.226214+0000","last_became_active":"2024-04-01T01:55:49.250522+0000","last_became_peered":"2024-04-01T01:55:49.250522+0000","last_unstale":"2024-04-01T01:55:50.226214+0000","last_undegraded":"2024-04-01T01:55:50.226214+0000","last_fullsized":"2024-04-01T01:55:50.226214+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:47:04.592262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.665958+0000","last_change":"2024-04-01T01:55:49.270067+0000","last_active":"2024-04-01T01:55:50.665958+0000","last_peered":"2024-04-01T01:55:50.665958+0000","last_clean":"2024-04-01T01:55:50.665958+0000","last_became_active":"2024-04-01T01:55:49.269694+0000","last_became_peered":"2024-04-01T01:55:49.269694+0000","last_unstale":"2024-04-01T01:55:50.665958+0000","last_undegraded":"2024-04-01T01:55:50.665958+0000","last_fullsized":"2024-04-01T01:55:50.665958+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:21:46.367144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.227645+0000","last_change":"2024-04-01T01:55:49.243460+0000","last_active":"2024-04-01T01:55:50.227645+0000","last_peered":"2024-04-01T01:55:50.227645+0000","last_clean":"2024-04-01T01:55:50.227645+0000","last_became_active":"2024-04-01T01:55:49.243017+0000","last_became_peered":"2024-04-01T01:55:49.243017+0000","last_unstale":"2024-04-01T01:55:50.227645+0000","last_undegraded":"2024-04-01T01:55:50.227645+0000","last_fullsized":"2024-04-01T01:55:50.227645+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:20:18.156798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.667300+0000","last_change":"2024-04-01T01:55:49.280226+0000","last_active":"2024-04-01T01:55:50.667300+0000","last_peered":"2024-04-01T01:55:50.667300+0000","last_clean":"2024-04-01T01:55:50.667300+0000","last_became_active":"2024-04-01T01:55:49.279882+0000","last_became_peered":"2024-04-01T01:55:49.279882+0000","last_unstale":"2024-04-01T01:55:50.667300+0000","last_undegraded":"2024-04-01T01:55:50.667300+0000","last_fullsized":"2024-04-01T01:55:50.667300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:06:48.999905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.636174+0000","last_change":"2024-04-01T01:55:49.249890+0000","last_active":"2024-04-01T01:55:50.636174+0000","last_peered":"2024-04-01T01:55:50.636174+0000","last_clean":"2024-04-01T01:55:50.636174+0000","last_became_active":"2024-04-01T01:55:49.249588+0000","last_became_peered":"2024-04-01T01:55:49.249588+0000","last_unstale":"2024-04-01T01:55:50.636174+0000","last_undegraded":"2024-04-01T01:55:50.636174+0000","last_fullsized":"2024-04-01T01:55:50.636174+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:02:25.180455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.635657+0000","last_change":"2024-04-01T01:55:49.254529+0000","last_active":"2024-04-01T01:55:50.635657+0000","last_peered":"2024-04-01T01:55:50.635657+0000","last_clean":"2024-04-01T01:55:50.635657+0000","last_became_active":"2024-04-01T01:55:49.253726+0000","last_became_peered":"2024-04-01T01:55:49.253726+0000","last_unstale":"2024-04-01T01:55:50.635657+0000","last_undegraded":"2024-04-01T01:55:50.635657+0000","last_fullsized":"2024-04-01T01:55:50.635657+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:55:44.175129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.227405+0000","last_change":"2024-04-01T01:55:49.252043+0000","last_active":"2024-04-01T01:55:50.227405+0000","last_peered":"2024-04-01T01:55:50.227405+0000","last_clean":"2024-04-01T01:55:50.227405+0000","last_became_active":"2024-04-01T01:55:49.251760+0000","last_became_peered":"2024-04-01T01:55:49.251760+0000","last_unstale":"2024-04-01T01:55:50.227405+0000","last_undegraded":"2024-04-01T01:55:50.227405+0000","last_fullsized":"2024-04-01T01:55:50.227405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:12:25.325040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.666628+0000","last_change":"2024-04-01T01:55:49.270451+0000","last_active":"2024-04-01T01:55:50.666628+0000","last_peered":"2024-04-01T01:55:50.666628+0000","last_clean":"2024-04-01T01:55:50.666628+0000","last_became_active":"2024-04-01T01:55:49.269636+0000","last_became_peered":"2024-04-01T01:55:49.269636+0000","last_unstale":"2024-04-01T01:55:50.666628+0000","last_undegraded":"2024-04-01T01:55:50.666628+0000","last_fullsized":"2024-04-01T01:55:50.666628+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:11:14.234867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.664845+0000","last_change":"2024-04-01T01:55:49.266187+0000","last_active":"2024-04-01T01:55:50.664845+0000","last_peered":"2024-04-01T01:55:50.664845+0000","last_clean":"2024-04-01T01:55:50.664845+0000","last_became_active":"2024-04-01T01:55:49.265946+0000","last_became_peered":"2024-04-01T01:55:49.265946+0000","last_unstale":"2024-04-01T01:55:50.664845+0000","last_undegraded":"2024-04-01T01:55:50.664845+0000","last_fullsized":"2024-04-01T01:55:50.664845+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:37:46.890765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.665336+0000","last_change":"2024-04-01T01:55:49.273104+0000","last_active":"2024-04-01T01:55:50.665336+0000","last_peered":"2024-04-01T01:55:50.665336+0000","last_clean":"2024-04-01T01:55:50.665336+0000","last_became_active":"2024-04-01T01:55:49.272742+0000","last_became_peered":"2024-04-01T01:55:49.272742+0000","last_unstale":"2024-04-01T01:55:50.665336+0000","last_undegraded":"2024-04-01T01:55:50.665336+0000","last_fullsized":"2024-04-01T01:55:50.665336+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:37:46.890765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.224162+0000","last_change":"2024-04-01T01:55:49.241595+0000","last_active":"2024-04-01T01:55:50.224162+0000","last_peered":"2024-04-01T01:55:50.224162+0000","last_clean":"2024-04-01T01:55:50.224162+0000","last_became_active":"2024-04-01T01:55:49.238286+0000","last_became_peered":"2024-04-01T01:55:49.238286+0000","last_unstale":"2024-04-01T01:55:50.224162+0000","last_undegraded":"2024-04-01T01:55:50.224162+0000","last_fullsized":"2024-04-01T01:55:50.224162+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:06:48.999905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.226757+0000","last_change":"2024-04-01T01:55:48.225145+0000","last_active":"2024-04-01T01:55:50.226757+0000","last_peered":"2024-04-01T01:55:50.226757+0000","last_clean":"2024-04-01T01:55:50.226757+0000","last_became_active":"2024-04-01T01:55:48.224408+0000","last_became_peered":"2024-04-01T01:55:48.224408+0000","last_unstale":"2024-04-01T01:55:50.226757+0000","last_undegraded":"2024-04-01T01:55:50.226757+0000","last_fullsized":"2024-04-01T01:55:50.226757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:41:59.465915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.227045+0000","last_change":"2024-04-01T01:55:49.247771+0000","last_active":"2024-04-01T01:55:50.227045+0000","last_peered":"2024-04-01T01:55:50.227045+0000","last_clean":"2024-04-01T01:55:50.227045+0000","last_became_active":"2024-04-01T01:55:49.247496+0000","last_became_peered":"2024-04-01T01:55:49.247496+0000","last_unstale":"2024-04-01T01:55:50.227045+0000","last_undegraded":"2024-04-01T01:55:50.227045+0000","last_fullsized":"2024-04-01T01:55:50.227045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:02:25.180455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.666773+0000","last_change":"2024-04-01T01:55:48.221934+0000","last_active":"2024-04-01T01:55:50.666773+0000","last_peered":"2024-04-01T01:55:50.666773+0000","last_clean":"2024-04-01T01:55:50.666773+0000","last_became_active":"2024-04-01T01:55:48.221614+0000","last_became_peered":"2024-04-01T01:55:48.221614+0000","last_unstale":"2024-04-01T01:55:50.666773+0000","last_undegraded":"2024-04-01T01:55:50.666773+0000","last_fullsized":"2024-04-01T01:55:50.666773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:06:47.990123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.635306+0000","last_change":"2024-04-01T01:55:48.217879+0000","last_active":"2024-04-01T01:55:50.635306+0000","last_peered":"2024-04-01T01:55:50.635306+0000","last_clean":"2024-04-01T01:55:50.635306+0000","last_became_active":"2024-04-01T01:55:48.216141+0000","last_became_peered":"2024-04-01T01:55:48.216141+0000","last_unstale":"2024-04-01T01:55:50.635306+0000","last_undegraded":"2024-04-01T01:55:50.635306+0000","last_fullsized":"2024-04-01T01:55:50.635306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:36:42.625449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.227275+0000","last_change":"2024-04-01T01:55:49.246424+0000","last_active":"2024-04-01T01:55:50.227275+0000","last_peered":"2024-04-01T01:55:50.227275+0000","last_clean":"2024-04-01T01:55:50.227275+0000","last_became_active":"2024-04-01T01:55:49.243823+0000","last_became_peered":"2024-04-01T01:55:49.243823+0000","last_unstale":"2024-04-01T01:55:50.227275+0000","last_undegraded":"2024-04-01T01:55:50.227275+0000","last_fullsized":"2024-04-01T01:55:50.227275+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:27:45.663474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.665864+0000","last_change":"2024-04-01T01:55:48.222831+0000","last_active":"2024-04-01T01:55:50.665864+0000","last_peered":"2024-04-01T01:55:50.665864+0000","last_clean":"2024-04-01T01:55:50.665864+0000","last_became_active":"2024-04-01T01:55:48.222535+0000","last_became_peered":"2024-04-01T01:55:48.222535+0000","last_unstale":"2024-04-01T01:55:50.665864+0000","last_undegraded":"2024-04-01T01:55:50.665864+0000","last_fullsized":"2024-04-01T01:55:50.665864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:49:34.960786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.227957+0000","last_change":"2024-04-01T01:55:49.231967+0000","last_active":"2024-04-01T01:55:50.227957+0000","last_peered":"2024-04-01T01:55:50.227957+0000","last_clean":"2024-04-01T01:55:50.227957+0000","last_became_active":"2024-04-01T01:55:49.230659+0000","last_became_peered":"2024-04-01T01:55:49.230659+0000","last_unstale":"2024-04-01T01:55:50.227957+0000","last_undegraded":"2024-04-01T01:55:50.227957+0000","last_fullsized":"2024-04-01T01:55:50.227957+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:57:31.843504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.224697+0000","last_change":"2024-04-01T01:55:48.216724+0000","last_active":"2024-04-01T01:55:50.224697+0000","last_peered":"2024-04-01T01:55:50.224697+0000","last_clean":"2024-04-01T01:55:50.224697+0000","last_became_active":"2024-04-01T01:55:48.216318+0000","last_became_peered":"2024-04-01T01:55:48.216318+0000","last_unstale":"2024-04-01T01:55:50.224697+0000","last_undegraded":"2024-04-01T01:55:50.224697+0000","last_fullsized":"2024-04-01T01:55:50.224697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:25:51.219789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.667408+0000","last_change":"2024-04-01T01:55:49.280230+0000","last_active":"2024-04-01T01:55:50.667408+0000","last_peered":"2024-04-01T01:55:50.667408+0000","last_clean":"2024-04-01T01:55:50.667408+0000","last_became_active":"2024-04-01T01:55:49.279866+0000","last_became_peered":"2024-04-01T01:55:49.279866+0000","last_unstale":"2024-04-01T01:55:50.667408+0000","last_undegraded":"2024-04-01T01:55:50.667408+0000","last_fullsized":"2024-04-01T01:55:50.667408+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:00:34.607980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.485507+0000","last_change":"2024-04-01T01:55:48.213879+0000","last_active":"2024-04-01T01:55:50.485507+0000","last_peered":"2024-04-01T01:55:50.485507+0000","last_clean":"2024-04-01T01:55:50.485507+0000","last_became_active":"2024-04-01T01:55:48.213610+0000","last_became_peered":"2024-04-01T01:55:48.213610+0000","last_unstale":"2024-04-01T01:55:50.485507+0000","last_undegraded":"2024-04-01T01:55:50.485507+0000","last_fullsized":"2024-04-01T01:55:50.485507+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:33:55.744424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.228364+0000","last_change":"2024-04-01T01:55:49.261532+0000","last_active":"2024-04-01T01:55:50.228364+0000","last_peered":"2024-04-01T01:55:50.228364+0000","last_clean":"2024-04-01T01:55:50.228364+0000","last_became_active":"2024-04-01T01:55:49.261260+0000","last_became_peered":"2024-04-01T01:55:49.261260+0000","last_unstale":"2024-04-01T01:55:50.228364+0000","last_undegraded":"2024-04-01T01:55:50.228364+0000","last_fullsized":"2024-04-01T01:55:50.228364+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:30:02.149564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.665057+0000","last_change":"2024-04-01T01:55:48.227054+0000","last_active":"2024-04-01T01:55:50.665057+0000","last_peered":"2024-04-01T01:55:50.665057+0000","last_clean":"2024-04-01T01:55:50.665057+0000","last_became_active":"2024-04-01T01:55:48.226061+0000","last_became_peered":"2024-04-01T01:55:48.226061+0000","last_unstale":"2024-04-01T01:55:50.665057+0000","last_undegraded":"2024-04-01T01:55:50.665057+0000","last_fullsized":"2024-04-01T01:55:50.665057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:18:27.840431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.666111+0000","last_change":"2024-04-01T01:55:49.261662+0000","last_active":"2024-04-01T01:55:50.666111+0000","last_peered":"2024-04-01T01:55:50.666111+0000","last_clean":"2024-04-01T01:55:50.666111+0000","last_became_active":"2024-04-01T01:55:49.261286+0000","last_became_peered":"2024-04-01T01:55:49.261286+0000","last_unstale":"2024-04-01T01:55:50.666111+0000","last_undegraded":"2024-04-01T01:55:50.666111+0000","last_fullsized":"2024-04-01T01:55:50.666111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:56:11.350186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.667035+0000","last_change":"2024-04-01T01:55:48.219739+0000","last_active":"2024-04-01T01:55:50.667035+0000","last_peered":"2024-04-01T01:55:50.667035+0000","last_clean":"2024-04-01T01:55:50.667035+0000","last_became_active":"2024-04-01T01:55:48.219107+0000","last_became_peered":"2024-04-01T01:55:48.219107+0000","last_unstale":"2024-04-01T01:55:50.667035+0000","last_undegraded":"2024-04-01T01:55:50.667035+0000","last_fullsized":"2024-04-01T01:55:50.667035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:14:12.790111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.485917+0000","last_change":"2024-04-01T01:55:49.255056+0000","last_active":"2024-04-01T01:55:50.485917+0000","last_peered":"2024-04-01T01:55:50.485917+0000","last_clean":"2024-04-01T01:55:50.485917+0000","last_became_active":"2024-04-01T01:55:49.247910+0000","last_became_peered":"2024-04-01T01:55:49.247910+0000","last_unstale":"2024-04-01T01:55:50.485917+0000","last_undegraded":"2024-04-01T01:55:50.485917+0000","last_fullsized":"2024-04-01T01:55:50.485917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T13:02:55.577616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.665142+0000","last_change":"2024-04-01T01:55:48.215613+0000","last_active":"2024-04-01T01:55:50.665142+0000","last_peered":"2024-04-01T01:55:50.665142+0000","last_clean":"2024-04-01T01:55:50.665142+0000","last_became_active":"2024-04-01T01:55:48.214669+0000","last_became_peered":"2024-04-01T01:55:48.214669+0000","last_unstale":"2024-04-01T01:55:50.665142+0000","last_undegraded":"2024-04-01T01:55:50.665142+0000","last_fullsized":"2024-04-01T01:55:50.665142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:25:51.219789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.635349+0000","last_change":"2024-04-01T01:55:49.270153+0000","last_active":"2024-04-01T01:55:50.635349+0000","last_peered":"2024-04-01T01:55:50.635349+0000","last_clean":"2024-04-01T01:55:50.635349+0000","last_became_active":"2024-04-01T01:55:49.269840+0000","last_became_peered":"2024-04-01T01:55:49.269840+0000","last_unstale":"2024-04-01T01:55:50.635349+0000","last_undegraded":"2024-04-01T01:55:50.635349+0000","last_fullsized":"2024-04-01T01:55:50.635349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:00:34.607980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.667049+0000","last_change":"2024-04-01T01:55:48.214783+0000","last_active":"2024-04-01T01:55:50.667049+0000","last_peered":"2024-04-01T01:55:50.667049+0000","last_clean":"2024-04-01T01:55:50.667049+0000","last_became_active":"2024-04-01T01:55:48.213463+0000","last_became_peered":"2024-04-01T01:55:48.213463+0000","last_unstale":"2024-04-01T01:55:50.667049+0000","last_undegraded":"2024-04-01T01:55:50.667049+0000","last_fullsized":"2024-04-01T01:55:50.667049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:00:33.598198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.666568+0000","last_change":"2024-04-01T01:55:49.274841+0000","last_active":"2024-04-01T01:55:50.666568+0000","last_peered":"2024-04-01T01:55:50.666568+0000","last_clean":"2024-04-01T01:55:50.666568+0000","last_became_active":"2024-04-01T01:55:49.274430+0000","last_became_peered":"2024-04-01T01:55:49.274430+0000","last_unstale":"2024-04-01T01:55:50.666568+0000","last_undegraded":"2024-04-01T01:55:50.666568+0000","last_fullsized":"2024-04-01T01:55:50.666568+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T13:25:36.254927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.484812+0000","last_change":"2024-04-01T01:55:48.210944+0000","last_active":"2024-04-01T01:55:50.484812+0000","last_peered":"2024-04-01T01:55:50.484812+0000","last_clean":"2024-04-01T01:55:50.484812+0000","last_became_active":"2024-04-01T01:55:48.210616+0000","last_became_peered":"2024-04-01T01:55:48.210616+0000","last_unstale":"2024-04-01T01:55:50.484812+0000","last_undegraded":"2024-04-01T01:55:50.484812+0000","last_fullsized":"2024-04-01T01:55:50.484812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:38:32.247471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.223513+0000","last_change":"2024-04-01T01:55:49.239528+0000","last_active":"2024-04-01T01:55:50.223513+0000","last_peered":"2024-04-01T01:55:50.223513+0000","last_clean":"2024-04-01T01:55:50.223513+0000","last_became_active":"2024-04-01T01:55:49.238805+0000","last_became_peered":"2024-04-01T01:55:49.238805+0000","last_unstale":"2024-04-01T01:55:50.223513+0000","last_undegraded":"2024-04-01T01:55:50.223513+0000","last_fullsized":"2024-04-01T01:55:50.223513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:37:46.890765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.226599+0000","last_change":"2024-04-01T01:55:48.211677+0000","last_active":"2024-04-01T01:55:50.226599+0000","last_peered":"2024-04-01T01:55:50.226599+0000","last_clean":"2024-04-01T01:55:50.226599+0000","last_became_active":"2024-04-01T01:55:48.210893+0000","last_became_peered":"2024-04-01T01:55:48.210893+0000","last_unstale":"2024-04-01T01:55:50.226599+0000","last_undegraded":"2024-04-01T01:55:50.226599+0000","last_fullsized":"2024-04-01T01:55:50.226599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:04:19.568533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.666123+0000","last_change":"2024-04-01T01:55:49.261872+0000","last_active":"2024-04-01T01:55:50.666123+0000","last_peered":"2024-04-01T01:55:50.666123+0000","last_clean":"2024-04-01T01:55:50.666123+0000","last_became_active":"2024-04-01T01:55:49.261517+0000","last_became_peered":"2024-04-01T01:55:49.261517+0000","last_unstale":"2024-04-01T01:55:50.666123+0000","last_undegraded":"2024-04-01T01:55:50.666123+0000","last_fullsized":"2024-04-01T01:55:50.666123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T13:02:55.577616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.485838+0000","last_change":"2024-04-01T01:55:48.198687+0000","last_active":"2024-04-01T01:55:50.485838+0000","last_peered":"2024-04-01T01:55:50.485838+0000","last_clean":"2024-04-01T01:55:50.485838+0000","last_became_active":"2024-04-01T01:55:48.198319+0000","last_became_peered":"2024-04-01T01:55:48.198319+0000","last_unstale":"2024-04-01T01:55:50.485838+0000","last_undegraded":"2024-04-01T01:55:50.485838+0000","last_fullsized":"2024-04-01T01:55:50.485838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:37:45.880984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.667742+0000","last_change":"2024-04-01T01:55:49.272424+0000","last_active":"2024-04-01T01:55:50.667742+0000","last_peered":"2024-04-01T01:55:50.667742+0000","last_clean":"2024-04-01T01:55:50.667742+0000","last_became_active":"2024-04-01T01:55:49.265670+0000","last_became_peered":"2024-04-01T01:55:49.265670+0000","last_unstale":"2024-04-01T01:55:50.667742+0000","last_undegraded":"2024-04-01T01:55:50.667742+0000","last_fullsized":"2024-04-01T01:55:50.667742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:26:09.632757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.227729+0000","last_change":"2024-04-01T01:55:48.219312+0000","last_active":"2024-04-01T01:55:50.227729+0000","last_peered":"2024-04-01T01:55:50.227729+0000","last_clean":"2024-04-01T01:55:50.227729+0000","last_became_active":"2024-04-01T01:55:48.218562+0000","last_became_peered":"2024-04-01T01:55:48.218562+0000","last_unstale":"2024-04-01T01:55:50.227729+0000","last_undegraded":"2024-04-01T01:55:50.227729+0000","last_fullsized":"2024-04-01T01:55:50.227729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:38:32.247471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.485763+0000","last_change":"2024-04-01T01:55:49.268041+0000","last_active":"2024-04-01T01:55:50.485763+0000","last_peered":"2024-04-01T01:55:50.485763+0000","last_clean":"2024-04-01T01:55:50.485763+0000","last_became_active":"2024-04-01T01:55:49.267502+0000","last_became_peered":"2024-04-01T01:55:49.267502+0000","last_unstale":"2024-04-01T01:55:50.485763+0000","last_undegraded":"2024-04-01T01:55:50.485763+0000","last_fullsized":"2024-04-01T01:55:50.485763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:21:46.367144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.227260+0000","last_change":"2024-04-01T01:55:48.216662+0000","last_active":"2024-04-01T01:55:50.227260+0000","last_peered":"2024-04-01T01:55:50.227260+0000","last_clean":"2024-04-01T01:55:50.227260+0000","last_became_active":"2024-04-01T01:55:48.215852+0000","last_became_peered":"2024-04-01T01:55:48.215852+0000","last_unstale":"2024-04-01T01:55:50.227260+0000","last_undegraded":"2024-04-01T01:55:50.227260+0000","last_fullsized":"2024-04-01T01:55:50.227260+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:25:39.713293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.485456+0000","last_change":"2024-04-01T01:55:49.256142+0000","last_active":"2024-04-01T01:55:50.485456+0000","last_peered":"2024-04-01T01:55:50.485456+0000","last_clean":"2024-04-01T01:55:50.485456+0000","last_became_active":"2024-04-01T01:55:49.255781+0000","last_became_peered":"2024-04-01T01:55:49.255781+0000","last_unstale":"2024-04-01T01:55:50.485456+0000","last_undegraded":"2024-04-01T01:55:50.485456+0000","last_fullsized":"2024-04-01T01:55:50.485456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:10:23.571126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.635926+0000","last_change":"2024-04-01T01:55:48.219851+0000","last_active":"2024-04-01T01:55:50.635926+0000","last_peered":"2024-04-01T01:55:50.635926+0000","last_clean":"2024-04-01T01:55:50.635926+0000","last_became_active":"2024-04-01T01:55:48.215898+0000","last_became_peered":"2024-04-01T01:55:48.215898+0000","last_unstale":"2024-04-01T01:55:50.635926+0000","last_undegraded":"2024-04-01T01:55:50.635926+0000","last_fullsized":"2024-04-01T01:55:50.635926+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:18:27.840431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.667778+0000","last_change":"2024-04-01T01:55:49.275452+0000","last_active":"2024-04-01T01:55:50.667778+0000","last_peered":"2024-04-01T01:55:50.667778+0000","last_clean":"2024-04-01T01:55:50.667778+0000","last_became_active":"2024-04-01T01:55:49.274600+0000","last_became_peered":"2024-04-01T01:55:49.274600+0000","last_unstale":"2024-04-01T01:55:50.667778+0000","last_undegraded":"2024-04-01T01:55:50.667778+0000","last_fullsized":"2024-04-01T01:55:50.667778+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:19:24.052574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.223321+0000","last_change":"2024-04-01T01:55:43.145201+0000","last_active":"2024-04-01T01:55:50.223321+0000","last_peered":"2024-04-01T01:55:50.223321+0000","last_clean":"2024-04-01T01:55:50.223321+0000","last_became_active":"2024-04-01T01:55:43.144882+0000","last_became_peered":"2024-04-01T01:55:43.144882+0000","last_unstale":"2024-04-01T01:55:50.223321+0000","last_undegraded":"2024-04-01T01:55:50.223321+0000","last_fullsized":"2024-04-01T01:55:50.223321+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:42.134502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:42.134502+0000","last_clean_scrub_stamp":"2024-04-01T01:55:42.134502+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:02:26.589535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.666696+0000","last_change":"2024-04-01T01:55:48.207222+0000","last_active":"2024-04-01T01:55:50.666696+0000","last_peered":"2024-04-01T01:55:50.666696+0000","last_clean":"2024-04-01T01:55:50.666696+0000","last_became_active":"2024-04-01T01:55:48.206293+0000","last_became_peered":"2024-04-01T01:55:48.206293+0000","last_unstale":"2024-04-01T01:55:50.666696+0000","last_undegraded":"2024-04-01T01:55:50.666696+0000","last_fullsized":"2024-04-01T01:55:50.666696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:37:45.880984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.226523+0000","last_change":"2024-04-01T01:55:49.273517+0000","last_active":"2024-04-01T01:55:50.226523+0000","last_peered":"2024-04-01T01:55:50.226523+0000","last_clean":"2024-04-01T01:55:50.226523+0000","last_became_active":"2024-04-01T01:55:49.273197+0000","last_became_peered":"2024-04-01T01:55:49.273197+0000","last_unstale":"2024-04-01T01:55:50.226523+0000","last_undegraded":"2024-04-01T01:55:50.226523+0000","last_fullsized":"2024-04-01T01:55:50.226523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:14:32.577522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.666134+0000","last_change":"2024-04-01T01:55:48.214341+0000","last_active":"2024-04-01T01:55:50.666134+0000","last_peered":"2024-04-01T01:55:50.666134+0000","last_clean":"2024-04-01T01:55:50.666134+0000","last_became_active":"2024-04-01T01:55:48.213914+0000","last_became_peered":"2024-04-01T01:55:48.213914+0000","last_unstale":"2024-04-01T01:55:50.666134+0000","last_undegraded":"2024-04-01T01:55:50.666134+0000","last_fullsized":"2024-04-01T01:55:50.666134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:09:28.276592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.636256+0000","last_change":"2024-04-01T01:55:49.272106+0000","last_active":"2024-04-01T01:55:50.636256+0000","last_peered":"2024-04-01T01:55:50.636256+0000","last_clean":"2024-04-01T01:55:50.636256+0000","last_became_active":"2024-04-01T01:55:49.271821+0000","last_became_peered":"2024-04-01T01:55:49.271821+0000","last_unstale":"2024-04-01T01:55:50.636256+0000","last_undegraded":"2024-04-01T01:55:50.636256+0000","last_fullsized":"2024-04-01T01:55:50.636256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T13:22:31.821166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.664742+0000","last_change":"2024-04-01T01:55:48.218296+0000","last_active":"2024-04-01T01:55:50.664742+0000","last_peered":"2024-04-01T01:55:50.664742+0000","last_clean":"2024-04-01T01:55:50.664742+0000","last_became_active":"2024-04-01T01:55:48.217516+0000","last_became_peered":"2024-04-01T01:55:48.217516+0000","last_unstale":"2024-04-01T01:55:50.664742+0000","last_undegraded":"2024-04-01T01:55:50.664742+0000","last_fullsized":"2024-04-01T01:55:50.664742+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:36:42.625449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.226891+0000","last_change":"2024-04-01T01:55:49.246734+0000","last_active":"2024-04-01T01:55:50.226891+0000","last_peered":"2024-04-01T01:55:50.226891+0000","last_clean":"2024-04-01T01:55:50.226891+0000","last_became_active":"2024-04-01T01:55:49.246152+0000","last_became_peered":"2024-04-01T01:55:49.246152+0000","last_unstale":"2024-04-01T01:55:50.226891+0000","last_undegraded":"2024-04-01T01:55:50.226891+0000","last_fullsized":"2024-04-01T01:55:50.226891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:52:34.992185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.667221+0000","last_change":"2024-04-01T01:55:48.222956+0000","last_active":"2024-04-01T01:55:50.667221+0000","last_peered":"2024-04-01T01:55:50.667221+0000","last_clean":"2024-04-01T01:55:50.667221+0000","last_became_active":"2024-04-01T01:55:48.222414+0000","last_became_peered":"2024-04-01T01:55:48.222414+0000","last_unstale":"2024-04-01T01:55:50.667221+0000","last_undegraded":"2024-04-01T01:55:50.667221+0000","last_fullsized":"2024-04-01T01:55:50.667221+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:26:08.622975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.485388+0000","last_change":"2024-04-01T01:55:49.247633+0000","last_active":"2024-04-01T01:55:50.485388+0000","last_peered":"2024-04-01T01:55:50.485388+0000","last_clean":"2024-04-01T01:55:50.485388+0000","last_became_active":"2024-04-01T01:55:49.247285+0000","last_became_peered":"2024-04-01T01:55:49.247285+0000","last_unstale":"2024-04-01T01:55:50.485388+0000","last_undegraded":"2024-04-01T01:55:50.485388+0000","last_fullsized":"2024-04-01T01:55:50.485388+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:15:01.912111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.226200+0000","last_change":"2024-04-01T01:55:48.226323+0000","last_active":"2024-04-01T01:55:50.226200+0000","last_peered":"2024-04-01T01:55:50.226200+0000","last_clean":"2024-04-01T01:55:50.226200+0000","last_became_active":"2024-04-01T01:55:48.225487+0000","last_became_peered":"2024-04-01T01:55:48.225487+0000","last_unstale":"2024-04-01T01:55:50.226200+0000","last_undegraded":"2024-04-01T01:55:50.226200+0000","last_fullsized":"2024-04-01T01:55:50.226200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:13:17.832963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.667602+0000","last_change":"2024-04-01T01:55:49.265542+0000","last_active":"2024-04-01T01:55:50.667602+0000","last_peered":"2024-04-01T01:55:50.667602+0000","last_clean":"2024-04-01T01:55:50.667602+0000","last_became_active":"2024-04-01T01:55:49.264914+0000","last_became_peered":"2024-04-01T01:55:49.264914+0000","last_unstale":"2024-04-01T01:55:50.667602+0000","last_undegraded":"2024-04-01T01:55:50.667602+0000","last_fullsized":"2024-04-01T01:55:50.667602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:55:44.175129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.667910+0000","last_change":"2024-04-01T01:55:48.227292+0000","last_active":"2024-04-01T01:55:50.667910+0000","last_peered":"2024-04-01T01:55:50.667910+0000","last_clean":"2024-04-01T01:55:50.667910+0000","last_became_active":"2024-04-01T01:55:48.226948+0000","last_became_peered":"2024-04-01T01:55:48.226948+0000","last_unstale":"2024-04-01T01:55:50.667910+0000","last_undegraded":"2024-04-01T01:55:50.667910+0000","last_fullsized":"2024-04-01T01:55:50.667910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:55:43.165347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.636006+0000","last_change":"2024-04-01T01:55:49.244171+0000","last_active":"2024-04-01T01:55:50.636006+0000","last_peered":"2024-04-01T01:55:50.636006+0000","last_clean":"2024-04-01T01:55:50.636006+0000","last_became_active":"2024-04-01T01:55:49.241632+0000","last_became_peered":"2024-04-01T01:55:49.241632+0000","last_unstale":"2024-04-01T01:55:50.636006+0000","last_undegraded":"2024-04-01T01:55:50.636006+0000","last_fullsized":"2024-04-01T01:55:50.636006+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:24:42.777720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.228150+0000","last_change":"2024-04-01T01:55:48.204432+0000","last_active":"2024-04-01T01:55:50.228150+0000","last_peered":"2024-04-01T01:55:50.228150+0000","last_clean":"2024-04-01T01:55:50.228150+0000","last_became_active":"2024-04-01T01:55:48.203576+0000","last_became_peered":"2024-04-01T01:55:48.203576+0000","last_unstale":"2024-04-01T01:55:50.228150+0000","last_undegraded":"2024-04-01T01:55:50.228150+0000","last_fullsized":"2024-04-01T01:55:50.228150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:49:34.960786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.227962+0000","last_change":"2024-04-01T01:55:49.244993+0000","last_active":"2024-04-01T01:55:50.227962+0000","last_peered":"2024-04-01T01:55:50.227962+0000","last_clean":"2024-04-01T01:55:50.227962+0000","last_became_active":"2024-04-01T01:55:49.244632+0000","last_became_peered":"2024-04-01T01:55:49.244632+0000","last_unstale":"2024-04-01T01:55:50.227962+0000","last_undegraded":"2024-04-01T01:55:50.227962+0000","last_fullsized":"2024-04-01T01:55:50.227962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:30:26.148968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.668315+0000","last_change":"2024-04-01T01:55:48.221282+0000","last_active":"2024-04-01T01:55:50.668315+0000","last_peered":"2024-04-01T01:55:50.668315+0000","last_clean":"2024-04-01T01:55:50.668315+0000","last_became_active":"2024-04-01T01:55:48.220889+0000","last_became_peered":"2024-04-01T01:55:48.220889+0000","last_unstale":"2024-04-01T01:55:50.668315+0000","last_undegraded":"2024-04-01T01:55:50.668315+0000","last_fullsized":"2024-04-01T01:55:50.668315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:13:12.104386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.227472+0000","last_change":"2024-04-01T01:55:49.251927+0000","last_active":"2024-04-01T01:55:50.227472+0000","last_peered":"2024-04-01T01:55:50.227472+0000","last_clean":"2024-04-01T01:55:50.227472+0000","last_became_active":"2024-04-01T01:55:49.251641+0000","last_became_peered":"2024-04-01T01:55:49.251641+0000","last_unstale":"2024-04-01T01:55:50.227472+0000","last_undegraded":"2024-04-01T01:55:50.227472+0000","last_fullsized":"2024-04-01T01:55:50.227472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T13:22:31.821166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.484332+0000","last_change":"2024-04-01T01:55:48.204161+0000","last_active":"2024-04-01T01:55:50.484332+0000","last_peered":"2024-04-01T01:55:50.484332+0000","last_clean":"2024-04-01T01:55:50.484332+0000","last_became_active":"2024-04-01T01:55:48.203828+0000","last_became_peered":"2024-04-01T01:55:48.203828+0000","last_unstale":"2024-04-01T01:55:50.484332+0000","last_undegraded":"2024-04-01T01:55:50.484332+0000","last_fullsized":"2024-04-01T01:55:50.484332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:04:19.568533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.666187+0000","last_change":"2024-04-01T01:55:49.259699+0000","last_active":"2024-04-01T01:55:50.666187+0000","last_peered":"2024-04-01T01:55:50.666187+0000","last_clean":"2024-04-01T01:55:50.666187+0000","last_became_active":"2024-04-01T01:55:49.259332+0000","last_became_peered":"2024-04-01T01:55:49.259332+0000","last_unstale":"2024-04-01T01:55:50.666187+0000","last_undegraded":"2024-04-01T01:55:50.666187+0000","last_fullsized":"2024-04-01T01:55:50.666187+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:02:41.829474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.227810+0000","last_change":"2024-04-01T01:55:48.206742+0000","last_active":"2024-04-01T01:55:50.227810+0000","last_peered":"2024-04-01T01:55:50.227810+0000","last_clean":"2024-04-01T01:55:50.227810+0000","last_became_active":"2024-04-01T01:55:48.206027+0000","last_became_peered":"2024-04-01T01:55:48.206027+0000","last_unstale":"2024-04-01T01:55:50.227810+0000","last_undegraded":"2024-04-01T01:55:50.227810+0000","last_fullsized":"2024-04-01T01:55:50.227810+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:18:27.840431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.228142+0000","last_change":"2024-04-01T01:55:49.246379+0000","last_active":"2024-04-01T01:55:50.228142+0000","last_peered":"2024-04-01T01:55:50.228142+0000","last_clean":"2024-04-01T01:55:50.228142+0000","last_became_active":"2024-04-01T01:55:49.245774+0000","last_became_peered":"2024-04-01T01:55:49.245774+0000","last_unstale":"2024-04-01T01:55:50.228142+0000","last_undegraded":"2024-04-01T01:55:50.228142+0000","last_fullsized":"2024-04-01T01:55:50.228142+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:25:48.896071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.635697+0000","last_change":"2024-04-01T01:55:48.222218+0000","last_active":"2024-04-01T01:55:50.635697+0000","last_peered":"2024-04-01T01:55:50.635697+0000","last_clean":"2024-04-01T01:55:50.635697+0000","last_became_active":"2024-04-01T01:55:48.221148+0000","last_became_peered":"2024-04-01T01:55:48.221148+0000","last_unstale":"2024-04-01T01:55:50.635697+0000","last_undegraded":"2024-04-01T01:55:50.635697+0000","last_fullsized":"2024-04-01T01:55:50.635697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:25:51.219789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.665026+0000","last_change":"2024-04-01T01:55:49.249648+0000","last_active":"2024-04-01T01:55:50.665026+0000","last_peered":"2024-04-01T01:55:50.665026+0000","last_clean":"2024-04-01T01:55:50.665026+0000","last_became_active":"2024-04-01T01:55:49.248925+0000","last_became_peered":"2024-04-01T01:55:49.248925+0000","last_unstale":"2024-04-01T01:55:50.665026+0000","last_undegraded":"2024-04-01T01:55:50.665026+0000","last_fullsized":"2024-04-01T01:55:50.665026+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:33:56.754206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.666488+0000","last_change":"2024-04-01T01:55:48.207522+0000","last_active":"2024-04-01T01:55:50.666488+0000","last_peered":"2024-04-01T01:55:50.666488+0000","last_clean":"2024-04-01T01:55:50.666488+0000","last_became_active":"2024-04-01T01:55:48.206856+0000","last_became_peered":"2024-04-01T01:55:48.206856+0000","last_unstale":"2024-04-01T01:55:50.666488+0000","last_undegraded":"2024-04-01T01:55:50.666488+0000","last_fullsized":"2024-04-01T01:55:50.666488+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:33:55.744424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.667078+0000","last_change":"2024-04-01T01:55:49.274489+0000","last_active":"2024-04-01T01:55:50.667078+0000","last_peered":"2024-04-01T01:55:50.667078+0000","last_clean":"2024-04-01T01:55:50.667078+0000","last_became_active":"2024-04-01T01:55:49.270254+0000","last_became_peered":"2024-04-01T01:55:49.270254+0000","last_unstale":"2024-04-01T01:55:50.667078+0000","last_undegraded":"2024-04-01T01:55:50.667078+0000","last_fullsized":"2024-04-01T01:55:50.667078+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T13:09:00.491227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.666309+0000","last_change":"2024-04-01T01:55:49.275782+0000","last_active":"2024-04-01T01:55:50.666309+0000","last_peered":"2024-04-01T01:55:50.666309+0000","last_clean":"2024-04-01T01:55:50.666309+0000","last_became_active":"2024-04-01T01:55:49.275050+0000","last_became_peered":"2024-04-01T01:55:49.275050+0000","last_unstale":"2024-04-01T01:55:50.666309+0000","last_undegraded":"2024-04-01T01:55:50.666309+0000","last_fullsized":"2024-04-01T01:55:50.666309+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:26:15.406856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.485245+0000","last_change":"2024-04-01T01:55:48.223704+0000","last_active":"2024-04-01T01:55:50.485245+0000","last_peered":"2024-04-01T01:55:50.485245+0000","last_clean":"2024-04-01T01:55:50.485245+0000","last_became_active":"2024-04-01T01:55:48.223220+0000","last_became_peered":"2024-04-01T01:55:48.223220+0000","last_unstale":"2024-04-01T01:55:50.485245+0000","last_undegraded":"2024-04-01T01:55:50.485245+0000","last_fullsized":"2024-04-01T01:55:50.485245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:49:34.960786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.223741+0000","last_change":"2024-04-01T01:55:49.264857+0000","last_active":"2024-04-01T01:55:50.223741+0000","last_peered":"2024-04-01T01:55:50.223741+0000","last_clean":"2024-04-01T01:55:50.223741+0000","last_became_active":"2024-04-01T01:55:49.258478+0000","last_became_peered":"2024-04-01T01:55:49.258478+0000","last_unstale":"2024-04-01T01:55:50.223741+0000","last_undegraded":"2024-04-01T01:55:50.223741+0000","last_fullsized":"2024-04-01T01:55:50.223741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:33:56.754206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.485995+0000","last_change":"2024-04-01T01:55:48.218370+0000","last_active":"2024-04-01T01:55:50.485995+0000","last_peered":"2024-04-01T01:55:50.485995+0000","last_clean":"2024-04-01T01:55:50.485995+0000","last_became_active":"2024-04-01T01:55:48.217755+0000","last_became_peered":"2024-04-01T01:55:48.217755+0000","last_unstale":"2024-04-01T01:55:50.485995+0000","last_undegraded":"2024-04-01T01:55:50.485995+0000","last_fullsized":"2024-04-01T01:55:50.485995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:09:28.276592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.228017+0000","last_change":"2024-04-01T01:55:49.243377+0000","last_active":"2024-04-01T01:55:50.228017+0000","last_peered":"2024-04-01T01:55:50.228017+0000","last_clean":"2024-04-01T01:55:50.228017+0000","last_became_active":"2024-04-01T01:55:49.242851+0000","last_became_peered":"2024-04-01T01:55:49.242851+0000","last_unstale":"2024-04-01T01:55:50.228017+0000","last_undegraded":"2024-04-01T01:55:50.228017+0000","last_fullsized":"2024-04-01T01:55:50.228017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:48:38.596647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.227487+0000","last_change":"2024-04-01T01:55:48.213862+0000","last_active":"2024-04-01T01:55:50.227487+0000","last_peered":"2024-04-01T01:55:50.227487+0000","last_clean":"2024-04-01T01:55:50.227487+0000","last_became_active":"2024-04-01T01:55:48.213122+0000","last_became_peered":"2024-04-01T01:55:48.213122+0000","last_unstale":"2024-04-01T01:55:50.227487+0000","last_undegraded":"2024-04-01T01:55:50.227487+0000","last_fullsized":"2024-04-01T01:55:50.227487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:59:23.563864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.227575+0000","last_change":"2024-04-01T01:55:49.252273+0000","last_active":"2024-04-01T01:55:50.227575+0000","last_peered":"2024-04-01T01:55:50.227575+0000","last_clean":"2024-04-01T01:55:50.227575+0000","last_became_active":"2024-04-01T01:55:49.251963+0000","last_became_peered":"2024-04-01T01:55:49.251963+0000","last_unstale":"2024-04-01T01:55:50.227575+0000","last_undegraded":"2024-04-01T01:55:50.227575+0000","last_fullsized":"2024-04-01T01:55:50.227575+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:56:18.086766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-01T01:55:50.227756+0000","last_change":"2024-04-01T01:55:48.225858+0000","last_active":"2024-04-01T01:55:50.227756+0000","last_peered":"2024-04-01T01:55:50.227756+0000","last_clean":"2024-04-01T01:55:50.227756+0000","last_became_active":"2024-04-01T01:55:48.224494+0000","last_became_peered":"2024-04-01T01:55:48.224494+0000","last_unstale":"2024-04-01T01:55:50.227756+0000","last_undegraded":"2024-04-01T01:55:50.227756+0000","last_fullsized":"2024-04-01T01:55:50.227756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:09:28.276592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66838,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509447,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509448,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":74457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31388,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340452,"statfs":{"total":96636764160,"available":96604622848,"internally_reserved":0,"allocated":212992,"data_stored":72755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":221184,"data_stored":73785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509447,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31456,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340384,"statfs":{"total":96636764160,"available":96604553216,"internally_reserved":0,"allocated":278528,"data_stored":662611,"data_compressed":33419,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509446,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":217088,"data_stored":72229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542150,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":72173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":282624,"data_stored":662633,"data_compressed":33419,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33419,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33419,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-01T01:56:02.606 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-01T01:56:02.606 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-01T01:56:02.606 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-01T01:56:02.606 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-01T01:56:02.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.766+0000 7fd10ce84640 1 Processor -- start 2024-04-01T01:56:02.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.766+0000 7fd10ce84640 1 -- start start 2024-04-01T01:56:02.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.766+0000 7fd10ce84640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fd108151e50 0x7fd1080c79f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:02.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.766+0000 7fd10ce84640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd108157c50 con 0x7fd1080c1f10 2024-04-01T01:56:02.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.766+0000 7fd10ce84640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd10815b490 con 0x7fd108158150 2024-04-01T01:56:02.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.766+0000 7fd10ce84640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fd10815b240 con 0x7fd108151e50 2024-04-01T01:56:02.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.766+0000 7fd0fdd9b640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fd1080c1f10 0x7fd10806ee40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44712/0 (socket says 172.21.15.50:44712) 2024-04-01T01:56:02.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.766+0000 7fd0fdd9b640 1 -- 172.21.15.50:0/3305892253 learned_addr learned my addr 172.21.15.50:0/3305892253 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-04-01T01:56:02.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.766+0000 7fd10659c640 1 --2- 172.21.15.50:0/3305892253 >> v2:172.21.15.97:3300/0 conn(0x7fd108151e50 0x7fd1080c79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:02.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.766+0000 7fd105d9b640 1 -- 172.21.15.50:0/3305892253 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1716406431 0 0) 0x7fd108157c50 con 0x7fd1080c1f10 2024-04-01T01:56:02.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.766+0000 7fd105d9b640 1 -- 172.21.15.50:0/3305892253 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd0e8003530 con 0x7fd1080c1f10 2024-04-01T01:56:02.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.766+0000 7fd10659c640 1 -- 172.21.15.50:0/3305892253 >> v1:172.21.15.97:6789/0 conn(0x7fd108158150 legacy=0x7fd1081585a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:02.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.766+0000 7fd10659c640 1 -- 172.21.15.50:0/3305892253 >> v1:172.21.15.50:6789/0 conn(0x7fd1080c1f10 legacy=0x7fd10806ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:02.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.770+0000 7fd10659c640 1 -- 172.21.15.50:0/3305892253 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd10815b770 con 0x7fd108151e50 2024-04-01T01:56:02.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.770+0000 7fd10659c640 1 --2- 172.21.15.50:0/3305892253 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd108151e50 0x7fd1080c79f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd0f00097c0 tx=0x7fd0f001ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=30a16520a5679213 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:56:02.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.770+0000 7fd105d9b640 1 -- 172.21.15.50:0/3305892253 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0f00b5070 con 0x7fd108151e50 2024-04-01T01:56:02.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.770+0000 7fd105d9b640 1 -- 172.21.15.50:0/3305892253 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0f00a8990 con 0x7fd108151e50 2024-04-01T01:56:02.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.770+0000 7fd105d9b640 1 -- 172.21.15.50:0/3305892253 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0f00a8d40 con 0x7fd108151e50 2024-04-01T01:56:02.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.770+0000 7fd10ce84640 1 -- 172.21.15.50:0/3305892253 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd108151e50 msgr2=0x7fd1080c79f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:02.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.770+0000 7fd10ce84640 1 --2- 172.21.15.50:0/3305892253 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd108151e50 0x7fd1080c79f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd0f00097c0 tx=0x7fd0f001ec90 comp rx=0 tx=0).stop 2024-04-01T01:56:02.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.770+0000 7fd10ce84640 1 -- 172.21.15.50:0/3305892253 shutdown_connections 2024-04-01T01:56:02.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.770+0000 7fd10ce84640 1 --2- 172.21.15.50:0/3305892253 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd108151e50 0x7fd1080c79f0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:02.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.770+0000 7fd10ce84640 1 -- 172.21.15.50:0/3305892253 >> 172.21.15.50:0/3305892253 conn(0x7fd1080676f0 msgr2=0x7fd1080c8010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:56:02.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.770+0000 7fd10ce84640 1 -- 172.21.15.50:0/3305892253 shutdown_connections 2024-04-01T01:56:02.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.770+0000 7fd10ce84640 1 -- 172.21.15.50:0/3305892253 wait complete. 2024-04-01T01:56:02.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.774+0000 7fd10ce84640 1 Processor -- start 2024-04-01T01:56:02.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.774+0000 7fd10ce84640 1 -- start start 2024-04-01T01:56:02.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.774+0000 7fd10ce84640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1080c1f10 0x7fd1081ef860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:02.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.774+0000 7fd10ce84640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd108151e50 0x7fd108155d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:02.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.774+0000 7fd10ce84640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd108158150 0x7fd1080c3b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:02.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.774+0000 7fd10ce84640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd10815c010 con 0x7fd1080c1f10 2024-04-01T01:56:02.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.774+0000 7fd10ce84640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fd10815bd30 con 0x7fd108151e50 2024-04-01T01:56:02.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.774+0000 7fd10ce84640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fd10806f550 con 0x7fd108158150 2024-04-01T01:56:02.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.774+0000 7fd10659c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1080c1f10 0x7fd1081ef860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:02.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.774+0000 7fd10659c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1080c1f10 0x7fd1081ef860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50836/0 (socket says 172.21.15.50:50836) 2024-04-01T01:56:02.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.774+0000 7fd10659c640 1 -- 172.21.15.50:0/3513389482 learned_addr learned my addr 172.21.15.50:0/3513389482 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T01:56:02.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.774+0000 7fd0fdd9b640 1 --2- 172.21.15.50:0/3513389482 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd108151e50 0x7fd108155d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:02.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.774+0000 7fd106d9d640 1 --2- 172.21.15.50:0/3513389482 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd108158150 0x7fd1080c3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:02.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.774+0000 7fd10659c640 1 -- 172.21.15.50:0/3513389482 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd108158150 msgr2=0x7fd1080c3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:02.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.774+0000 7fd10659c640 1 --2- 172.21.15.50:0/3513389482 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd108158150 0x7fd1080c3b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:02.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.774+0000 7fd10659c640 1 -- 172.21.15.50:0/3513389482 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd108151e50 msgr2=0x7fd108155d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:02.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.774+0000 7fd10659c640 1 --2- 172.21.15.50:0/3513389482 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd108151e50 0x7fd108155d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:02.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.774+0000 7fd10659c640 1 -- 172.21.15.50:0/3513389482 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd108159040 con 0x7fd1080c1f10 2024-04-01T01:56:02.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.774+0000 7fd10659c640 1 --2- 172.21.15.50:0/3513389482 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1080c1f10 0x7fd1081ef860 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd0f00097c0 tx=0x7fd0f001ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:56:02.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.774+0000 7fd0ff7fe640 1 -- 172.21.15.50:0/3513389482 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0f00b5040 con 0x7fd1080c1f10 2024-04-01T01:56:02.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.774+0000 7fd0ff7fe640 1 -- 172.21.15.50:0/3513389482 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0f00c0070 con 0x7fd1080c1f10 2024-04-01T01:56:02.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.774+0000 7fd0ff7fe640 1 -- 172.21.15.50:0/3513389482 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0f0004440 con 0x7fd1080c1f10 2024-04-01T01:56:02.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.774+0000 7fd10ce84640 1 -- 172.21.15.50:0/3513389482 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd108159300 con 0x7fd1080c1f10 2024-04-01T01:56:02.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.774+0000 7fd10ce84640 1 -- 172.21.15.50:0/3513389482 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1081f3290 con 0x7fd1080c1f10 2024-04-01T01:56:02.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.774+0000 7fd10ce84640 1 -- 172.21.15.50:0/3513389482 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd108068230 con 0x7fd1080c1f10 2024-04-01T01:56:02.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.774+0000 7fd0ff7fe640 1 -- 172.21.15.50:0/3513389482 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 87103+0+0 (secure 0 0 0) 0x7fd0f0003620 con 0x7fd1080c1f10 2024-04-01T01:56:02.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.778+0000 7fd0ff7fe640 1 --2- 172.21.15.50:0/3513389482 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fd0ec067450 0x7fd0ec069910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:02.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.778+0000 7fd0ff7fe640 1 -- 172.21.15.50:0/3513389482 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fd0f0123750 con 0x7fd1080c1f10 2024-04-01T01:56:02.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.778+0000 7fd0fdd9b640 1 --2- 172.21.15.50:0/3513389482 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fd0ec067450 0x7fd0ec069910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:02.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.778+0000 7fd0fdd9b640 1 --2- 172.21.15.50:0/3513389482 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fd0ec067450 0x7fd0ec069910 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd10815b1a0 tx=0x7fd0f8007d40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:56:02.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.782+0000 7fd0ff7fe640 1 -- 172.21.15.50:0/3513389482 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+176632 (secure 0 0 0) 0x7fd0f00187f0 con 0x7fd1080c1f10 2024-04-01T01:56:02.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.970+0000 7fd10ce84640 1 -- 172.21.15.50:0/3513389482 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fd1081f2d80 con 0x7fd1080c1f10 2024-04-01T01:56:02.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.970+0000 7fd0ff7fe640 1 -- 172.21.15.50:0/3513389482 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fd0f00f4570 con 0x7fd1080c1f10 2024-04-01T01:56:02.971 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-01T01:56:02.971 INFO:teuthology.orchestra.run.smithi050.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-01T01:56:02.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.970+0000 7fd10ce84640 1 -- 172.21.15.50:0/3513389482 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fd0ec067450 msgr2=0x7fd0ec069910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:02.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.970+0000 7fd10ce84640 1 --2- 172.21.15.50:0/3513389482 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fd0ec067450 0x7fd0ec069910 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd10815b1a0 tx=0x7fd0f8007d40 comp rx=0 tx=0).stop 2024-04-01T01:56:02.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.970+0000 7fd10ce84640 1 -- 172.21.15.50:0/3513389482 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1080c1f10 msgr2=0x7fd1081ef860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:02.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.970+0000 7fd10ce84640 1 --2- 172.21.15.50:0/3513389482 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1080c1f10 0x7fd1081ef860 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd0f00097c0 tx=0x7fd0f001ba30 comp rx=0 tx=0).stop 2024-04-01T01:56:02.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.970+0000 7fd10ce84640 1 -- 172.21.15.50:0/3513389482 shutdown_connections 2024-04-01T01:56:02.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.970+0000 7fd10ce84640 1 --2- 172.21.15.50:0/3513389482 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fd0ec067450 0x7fd0ec069910 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:02.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.970+0000 7fd10ce84640 1 --2- 172.21.15.50:0/3513389482 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd108158150 0x7fd1080c3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:02.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.970+0000 7fd10ce84640 1 --2- 172.21.15.50:0/3513389482 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd108151e50 0x7fd108155d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:02.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.970+0000 7fd10ce84640 1 --2- 172.21.15.50:0/3513389482 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1080c1f10 0x7fd1081ef860 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:02.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.970+0000 7fd10ce84640 1 -- 172.21.15.50:0/3513389482 >> 172.21.15.50:0/3513389482 conn(0x7fd1080676f0 msgr2=0x7fd108156c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:56:02.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.970+0000 7fd10ce84640 1 -- 172.21.15.50:0/3513389482 shutdown_connections 2024-04-01T01:56:02.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:02.970+0000 7fd10ce84640 1 -- 172.21.15.50:0/3513389482 wait complete. 2024-04-01T01:56:02.989 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-01T01:56:02.989 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-01T01:56:03.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.106+0000 7fc8ff9e3640 1 Processor -- start 2024-04-01T01:56:03.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.106+0000 7fc8ff9e3640 1 -- start start 2024-04-01T01:56:03.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.106+0000 7fc8ff9e3640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc8f8154360 0x7fc8f8066f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:03.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.106+0000 7fc8ff9e3640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc8f8072b40 0x7fc8f80674a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:03.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.106+0000 7fc8ff9e3640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8f8073610 con 0x7fc8f806c2c0 2024-04-01T01:56:03.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.106+0000 7fc8ff9e3640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fc8f815a8a0 con 0x7fc8f8154360 2024-04-01T01:56:03.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.106+0000 7fc8ff9e3640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fc8f815add0 con 0x7fc8f8072b40 2024-04-01T01:56:03.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.106+0000 7fc8fd77f640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc8f8154360 0x7fc8f8066f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:03.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.106+0000 7fc8fcf7e640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fc8f806c2c0 0x7fc8f8072430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44718/0 (socket says 172.21.15.50:44718) 2024-04-01T01:56:03.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.106+0000 7fc8fcf7e640 1 -- 172.21.15.50:0/500076195 learned_addr learned my addr 172.21.15.50:0/500076195 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-04-01T01:56:03.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.106+0000 7fc8fdf80640 1 --2- 172.21.15.50:0/500076195 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc8f8072b40 0x7fc8f80674a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:03.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.106+0000 7fc8fd77f640 1 -- 172.21.15.50:0/500076195 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc8f8072b40 msgr2=0x7fc8f80674a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:56:03.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.106+0000 7fc8fd77f640 1 --2- 172.21.15.50:0/500076195 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc8f8072b40 0x7fc8f80674a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:03.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.106+0000 7fc8fd77f640 1 -- 172.21.15.50:0/500076195 >> v1:172.21.15.50:6789/0 conn(0x7fc8f806c2c0 legacy=0x7fc8f8072430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:03.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.106+0000 7fc8fd77f640 1 -- 172.21.15.50:0/500076195 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8f815aaf0 con 0x7fc8f8154360 2024-04-01T01:56:03.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.106+0000 7fc8f7fff640 1 -- 172.21.15.50:0/500076195 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3858087159 0 0) 0x7fc8f8073610 con 0x7fc8f806c2c0 2024-04-01T01:56:03.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.106+0000 7fc8fdf80640 1 --2- 172.21.15.50:0/500076195 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc8f8072b40 0x7fc8f80674a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T01:56:03.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.110+0000 7fc8fd77f640 1 --2- 172.21.15.50:0/500076195 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8f8154360 0x7fc8f8066f60 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fc8f00097c0 tx=0x7fc8f001c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa6b744c3f953df7 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:56:03.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.110+0000 7fc8f7fff640 1 -- 172.21.15.50:0/500076195 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8f00b0070 con 0x7fc8f8154360 2024-04-01T01:56:03.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.110+0000 7fc8f7fff640 1 -- 172.21.15.50:0/500076195 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8f00ab600 con 0x7fc8f8154360 2024-04-01T01:56:03.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.110+0000 7fc8f7fff640 1 -- 172.21.15.50:0/500076195 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8f00ab9d0 con 0x7fc8f8154360 2024-04-01T01:56:03.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.110+0000 7fc8ff9e3640 1 -- 172.21.15.50:0/500076195 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8f8154360 msgr2=0x7fc8f8066f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:03.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.110+0000 7fc8ff9e3640 1 --2- 172.21.15.50:0/500076195 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8f8154360 0x7fc8f8066f60 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fc8f00097c0 tx=0x7fc8f001c380 comp rx=0 tx=0).stop 2024-04-01T01:56:03.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.110+0000 7fc8ff9e3640 1 -- 172.21.15.50:0/500076195 shutdown_connections 2024-04-01T01:56:03.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.110+0000 7fc8ff9e3640 1 --2- 172.21.15.50:0/500076195 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc8f8072b40 0x7fc8f80674a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:03.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.110+0000 7fc8ff9e3640 1 --2- 172.21.15.50:0/500076195 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8f8154360 0x7fc8f8066f60 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:03.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.110+0000 7fc8ff9e3640 1 -- 172.21.15.50:0/500076195 >> 172.21.15.50:0/500076195 conn(0x7fc8f806b220 msgr2=0x7fc8f806b630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:56:03.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.110+0000 7fc8ff9e3640 1 -- 172.21.15.50:0/500076195 shutdown_connections 2024-04-01T01:56:03.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.110+0000 7fc8ff9e3640 1 -- 172.21.15.50:0/500076195 wait complete. 2024-04-01T01:56:03.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.110+0000 7fc8ff9e3640 1 Processor -- start 2024-04-01T01:56:03.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.110+0000 7fc8ff9e3640 1 -- start start 2024-04-01T01:56:03.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.110+0000 7fc8ff9e3640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc8f806c2c0 0x7fc8f8149a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:03.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.110+0000 7fc8ff9e3640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8f8072b40 0x7fc8f81444a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:03.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.110+0000 7fc8ff9e3640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc8f8154360 0x7fc8f813ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:03.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.110+0000 7fc8ff9e3640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc8f8167060 con 0x7fc8f8072b40 2024-04-01T01:56:03.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.110+0000 7fc8ff9e3640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fc8f8166ee0 con 0x7fc8f8154360 2024-04-01T01:56:03.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.110+0000 7fc8ff9e3640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fc8f81671e0 con 0x7fc8f806c2c0 2024-04-01T01:56:03.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.110+0000 7fc8fcf7e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8f8072b40 0x7fc8f81444a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:03.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.110+0000 7fc8fcf7e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8f8072b40 0x7fc8f81444a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50864/0 (socket says 172.21.15.50:50864) 2024-04-01T01:56:03.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.110+0000 7fc8fcf7e640 1 -- 172.21.15.50:0/1909087285 learned_addr learned my addr 172.21.15.50:0/1909087285 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T01:56:03.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.110+0000 7fc8fdf80640 1 --2- 172.21.15.50:0/1909087285 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc8f8154360 0x7fc8f813ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:03.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.110+0000 7fc8fd77f640 1 --2- 172.21.15.50:0/1909087285 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc8f806c2c0 0x7fc8f8149a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:03.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.114+0000 7fc8fcf7e640 1 -- 172.21.15.50:0/1909087285 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc8f806c2c0 msgr2=0x7fc8f8149a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:03.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.114+0000 7fc8fcf7e640 1 --2- 172.21.15.50:0/1909087285 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc8f806c2c0 0x7fc8f8149a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:03.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.114+0000 7fc8fcf7e640 1 -- 172.21.15.50:0/1909087285 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc8f8154360 msgr2=0x7fc8f813ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:03.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.114+0000 7fc8fcf7e640 1 --2- 172.21.15.50:0/1909087285 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc8f8154360 0x7fc8f813ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:03.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.114+0000 7fc8fcf7e640 1 -- 172.21.15.50:0/1909087285 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8f80cad50 con 0x7fc8f8072b40 2024-04-01T01:56:03.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.114+0000 7fc8fcf7e640 1 --2- 172.21.15.50:0/1909087285 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8f8072b40 0x7fc8f81444a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc8ec00c4b0 tx=0x7fc8ec00c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:56:03.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.114+0000 7fc8f5ffb640 1 -- 172.21.15.50:0/1909087285 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8ec018070 con 0x7fc8f8072b40 2024-04-01T01:56:03.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.114+0000 7fc8f5ffb640 1 -- 172.21.15.50:0/1909087285 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8ec007500 con 0x7fc8f8072b40 2024-04-01T01:56:03.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.114+0000 7fc8ff9e3640 1 -- 172.21.15.50:0/1909087285 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8f80cb030 con 0x7fc8f8072b40 2024-04-01T01:56:03.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.114+0000 7fc8f5ffb640 1 -- 172.21.15.50:0/1909087285 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8ec004a30 con 0x7fc8f8072b40 2024-04-01T01:56:03.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.114+0000 7fc8ff9e3640 1 -- 172.21.15.50:0/1909087285 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8f80cb5f0 con 0x7fc8f8072b40 2024-04-01T01:56:03.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.114+0000 7fc8ff9e3640 1 -- 172.21.15.50:0/1909087285 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8f8068230 con 0x7fc8f8072b40 2024-04-01T01:56:03.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.114+0000 7fc8f5ffb640 1 -- 172.21.15.50:0/1909087285 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 87103+0+0 (secure 0 0 0) 0x7fc8ec01b070 con 0x7fc8f8072b40 2024-04-01T01:56:03.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.114+0000 7fc8f5ffb640 1 --2- 172.21.15.50:0/1909087285 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fc8e4067420 0x7fc8e40698e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:03.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.114+0000 7fc8f5ffb640 1 -- 172.21.15.50:0/1909087285 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fc8ec084970 con 0x7fc8f8072b40 2024-04-01T01:56:03.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.114+0000 7fc8fd77f640 1 --2- 172.21.15.50:0/1909087285 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fc8e4067420 0x7fc8e40698e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:03.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.114+0000 7fc8fd77f640 1 --2- 172.21.15.50:0/1909087285 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fc8e4067420 0x7fc8e40698e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc8f00ad000 tx=0x7fc8f0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:56:03.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.118+0000 7fc8f5ffb640 1 -- 172.21.15.50:0/1909087285 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+176632 (secure 0 0 0) 0x7fc8ec055710 con 0x7fc8f8072b40 2024-04-01T01:56:03.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.274+0000 7fc8ff9e3640 1 -- 172.21.15.50:0/1909087285 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc8f806f170 con 0x7fc8f8072b40 2024-04-01T01:56:03.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.274+0000 7fc8f5ffb640 1 -- 172.21.15.50:0/1909087285 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16525 (secure 0 0 0) 0x7fc8ec055010 con 0x7fc8f8072b40 2024-04-01T01:56:03.276 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-01T01:56:03.277 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":21,"fsid":"f67878a9-bc75-426b-962d-fa7bc2517f7d","created":"2024-04-01T01:55:31.562371+0000","modified":"2024-04-01T01:55:50.217570+0000","last_up_change":"2024-04-01T01:55:42.134502+0000","last_in_change":"2024-04-01T01:55:33.849789+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-01T01:55:42.134418+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-01T01:55:47.009880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-01T01:55:47.551516+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"81e8ca4f-bde8-419a-875f-73a1f4a641ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":4170468134},{"type":"v1","addr":"172.21.15.50:6825","nonce":4170468134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":4170468134},{"type":"v1","addr":"172.21.15.50:6827","nonce":4170468134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":4170468134},{"type":"v1","addr":"172.21.15.50:6831","nonce":4170468134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":4170468134},{"type":"v1","addr":"172.21.15.50:6829","nonce":4170468134}]},"public_addr":"172.21.15.50:6825/4170468134","cluster_addr":"172.21.15.50:6827/4170468134","heartbeat_back_addr":"172.21.15.50:6831/4170468134","heartbeat_front_addr":"172.21.15.50:6829/4170468134","state":["exists","up"]},{"osd":1,"uuid":"bd060ca0-7559-4d30-987c-62e59818431d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1794491326},{"type":"v1","addr":"172.21.15.50:6809","nonce":1794491326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1794491326},{"type":"v1","addr":"172.21.15.50:6811","nonce":1794491326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1794491326},{"type":"v1","addr":"172.21.15.50:6815","nonce":1794491326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1794491326},{"type":"v1","addr":"172.21.15.50:6813","nonce":1794491326}]},"public_addr":"172.21.15.50:6809/1794491326","cluster_addr":"172.21.15.50:6811/1794491326","heartbeat_back_addr":"172.21.15.50:6815/1794491326","heartbeat_front_addr":"172.21.15.50:6813/1794491326","state":["exists","up"]},{"osd":2,"uuid":"eac5d816-a281-4acd-aa7d-b96a8e0aa962","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":710247177},{"type":"v1","addr":"172.21.15.50:6801","nonce":710247177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":710247177},{"type":"v1","addr":"172.21.15.50:6803","nonce":710247177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":710247177},{"type":"v1","addr":"172.21.15.50:6807","nonce":710247177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":710247177},{"type":"v1","addr":"172.21.15.50:6805","nonce":710247177}]},"public_addr":"172.21.15.50:6801/710247177","cluster_addr":"172.21.15.50:6803/710247177","heartbeat_back_addr":"172.21.15.50:6807/710247177","heartbeat_front_addr":"172.21.15.50:6805/710247177","state":["exists","up"]},{"osd":3,"uuid":"12b23968-04a7-40b8-98c4-02b16ae28265","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":871680805},{"type":"v1","addr":"172.21.15.50:6817","nonce":871680805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":871680805},{"type":"v1","addr":"172.21.15.50:6819","nonce":871680805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":871680805},{"type":"v1","addr":"172.21.15.50:6823","nonce":871680805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":871680805},{"type":"v1","addr":"172.21.15.50:6821","nonce":871680805}]},"public_addr":"172.21.15.50:6817/871680805","cluster_addr":"172.21.15.50:6819/871680805","heartbeat_back_addr":"172.21.15.50:6823/871680805","heartbeat_front_addr":"172.21.15.50:6821/871680805","state":["exists","up"]},{"osd":4,"uuid":"0e6b1639-23b0-47d9-8b08-40c8ab6df818","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":1095319381},{"type":"v1","addr":"172.21.15.97:6801","nonce":1095319381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":1095319381},{"type":"v1","addr":"172.21.15.97:6803","nonce":1095319381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":1095319381},{"type":"v1","addr":"172.21.15.97:6807","nonce":1095319381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":1095319381},{"type":"v1","addr":"172.21.15.97:6805","nonce":1095319381}]},"public_addr":"172.21.15.97:6801/1095319381","cluster_addr":"172.21.15.97:6803/1095319381","heartbeat_back_addr":"172.21.15.97:6807/1095319381","heartbeat_front_addr":"172.21.15.97:6805/1095319381","state":["exists","up"]},{"osd":5,"uuid":"f0f876ef-0823-46e9-8fe4-9b7a64a94cee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":899031308},{"type":"v1","addr":"172.21.15.97:6817","nonce":899031308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":899031308},{"type":"v1","addr":"172.21.15.97:6819","nonce":899031308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":899031308},{"type":"v1","addr":"172.21.15.97:6823","nonce":899031308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":899031308},{"type":"v1","addr":"172.21.15.97:6821","nonce":899031308}]},"public_addr":"172.21.15.97:6817/899031308","cluster_addr":"172.21.15.97:6819/899031308","heartbeat_back_addr":"172.21.15.97:6823/899031308","heartbeat_front_addr":"172.21.15.97:6821/899031308","state":["exists","up"]},{"osd":6,"uuid":"d29a625e-83bf-40ef-a57e-618220b96b9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2224814961},{"type":"v1","addr":"172.21.15.97:6825","nonce":2224814961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2224814961},{"type":"v1","addr":"172.21.15.97:6827","nonce":2224814961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2224814961},{"type":"v1","addr":"172.21.15.97:6831","nonce":2224814961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2224814961},{"type":"v1","addr":"172.21.15.97:6829","nonce":2224814961}]},"public_addr":"172.21.15.97:6825/2224814961","cluster_addr":"172.21.15.97:6827/2224814961","heartbeat_back_addr":"172.21.15.97:6831/2224814961","heartbeat_front_addr":"172.21.15.97:6829/2224814961","state":["exists","up"]},{"osd":7,"uuid":"7bcfd8f1-7dc0-4013-af17-16da5a8d931d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":284968823},{"type":"v1","addr":"172.21.15.97:6809","nonce":284968823}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":284968823},{"type":"v1","addr":"172.21.15.97:6811","nonce":284968823}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6814","nonce":284968823},{"type":"v1","addr":"172.21.15.97:6815","nonce":284968823}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":284968823},{"type":"v1","addr":"172.21.15.97:6813","nonce":284968823}]},"public_addr":"172.21.15.97:6809/284968823","cluster_addr":"172.21.15.97:6811/284968823","heartbeat_back_addr":"172.21.15.97:6815/284968823","heartbeat_front_addr":"172.21.15.97:6813/284968823","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T01:55:39.369550+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T01:55:39.367285+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T01:55:39.458393+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T01:55:39.456179+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T01:55:39.463649+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T01:55:38.728924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T01:55:39.522411+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T01:55:39.432081+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-01T01:56:03.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.274+0000 7fc8ff9e3640 1 -- 172.21.15.50:0/1909087285 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fc8e4067420 msgr2=0x7fc8e40698e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:03.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.274+0000 7fc8ff9e3640 1 --2- 172.21.15.50:0/1909087285 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fc8e4067420 0x7fc8e40698e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc8f00ad000 tx=0x7fc8f0008040 comp rx=0 tx=0).stop 2024-04-01T01:56:03.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.274+0000 7fc8ff9e3640 1 -- 172.21.15.50:0/1909087285 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8f8072b40 msgr2=0x7fc8f81444a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:03.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.274+0000 7fc8ff9e3640 1 --2- 172.21.15.50:0/1909087285 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8f8072b40 0x7fc8f81444a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc8ec00c4b0 tx=0x7fc8ec00c970 comp rx=0 tx=0).stop 2024-04-01T01:56:03.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.274+0000 7fc8ff9e3640 1 -- 172.21.15.50:0/1909087285 shutdown_connections 2024-04-01T01:56:03.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.274+0000 7fc8ff9e3640 1 --2- 172.21.15.50:0/1909087285 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fc8e4067420 0x7fc8e40698e0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:03.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.274+0000 7fc8ff9e3640 1 --2- 172.21.15.50:0/1909087285 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc8f8154360 0x7fc8f813ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:03.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.274+0000 7fc8ff9e3640 1 --2- 172.21.15.50:0/1909087285 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8f8072b40 0x7fc8f81444a0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:03.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.274+0000 7fc8ff9e3640 1 --2- 172.21.15.50:0/1909087285 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc8f806c2c0 0x7fc8f8149a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:03.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.274+0000 7fc8ff9e3640 1 -- 172.21.15.50:0/1909087285 >> 172.21.15.50:0/1909087285 conn(0x7fc8f806b220 msgr2=0x7fc8f81535a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:56:03.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.278+0000 7fc8ff9e3640 1 -- 172.21.15.50:0/1909087285 shutdown_connections 2024-04-01T01:56:03.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.278+0000 7fc8ff9e3640 1 -- 172.21.15.50:0/1909087285 wait complete. 2024-04-01T01:56:03.296 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-01T01:55:42.134418+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-01T01:55:47.009880+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-01T01:55:47.551516+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-01T01:56:03.297 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-01T01:56:03.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.414+0000 7f506f70d640 1 Processor -- start 2024-04-01T01:56:03.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.414+0000 7f506f70d640 1 -- start start 2024-04-01T01:56:03.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.418+0000 7f506f70d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f50680c6400 0x7f50680c6870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:03.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.418+0000 7f506f70d640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f506806f8d0 con 0x7f5068150b60 2024-04-01T01:56:03.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.418+0000 7f506f70d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f506815ae50 con 0x7f506815aa20 2024-04-01T01:56:03.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.418+0000 7f506f70d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f506815dff0 con 0x7f50680c6400 2024-04-01T01:56:03.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.418+0000 7f506d4a9640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f5068150b60 0x7f506806ee40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44732/0 (socket says 172.21.15.50:44732) 2024-04-01T01:56:03.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.418+0000 7f506d4a9640 1 -- 172.21.15.50:0/2176827811 learned_addr learned my addr 172.21.15.50:0/2176827811 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-04-01T01:56:03.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.418+0000 7f506dcaa640 1 --2- 172.21.15.50:0/2176827811 >> v2:172.21.15.97:3300/0 conn(0x7f50680c6400 0x7f50680c6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:03.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.418+0000 7f505ffff640 1 -- 172.21.15.50:0/2176827811 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 377493645 0 0) 0x7f506806f8d0 con 0x7f5068150b60 2024-04-01T01:56:03.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.418+0000 7f505ffff640 1 -- 172.21.15.50:0/2176827811 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5054003530 con 0x7f5068150b60 2024-04-01T01:56:03.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.418+0000 7f505ffff640 1 -- 172.21.15.50:0/2176827811 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3751698420 0 0) 0x7f5054003530 con 0x7f5068150b60 2024-04-01T01:56:03.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.418+0000 7f505ffff640 1 -- 172.21.15.50:0/2176827811 >> v2:172.21.15.97:3300/0 conn(0x7f50680c6400 msgr2=0x7f50680c6870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:56:03.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.418+0000 7f505ffff640 1 --2- 172.21.15.50:0/2176827811 >> v2:172.21.15.97:3300/0 conn(0x7f50680c6400 0x7f50680c6870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:03.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.418+0000 7f505ffff640 1 -- 172.21.15.50:0/2176827811 >> v1:172.21.15.97:6789/0 conn(0x7f506815aa20 legacy=0x7f5068071350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:03.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.418+0000 7f505ffff640 1 -- 172.21.15.50:0/2176827811 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f506815d6c0 con 0x7f5068150b60 2024-04-01T01:56:03.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.418+0000 7f505ffff640 1 -- 172.21.15.50:0/2176827811 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2779672543 0 0) 0x7f5064001680 con 0x7f5068150b60 2024-04-01T01:56:03.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.418+0000 7f505ffff640 1 -- 172.21.15.50:0/2176827811 >> v1:172.21.15.50:6789/0 conn(0x7f5068150b60 legacy=0x7f506806ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:03.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.418+0000 7f505ffff640 1 --2- 172.21.15.50:0/2176827811 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f50540039c0 0x7f5054003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:03.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.418+0000 7f505ffff640 1 --2- 172.21.15.50:0/2176827811 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5054004810 0x7f5054004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:03.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.418+0000 7f505ffff640 1 --2- 172.21.15.50:0/2176827811 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f50540051d0 0x7f505400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:03.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.418+0000 7f505ffff640 1 -- 172.21.15.50:0/2176827811 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f506815dff0 con 0x7f5054004810 2024-04-01T01:56:03.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.418+0000 7f505ffff640 1 -- 172.21.15.50:0/2176827811 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f505400c080 con 0x7f50540039c0 2024-04-01T01:56:03.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.418+0000 7f505ffff640 1 -- 172.21.15.50:0/2176827811 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f505400c280 con 0x7f50540051d0 2024-04-01T01:56:03.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.418+0000 7f506cca8640 1 --2- 172.21.15.50:0/2176827811 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5054004810 0x7f5054004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:03.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.418+0000 7f506d4a9640 1 --2- 172.21.15.50:0/2176827811 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f50540039c0 0x7f5054003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:03.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.418+0000 7f506cca8640 1 -- 172.21.15.50:0/2176827811 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f50540051d0 msgr2=0x7f505400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:56:03.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.418+0000 7f506dcaa640 1 --2- 172.21.15.50:0/2176827811 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f50540051d0 0x7f505400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:03.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.418+0000 7f506cca8640 1 --2- 172.21.15.50:0/2176827811 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f50540051d0 0x7f505400b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:03.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.418+0000 7f506cca8640 1 -- 172.21.15.50:0/2176827811 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f50540039c0 msgr2=0x7f5054003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:56:03.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.418+0000 7f506cca8640 1 --2- 172.21.15.50:0/2176827811 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f50540039c0 0x7f5054003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:03.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.418+0000 7f506cca8640 1 -- 172.21.15.50:0/2176827811 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5054003530 con 0x7f5054004810 2024-04-01T01:56:03.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.418+0000 7f506d4a9640 1 --2- 172.21.15.50:0/2176827811 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f50540039c0 0x7f5054003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T01:56:03.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.418+0000 7f506dcaa640 1 -- 172.21.15.50:0/2176827811 reap_dead start 2024-04-01T01:56:03.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.418+0000 7f506cca8640 1 --2- 172.21.15.50:0/2176827811 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5054004810 0x7f5054004c90 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5058001780 tx=0x7f505801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb8a2fa54c56f86f server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:56:03.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.418+0000 7f505ffff640 1 -- 172.21.15.50:0/2176827811 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50580a8050 con 0x7f5054004810 2024-04-01T01:56:03.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.418+0000 7f505ffff640 1 -- 172.21.15.50:0/2176827811 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50580052f0 con 0x7f5054004810 2024-04-01T01:56:03.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.418+0000 7f505ffff640 1 -- 172.21.15.50:0/2176827811 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50580013a0 con 0x7f5054004810 2024-04-01T01:56:03.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.422+0000 7f506f70d640 1 -- 172.21.15.50:0/2176827811 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5054004810 msgr2=0x7f5054004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:03.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.422+0000 7f506f70d640 1 --2- 172.21.15.50:0/2176827811 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5054004810 0x7f5054004c90 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5058001780 tx=0x7f505801c400 comp rx=0 tx=0).stop 2024-04-01T01:56:03.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.422+0000 7f506f70d640 1 -- 172.21.15.50:0/2176827811 shutdown_connections 2024-04-01T01:56:03.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.422+0000 7f506f70d640 1 --2- 172.21.15.50:0/2176827811 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5054004810 0x7f5054004c90 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:03.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.422+0000 7f506f70d640 1 -- 172.21.15.50:0/2176827811 >> 172.21.15.50:0/2176827811 conn(0x7f50680676f0 msgr2=0x7f50680c8010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:56:03.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.422+0000 7f506f70d640 1 -- 172.21.15.50:0/2176827811 shutdown_connections 2024-04-01T01:56:03.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.422+0000 7f506f70d640 1 -- 172.21.15.50:0/2176827811 wait complete. 2024-04-01T01:56:03.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.422+0000 7f506f70d640 1 Processor -- start 2024-04-01T01:56:03.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.422+0000 7f506f70d640 1 -- start start 2024-04-01T01:56:03.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.422+0000 7f506f70d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5054004810 0x7f50681e3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:03.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.422+0000 7f506f70d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5068159aa0 0x7f506815b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:03.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.422+0000 7f506f70d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f506815bca0 0x7f50681f3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:03.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.422+0000 7f506f70d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5068150f40 con 0x7f5054004810 2024-04-01T01:56:03.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.422+0000 7f506f70d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f506815dc80 con 0x7f506815bca0 2024-04-01T01:56:03.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.422+0000 7f506f70d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f50681510c0 con 0x7f5068159aa0 2024-04-01T01:56:03.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.422+0000 7f506d4a9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5054004810 0x7f50681e3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:03.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.422+0000 7f506d4a9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5054004810 0x7f50681e3bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50868/0 (socket says 172.21.15.50:50868) 2024-04-01T01:56:03.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.422+0000 7f506d4a9640 1 -- 172.21.15.50:0/4257500696 learned_addr learned my addr 172.21.15.50:0/4257500696 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T01:56:03.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.422+0000 7f506cca8640 1 --2- 172.21.15.50:0/4257500696 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5068159aa0 0x7f506815b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:03.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.422+0000 7f506dcaa640 1 --2- 172.21.15.50:0/4257500696 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f506815bca0 0x7f50681f3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:03.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.422+0000 7f506d4a9640 1 -- 172.21.15.50:0/4257500696 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5068159aa0 msgr2=0x7f506815b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:03.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.422+0000 7f506d4a9640 1 --2- 172.21.15.50:0/4257500696 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5068159aa0 0x7f506815b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:03.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.422+0000 7f506d4a9640 1 -- 172.21.15.50:0/4257500696 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f506815bca0 msgr2=0x7f50681f3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:03.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.422+0000 7f506d4a9640 1 --2- 172.21.15.50:0/4257500696 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f506815bca0 0x7f50681f3810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:03.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.422+0000 7f506d4a9640 1 -- 172.21.15.50:0/4257500696 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f506814f620 con 0x7f5054004810 2024-04-01T01:56:03.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.422+0000 7f506dcaa640 1 --2- 172.21.15.50:0/4257500696 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f506815bca0 0x7f50681f3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T01:56:03.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.422+0000 7f506d4a9640 1 --2- 172.21.15.50:0/4257500696 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5054004810 0x7f50681e3bc0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f506400e7b0 tx=0x7f506400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:56:03.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.422+0000 7f505dffb640 1 -- 172.21.15.50:0/4257500696 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f506400c870 con 0x7f5054004810 2024-04-01T01:56:03.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.422+0000 7f505dffb640 1 -- 172.21.15.50:0/4257500696 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5064018070 con 0x7f5054004810 2024-04-01T01:56:03.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.422+0000 7f505dffb640 1 -- 172.21.15.50:0/4257500696 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f506400cc30 con 0x7f5054004810 2024-04-01T01:56:03.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.422+0000 7f506f70d640 1 -- 172.21.15.50:0/4257500696 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5068158690 con 0x7f5054004810 2024-04-01T01:56:03.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.422+0000 7f506f70d640 1 -- 172.21.15.50:0/4257500696 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50681e4100 con 0x7f5054004810 2024-04-01T01:56:03.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.426+0000 7f506f70d640 1 -- 172.21.15.50:0/4257500696 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50681584b0 con 0x7f5054004810 2024-04-01T01:56:03.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.426+0000 7f505dffb640 1 -- 172.21.15.50:0/4257500696 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 87103+0+0 (secure 0 0 0) 0x7f506401d460 con 0x7f5054004810 2024-04-01T01:56:03.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.426+0000 7f505dffb640 1 --2- 172.21.15.50:0/4257500696 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f504c067450 0x7f504c069910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:03.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.426+0000 7f505dffb640 1 -- 172.21.15.50:0/4257500696 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f5064085550 con 0x7f5054004810 2024-04-01T01:56:03.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.426+0000 7f506cca8640 1 --2- 172.21.15.50:0/4257500696 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f504c067450 0x7f504c069910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:03.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.426+0000 7f506cca8640 1 --2- 172.21.15.50:0/4257500696 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f504c067450 0x7f504c069910 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5058001750 tx=0x7f50580011a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:56:03.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.430+0000 7f505dffb640 1 -- 172.21.15.50:0/4257500696 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+176632 (secure 0 0 0) 0x7f50681584b0 con 0x7f5054004810 2024-04-01T01:56:03.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.586+0000 7f506f70d640 1 -- 172.21.15.50:0/4257500696 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f5068068230 con 0x7f5054004810 2024-04-01T01:56:03.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.590+0000 7f505dffb640 1 -- 172.21.15.50:0/4257500696 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7f5064056260 con 0x7f5054004810 2024-04-01T01:56:03.591 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2024-04-01T01:56:03.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.590+0000 7f506f70d640 1 -- 172.21.15.50:0/4257500696 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f504c067450 msgr2=0x7f504c069910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:03.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.590+0000 7f506f70d640 1 --2- 172.21.15.50:0/4257500696 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f504c067450 0x7f504c069910 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5058001750 tx=0x7f50580011a0 comp rx=0 tx=0).stop 2024-04-01T01:56:03.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.590+0000 7f506f70d640 1 -- 172.21.15.50:0/4257500696 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5054004810 msgr2=0x7f50681e3bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:03.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.590+0000 7f506f70d640 1 --2- 172.21.15.50:0/4257500696 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5054004810 0x7f50681e3bc0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f506400e7b0 tx=0x7f506400ec70 comp rx=0 tx=0).stop 2024-04-01T01:56:03.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.590+0000 7f506f70d640 1 -- 172.21.15.50:0/4257500696 shutdown_connections 2024-04-01T01:56:03.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.590+0000 7f506f70d640 1 --2- 172.21.15.50:0/4257500696 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f504c067450 0x7f504c069910 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:03.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.590+0000 7f506f70d640 1 --2- 172.21.15.50:0/4257500696 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f506815bca0 0x7f50681f3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:03.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.590+0000 7f506f70d640 1 --2- 172.21.15.50:0/4257500696 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5068159aa0 0x7f506815b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:03.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.590+0000 7f506f70d640 1 --2- 172.21.15.50:0/4257500696 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5054004810 0x7f50681e3bc0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:03.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.590+0000 7f506f70d640 1 -- 172.21.15.50:0/4257500696 >> 172.21.15.50:0/4257500696 conn(0x7f50680676f0 msgr2=0x7f50680c7330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:56:03.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.590+0000 7f506f70d640 1 -- 172.21.15.50:0/4257500696 shutdown_connections 2024-04-01T01:56:03.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.590+0000 7f506f70d640 1 -- 172.21.15.50:0/4257500696 wait complete. 2024-04-01T01:56:03.610 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-01T01:56:03.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.726+0000 7f1eae64a640 1 Processor -- start 2024-04-01T01:56:03.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.726+0000 7f1eae64a640 1 -- start start 2024-04-01T01:56:03.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.726+0000 7f1eae64a640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f1ea80c1f10 0x7f1ea80c79f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:03.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.726+0000 7f1eae64a640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1ea8158150 0x7f1ea81585a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:03.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.726+0000 7f1eae64a640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ea8158ae0 con 0x7f1ea8151e50 2024-04-01T01:56:03.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.726+0000 7f1eae64a640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f1ea815b240 con 0x7f1ea8158150 2024-04-01T01:56:03.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.726+0000 7f1eae64a640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f1ea8157c50 con 0x7f1ea80c1f10 2024-04-01T01:56:03.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.726+0000 7f1eacbe7640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1ea8158150 0x7f1ea81585a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:03.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.726+0000 7f1eacbe7640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1ea8158150 0x7f1ea81585a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50870/0 (socket says 172.21.15.50:50870) 2024-04-01T01:56:03.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.726+0000 7f1eacbe7640 1 -- 172.21.15.50:0/1071528916 learned_addr learned my addr 172.21.15.50:0/1071528916 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T01:56:03.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.726+0000 7f1ea77fe640 1 --2- 172.21.15.50:0/1071528916 >> v2:172.21.15.97:3300/0 conn(0x7f1ea80c1f10 0x7f1ea80c79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:03.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.726+0000 7f1eacbe7640 1 -- 172.21.15.50:0/1071528916 >> v2:172.21.15.97:3300/0 conn(0x7f1ea80c1f10 msgr2=0x7f1ea80c79f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:56:03.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.726+0000 7f1eacbe7640 1 --2- 172.21.15.50:0/1071528916 >> v2:172.21.15.97:3300/0 conn(0x7f1ea80c1f10 0x7f1ea80c79f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:03.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.726+0000 7f1eacbe7640 1 -- 172.21.15.50:0/1071528916 >> v1:172.21.15.50:6789/0 conn(0x7f1ea8151e50 legacy=0x7f1ea806ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:03.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.726+0000 7f1eacbe7640 1 -- 172.21.15.50:0/1071528916 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ea815b490 con 0x7f1ea8158150 2024-04-01T01:56:03.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.730+0000 7f1eacbe7640 1 --2- 172.21.15.50:0/1071528916 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ea8158150 0x7f1ea81585a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1ea806c430 tx=0x7f1ea001ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acc3e72cafef56c4 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:56:03.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.730+0000 7f1ea6ffd640 1 -- 172.21.15.50:0/1071528916 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ea00b5070 con 0x7f1ea8158150 2024-04-01T01:56:03.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.730+0000 7f1ea6ffd640 1 -- 172.21.15.50:0/1071528916 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ea00a8a10 con 0x7f1ea8158150 2024-04-01T01:56:03.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.730+0000 7f1ea6ffd640 1 -- 172.21.15.50:0/1071528916 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ea00a8de0 con 0x7f1ea8158150 2024-04-01T01:56:03.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.730+0000 7f1eae64a640 1 -- 172.21.15.50:0/1071528916 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ea8158150 msgr2=0x7f1ea81585a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:03.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.730+0000 7f1eae64a640 1 --2- 172.21.15.50:0/1071528916 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ea8158150 0x7f1ea81585a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1ea806c430 tx=0x7f1ea001ed10 comp rx=0 tx=0).stop 2024-04-01T01:56:03.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.730+0000 7f1eae64a640 1 -- 172.21.15.50:0/1071528916 shutdown_connections 2024-04-01T01:56:03.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.730+0000 7f1eae64a640 1 --2- 172.21.15.50:0/1071528916 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ea8158150 0x7f1ea81585a0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:03.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.730+0000 7f1eae64a640 1 --2- 172.21.15.50:0/1071528916 >> v2:172.21.15.97:3300/0 conn(0x7f1ea80c1f10 0x7f1ea80c79f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:03.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.730+0000 7f1eae64a640 1 -- 172.21.15.50:0/1071528916 >> 172.21.15.50:0/1071528916 conn(0x7f1ea80676f0 msgr2=0x7f1ea80c8010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:56:03.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.730+0000 7f1eae64a640 1 -- 172.21.15.50:0/1071528916 shutdown_connections 2024-04-01T01:56:03.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.730+0000 7f1eae64a640 1 -- 172.21.15.50:0/1071528916 wait complete. 2024-04-01T01:56:03.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.730+0000 7f1eae64a640 1 Processor -- start 2024-04-01T01:56:03.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.730+0000 7f1eae64a640 1 -- start start 2024-04-01T01:56:03.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.730+0000 7f1eae64a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ea80c1f10 0x7f1ea81e4400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:03.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.730+0000 7f1eae64a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1ea8151e50 0x7f1ea814e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:03.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.730+0000 7f1eae64a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1ea8158150 0x7f1ea814e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:03.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.730+0000 7f1eae64a640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f1ea815bd30 con 0x7f1ea80c1f10 2024-04-01T01:56:03.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.730+0000 7f1eae64a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f1ea815ba50 con 0x7f1ea8158150 2024-04-01T01:56:03.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.730+0000 7f1eae64a640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f1ea815c010 con 0x7f1ea8151e50 2024-04-01T01:56:03.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.730+0000 7f1ea7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ea80c1f10 0x7f1ea81e4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:03.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.730+0000 7f1ea7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ea80c1f10 0x7f1ea81e4400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50880/0 (socket says 172.21.15.50:50880) 2024-04-01T01:56:03.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.730+0000 7f1ea7fff640 1 -- 172.21.15.50:0/2832620826 learned_addr learned my addr 172.21.15.50:0/2832620826 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T01:56:03.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.730+0000 7f1ea77fe640 1 --2- 172.21.15.50:0/2832620826 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1ea8151e50 0x7f1ea814e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:03.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.730+0000 7f1eacbe7640 1 --2- 172.21.15.50:0/2832620826 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1ea8158150 0x7f1ea814e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:03.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.730+0000 7f1ea7fff640 1 -- 172.21.15.50:0/2832620826 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1ea8151e50 msgr2=0x7f1ea814e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:03.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.730+0000 7f1ea7fff640 1 --2- 172.21.15.50:0/2832620826 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1ea8151e50 0x7f1ea814e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:03.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.730+0000 7f1ea7fff640 1 -- 172.21.15.50:0/2832620826 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1ea8158150 msgr2=0x7f1ea814e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:03.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.730+0000 7f1ea7fff640 1 --2- 172.21.15.50:0/2832620826 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1ea8158150 0x7f1ea814e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:03.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.730+0000 7f1ea7fff640 1 -- 172.21.15.50:0/2832620826 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ea814b500 con 0x7f1ea80c1f10 2024-04-01T01:56:03.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.730+0000 7f1ea7fff640 1 --2- 172.21.15.50:0/2832620826 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ea80c1f10 0x7f1ea81e4400 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1e9800c790 tx=0x7f1e9800cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:56:03.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.730+0000 7f1ea4ff9640 1 -- 172.21.15.50:0/2832620826 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e98016020 con 0x7f1ea80c1f10 2024-04-01T01:56:03.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.730+0000 7f1ea4ff9640 1 -- 172.21.15.50:0/2832620826 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e98006d60 con 0x7f1ea80c1f10 2024-04-01T01:56:03.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.730+0000 7f1eae64a640 1 -- 172.21.15.50:0/2832620826 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ea814b7a0 con 0x7f1ea80c1f10 2024-04-01T01:56:03.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.730+0000 7f1ea4ff9640 1 -- 172.21.15.50:0/2832620826 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e98003bc0 con 0x7f1ea80c1f10 2024-04-01T01:56:03.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.730+0000 7f1eae64a640 1 -- 172.21.15.50:0/2832620826 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ea8073090 con 0x7f1ea80c1f10 2024-04-01T01:56:03.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.734+0000 7f1eae64a640 1 -- 172.21.15.50:0/2832620826 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ea815aca0 con 0x7f1ea80c1f10 2024-04-01T01:56:03.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.734+0000 7f1ea4ff9640 1 -- 172.21.15.50:0/2832620826 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 87103+0+0 (secure 0 0 0) 0x7f1e9800a850 con 0x7f1ea80c1f10 2024-04-01T01:56:03.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.734+0000 7f1ea4ff9640 1 --2- 172.21.15.50:0/2832620826 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f1e88067420 0x7f1e880698e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:03.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.734+0000 7f1ea4ff9640 1 -- 172.21.15.50:0/2832620826 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f1e980853e0 con 0x7f1ea80c1f10 2024-04-01T01:56:03.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.734+0000 7f1ea77fe640 1 --2- 172.21.15.50:0/2832620826 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f1e88067420 0x7f1e880698e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:03.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.734+0000 7f1ea77fe640 1 --2- 172.21.15.50:0/2832620826 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f1e88067420 0x7f1e880698e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1ea814c1f0 tx=0x7f1e90008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:56:03.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.738+0000 7f1ea4ff9640 1 -- 172.21.15.50:0/2832620826 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+176632 (secure 0 0 0) 0x7f1e98020020 con 0x7f1ea80c1f10 2024-04-01T01:56:03.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.890+0000 7f1eae64a640 1 -- 172.21.15.50:0/2832620826 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f1ea80c9900 con 0x7f1ea80c1f10 2024-04-01T01:56:03.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.894+0000 7f1ea4ff9640 1 -- 172.21.15.50:0/2832620826 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7f1e98019310 con 0x7f1ea80c1f10 2024-04-01T01:56:03.895 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2024-04-01T01:56:03.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.894+0000 7f1eae64a640 1 -- 172.21.15.50:0/2832620826 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f1e88067420 msgr2=0x7f1e880698e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:03.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.894+0000 7f1eae64a640 1 --2- 172.21.15.50:0/2832620826 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f1e88067420 0x7f1e880698e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1ea814c1f0 tx=0x7f1e90008040 comp rx=0 tx=0).stop 2024-04-01T01:56:03.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.894+0000 7f1eae64a640 1 -- 172.21.15.50:0/2832620826 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ea80c1f10 msgr2=0x7f1ea81e4400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:03.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.894+0000 7f1eae64a640 1 --2- 172.21.15.50:0/2832620826 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ea80c1f10 0x7f1ea81e4400 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1e9800c790 tx=0x7f1e9800cc50 comp rx=0 tx=0).stop 2024-04-01T01:56:03.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.894+0000 7f1eae64a640 1 -- 172.21.15.50:0/2832620826 shutdown_connections 2024-04-01T01:56:03.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.894+0000 7f1eae64a640 1 --2- 172.21.15.50:0/2832620826 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f1e88067420 0x7f1e880698e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:03.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.894+0000 7f1eae64a640 1 --2- 172.21.15.50:0/2832620826 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1ea8158150 0x7f1ea814e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:03.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.894+0000 7f1eae64a640 1 --2- 172.21.15.50:0/2832620826 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1ea8151e50 0x7f1ea814e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:03.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.894+0000 7f1eae64a640 1 --2- 172.21.15.50:0/2832620826 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ea80c1f10 0x7f1ea81e4400 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:03.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.894+0000 7f1eae64a640 1 -- 172.21.15.50:0/2832620826 >> 172.21.15.50:0/2832620826 conn(0x7f1ea80676f0 msgr2=0x7f1ea80c9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:56:03.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.894+0000 7f1eae64a640 1 -- 172.21.15.50:0/2832620826 shutdown_connections 2024-04-01T01:56:03.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:03.894+0000 7f1eae64a640 1 -- 172.21.15.50:0/2832620826 wait complete. 2024-04-01T01:56:03.912 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-01T01:56:04.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.034+0000 7f68a24cb640 1 Processor -- start 2024-04-01T01:56:04.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.034+0000 7f68a24cb640 1 -- start start 2024-04-01T01:56:04.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.034+0000 7f68a24cb640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f689c151e50 0x7f689c0c79f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:04.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.034+0000 7f68a24cb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f689c0c1f10 0x7f689c06ee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:04.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.034+0000 7f68a24cb640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f689c157c50 con 0x7f689c06f380 2024-04-01T01:56:04.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.034+0000 7f68a24cb640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f689c15b240 con 0x7f689c0c1f10 2024-04-01T01:56:04.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.034+0000 7f68a24cb640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f689c15b490 con 0x7f689c151e50 2024-04-01T01:56:04.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.034+0000 7f689b7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f689c0c1f10 0x7f689c06ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:04.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.034+0000 7f68a0a68640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f689c06f380 0x7f689c158150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44750/0 (socket says 172.21.15.50:44750) 2024-04-01T01:56:04.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.034+0000 7f68a0a68640 1 -- 172.21.15.50:0/1707808469 learned_addr learned my addr 172.21.15.50:0/1707808469 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-04-01T01:56:04.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.034+0000 7f689bfff640 1 --2- 172.21.15.50:0/1707808469 >> v2:172.21.15.97:3300/0 conn(0x7f689c151e50 0x7f689c0c79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:04.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.034+0000 7f689b7fe640 1 -- 172.21.15.50:0/1707808469 >> v2:172.21.15.97:3300/0 conn(0x7f689c151e50 msgr2=0x7f689c0c79f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:56:04.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.034+0000 7f689b7fe640 1 --2- 172.21.15.50:0/1707808469 >> v2:172.21.15.97:3300/0 conn(0x7f689c151e50 0x7f689c0c79f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:04.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.034+0000 7f689b7fe640 1 -- 172.21.15.50:0/1707808469 >> v1:172.21.15.50:6789/0 conn(0x7f689c06f380 legacy=0x7f689c158150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:04.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.034+0000 7f689b7fe640 1 -- 172.21.15.50:0/1707808469 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f689c15b770 con 0x7f689c0c1f10 2024-04-01T01:56:04.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.034+0000 7f689affd640 1 -- 172.21.15.50:0/1707808469 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1508103528 0 0) 0x7f689c157c50 con 0x7f689c06f380 2024-04-01T01:56:04.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.038+0000 7f689b7fe640 1 --2- 172.21.15.50:0/1707808469 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f689c0c1f10 0x7f689c06ee40 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f689c15b3c0 tx=0x7f689001ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62e47892ffbfc12d server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:56:04.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.038+0000 7f689affd640 1 -- 172.21.15.50:0/1707808469 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68900b5070 con 0x7f689c0c1f10 2024-04-01T01:56:04.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.038+0000 7f689affd640 1 -- 172.21.15.50:0/1707808469 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68900a8950 con 0x7f689c0c1f10 2024-04-01T01:56:04.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.038+0000 7f689affd640 1 -- 172.21.15.50:0/1707808469 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68900a8d20 con 0x7f689c0c1f10 2024-04-01T01:56:04.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.038+0000 7f68a24cb640 1 -- 172.21.15.50:0/1707808469 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f689c0c1f10 msgr2=0x7f689c06ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:04.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.038+0000 7f68a24cb640 1 --2- 172.21.15.50:0/1707808469 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f689c0c1f10 0x7f689c06ee40 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f689c15b3c0 tx=0x7f689001ec50 comp rx=0 tx=0).stop 2024-04-01T01:56:04.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.038+0000 7f68a24cb640 1 -- 172.21.15.50:0/1707808469 shutdown_connections 2024-04-01T01:56:04.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.038+0000 7f68a24cb640 1 --2- 172.21.15.50:0/1707808469 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f689c0c1f10 0x7f689c06ee40 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:04.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.038+0000 7f68a24cb640 1 --2- 172.21.15.50:0/1707808469 >> v2:172.21.15.97:3300/0 conn(0x7f689c151e50 0x7f689c0c79f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:04.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.038+0000 7f68a24cb640 1 -- 172.21.15.50:0/1707808469 >> 172.21.15.50:0/1707808469 conn(0x7f689c0676f0 msgr2=0x7f689c0c8010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:56:04.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.038+0000 7f68a24cb640 1 -- 172.21.15.50:0/1707808469 shutdown_connections 2024-04-01T01:56:04.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.038+0000 7f68a24cb640 1 -- 172.21.15.50:0/1707808469 wait complete. 2024-04-01T01:56:04.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.038+0000 7f68a24cb640 1 Processor -- start 2024-04-01T01:56:04.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.038+0000 7f68a24cb640 1 -- start start 2024-04-01T01:56:04.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.038+0000 7f68a24cb640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f689c06f380 0x7f689c1ed670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:04.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.038+0000 7f68a24cb640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f689c0c1f10 0x7f689c1eeae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:04.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.038+0000 7f68a24cb640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f689c151e50 0x7f689c156ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:04.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.038+0000 7f68a24cb640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f689c15c010 con 0x7f689c0c1f10 2024-04-01T01:56:04.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.038+0000 7f68a24cb640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f689c15bd30 con 0x7f689c06f380 2024-04-01T01:56:04.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.038+0000 7f68a24cb640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f689c152230 con 0x7f689c151e50 2024-04-01T01:56:04.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.038+0000 7f689b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f689c0c1f10 0x7f689c1eeae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:04.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.038+0000 7f689b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f689c0c1f10 0x7f689c1eeae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50908/0 (socket says 172.21.15.50:50908) 2024-04-01T01:56:04.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.038+0000 7f689b7fe640 1 -- 172.21.15.50:0/331770928 learned_addr learned my addr 172.21.15.50:0/331770928 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T01:56:04.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.038+0000 7f689bfff640 1 --2- 172.21.15.50:0/331770928 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f689c06f380 0x7f689c1ed670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:04.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.038+0000 7f68a0a68640 1 --2- 172.21.15.50:0/331770928 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f689c151e50 0x7f689c156ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:04.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.038+0000 7f689b7fe640 1 -- 172.21.15.50:0/331770928 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f689c151e50 msgr2=0x7f689c156ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:04.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.038+0000 7f689b7fe640 1 --2- 172.21.15.50:0/331770928 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f689c151e50 0x7f689c156ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:04.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.038+0000 7f689b7fe640 1 -- 172.21.15.50:0/331770928 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f689c06f380 msgr2=0x7f689c1ed670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:04.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.038+0000 7f689b7fe640 1 --2- 172.21.15.50:0/331770928 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f689c06f380 0x7f689c1ed670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:04.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.038+0000 7f689b7fe640 1 -- 172.21.15.50:0/331770928 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f689c155b60 con 0x7f689c0c1f10 2024-04-01T01:56:04.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.038+0000 7f689b7fe640 1 --2- 172.21.15.50:0/331770928 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f689c0c1f10 0x7f689c1eeae0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f68900b3040 tx=0x7f689001b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:56:04.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.042+0000 7f6898ff9640 1 -- 172.21.15.50:0/331770928 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68900c0070 con 0x7f689c0c1f10 2024-04-01T01:56:04.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.042+0000 7f6898ff9640 1 -- 172.21.15.50:0/331770928 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6890004230 con 0x7f689c0c1f10 2024-04-01T01:56:04.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.042+0000 7f68a24cb640 1 -- 172.21.15.50:0/331770928 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f689c155e40 con 0x7f689c0c1f10 2024-04-01T01:56:04.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.042+0000 7f6898ff9640 1 -- 172.21.15.50:0/331770928 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68900b5040 con 0x7f689c0c1f10 2024-04-01T01:56:04.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.042+0000 7f68a24cb640 1 -- 172.21.15.50:0/331770928 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f689c156400 con 0x7f689c0c1f10 2024-04-01T01:56:04.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.042+0000 7f68a24cb640 1 -- 172.21.15.50:0/331770928 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f689c068230 con 0x7f689c0c1f10 2024-04-01T01:56:04.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.042+0000 7f6898ff9640 1 -- 172.21.15.50:0/331770928 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 87103+0+0 (secure 0 0 0) 0x7f68900c3070 con 0x7f689c0c1f10 2024-04-01T01:56:04.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.042+0000 7f6898ff9640 1 --2- 172.21.15.50:0/331770928 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f6888067420 0x7f68880698e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:04.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.042+0000 7f6898ff9640 1 -- 172.21.15.50:0/331770928 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f6890122020 con 0x7f689c0c1f10 2024-04-01T01:56:04.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.042+0000 7f689bfff640 1 --2- 172.21.15.50:0/331770928 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f6888067420 0x7f68880698e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:04.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.042+0000 7f689bfff640 1 --2- 172.21.15.50:0/331770928 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f6888067420 0x7f68880698e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f688c009ac0 tx=0x7f688c009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:56:04.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.046+0000 7f6898ff9640 1 -- 172.21.15.50:0/331770928 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+176632 (secure 0 0 0) 0x7f68900187b0 con 0x7f689c0c1f10 2024-04-01T01:56:04.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.202+0000 7f68a24cb640 1 -- 172.21.15.50:0/331770928 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f689c14d050 con 0x7f689c0c1f10 2024-04-01T01:56:04.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.202+0000 7f6898ff9640 1 -- 172.21.15.50:0/331770928 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7f68900f2770 con 0x7f689c0c1f10 2024-04-01T01:56:04.204 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2024-04-01T01:56:04.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.202+0000 7f68a24cb640 1 -- 172.21.15.50:0/331770928 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f6888067420 msgr2=0x7f68880698e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:04.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.202+0000 7f68a24cb640 1 --2- 172.21.15.50:0/331770928 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f6888067420 0x7f68880698e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f688c009ac0 tx=0x7f688c009190 comp rx=0 tx=0).stop 2024-04-01T01:56:04.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.202+0000 7f68a24cb640 1 -- 172.21.15.50:0/331770928 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f689c0c1f10 msgr2=0x7f689c1eeae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:04.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.202+0000 7f68a24cb640 1 --2- 172.21.15.50:0/331770928 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f689c0c1f10 0x7f689c1eeae0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f68900b3040 tx=0x7f689001b9f0 comp rx=0 tx=0).stop 2024-04-01T01:56:04.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.202+0000 7f68a24cb640 1 -- 172.21.15.50:0/331770928 shutdown_connections 2024-04-01T01:56:04.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.202+0000 7f68a24cb640 1 --2- 172.21.15.50:0/331770928 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f6888067420 0x7f68880698e0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:04.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.202+0000 7f68a24cb640 1 --2- 172.21.15.50:0/331770928 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f689c151e50 0x7f689c156ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:04.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.202+0000 7f68a24cb640 1 --2- 172.21.15.50:0/331770928 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f689c0c1f10 0x7f689c1eeae0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:04.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.202+0000 7f68a24cb640 1 --2- 172.21.15.50:0/331770928 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f689c06f380 0x7f689c1ed670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:04.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.202+0000 7f68a24cb640 1 -- 172.21.15.50:0/331770928 >> 172.21.15.50:0/331770928 conn(0x7f689c0676f0 msgr2=0x7f689c0c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:56:04.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.202+0000 7f68a24cb640 1 -- 172.21.15.50:0/331770928 shutdown_connections 2024-04-01T01:56:04.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.206+0000 7f68a24cb640 1 -- 172.21.15.50:0/331770928 wait complete. 2024-04-01T01:56:04.222 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-01T01:56:04.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.334+0000 7f47265b7640 1 Processor -- start 2024-04-01T01:56:04.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.334+0000 7f47265b7640 1 -- start start 2024-04-01T01:56:04.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.334+0000 7f47265b7640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4720151de0 0x7f4720157be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:04.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.334+0000 7f47265b7640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4720158120 0x7f4720162560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:04.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.334+0000 7f47265b7640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47200c30d0 con 0x7f47200c2900 2024-04-01T01:56:04.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.334+0000 7f47265b7640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f472015b370 con 0x7f4720158120 2024-04-01T01:56:04.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.334+0000 7f47265b7640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f472015c0f0 con 0x7f4720151de0 2024-04-01T01:56:04.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.334+0000 7f471f7fe640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f47200c2900 0x7f47200c5f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.50:50480/0 (socket says 172.21.15.50:50480) 2024-04-01T01:56:04.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.334+0000 7f4724b54640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4720158120 0x7f4720162560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:04.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.338+0000 7f471f7fe640 1 -- 172.21.15.50:0/2914128506 learned_addr learned my addr 172.21.15.50:0/2914128506 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-04-01T01:56:04.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.338+0000 7f471ffff640 1 --2- 172.21.15.50:0/2914128506 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4720151de0 0x7f4720157be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:04.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.338+0000 7f4724b54640 1 -- 172.21.15.50:0/2914128506 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4720151de0 msgr2=0x7f4720157be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:56:04.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.338+0000 7f4724b54640 1 --2- 172.21.15.50:0/2914128506 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4720151de0 0x7f4720157be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:04.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.338+0000 7f4724b54640 1 -- 172.21.15.50:0/2914128506 >> v1:172.21.15.97:6789/0 conn(0x7f47200c2900 legacy=0x7f47200c5f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:04.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.338+0000 7f4724b54640 1 -- 172.21.15.50:0/2914128506 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47200c2df0 con 0x7f4720158120 2024-04-01T01:56:04.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.338+0000 7f4724b54640 1 --2- 172.21.15.50:0/2914128506 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4720158120 0x7f4720162560 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4718009d90 tx=0x7f471801f150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e665130451f6499e server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:56:04.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.338+0000 7f471effd640 1 -- 172.21.15.50:0/2914128506 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47180b4070 con 0x7f4720158120 2024-04-01T01:56:04.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.338+0000 7f471effd640 1 -- 172.21.15.50:0/2914128506 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47180af600 con 0x7f4720158120 2024-04-01T01:56:04.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.338+0000 7f471effd640 1 -- 172.21.15.50:0/2914128506 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47180af9d0 con 0x7f4720158120 2024-04-01T01:56:04.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.338+0000 7f47265b7640 1 -- 172.21.15.50:0/2914128506 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4720158120 msgr2=0x7f4720162560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:04.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.338+0000 7f47265b7640 1 --2- 172.21.15.50:0/2914128506 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4720158120 0x7f4720162560 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4718009d90 tx=0x7f471801f150 comp rx=0 tx=0).stop 2024-04-01T01:56:04.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.338+0000 7f47265b7640 1 -- 172.21.15.50:0/2914128506 shutdown_connections 2024-04-01T01:56:04.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.338+0000 7f47265b7640 1 --2- 172.21.15.50:0/2914128506 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4720158120 0x7f4720162560 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:04.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.338+0000 7f47265b7640 1 --2- 172.21.15.50:0/2914128506 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4720151de0 0x7f4720157be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:04.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.338+0000 7f47265b7640 1 -- 172.21.15.50:0/2914128506 >> 172.21.15.50:0/2914128506 conn(0x7f4720067560 msgr2=0x7f472006b220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:56:04.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.338+0000 7f47265b7640 1 -- 172.21.15.50:0/2914128506 shutdown_connections 2024-04-01T01:56:04.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.338+0000 7f47265b7640 1 -- 172.21.15.50:0/2914128506 wait complete. 2024-04-01T01:56:04.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.342+0000 7f47265b7640 1 Processor -- start 2024-04-01T01:56:04.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.342+0000 7f47265b7640 1 -- start start 2024-04-01T01:56:04.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.342+0000 7f47265b7640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f47200c2900 0x7f47201ee700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:04.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.342+0000 7f47265b7640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4720151de0 0x7f47200ca090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:04.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.342+0000 7f47265b7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4720158120 0x7f4720149310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:04.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.342+0000 7f47265b7640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f472015bbd0 con 0x7f4720158120 2024-04-01T01:56:04.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.342+0000 7f47265b7640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f472015b8f0 con 0x7f4720151de0 2024-04-01T01:56:04.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.342+0000 7f47265b7640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f47200c88a0 con 0x7f47200c2900 2024-04-01T01:56:04.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.342+0000 7f4724b54640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4720158120 0x7f4720149310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:04.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.342+0000 7f4724b54640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4720158120 0x7f4720149310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50920/0 (socket says 172.21.15.50:50920) 2024-04-01T01:56:04.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.342+0000 7f4724b54640 1 -- 172.21.15.50:0/820773138 learned_addr learned my addr 172.21.15.50:0/820773138 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T01:56:04.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.342+0000 7f471f7fe640 1 --2- 172.21.15.50:0/820773138 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4720151de0 0x7f47200ca090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:04.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.342+0000 7f471ffff640 1 --2- 172.21.15.50:0/820773138 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f47200c2900 0x7f47201ee700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:04.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.342+0000 7f4724b54640 1 -- 172.21.15.50:0/820773138 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f47200c2900 msgr2=0x7f47201ee700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:04.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.342+0000 7f4724b54640 1 --2- 172.21.15.50:0/820773138 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f47200c2900 0x7f47201ee700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:04.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.342+0000 7f4724b54640 1 -- 172.21.15.50:0/820773138 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4720151de0 msgr2=0x7f47200ca090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:04.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.342+0000 7f4724b54640 1 --2- 172.21.15.50:0/820773138 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4720151de0 0x7f47200ca090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:04.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.342+0000 7f4724b54640 1 -- 172.21.15.50:0/820773138 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47200cabb0 con 0x7f4720158120 2024-04-01T01:56:04.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.342+0000 7f471ffff640 1 --2- 172.21.15.50:0/820773138 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f47200c2900 0x7f47201ee700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T01:56:04.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.342+0000 7f4724b54640 1 --2- 172.21.15.50:0/820773138 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4720158120 0x7f4720149310 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4718009d90 tx=0x7f471801bef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:56:04.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.342+0000 7f471cff9640 1 -- 172.21.15.50:0/820773138 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47180b4040 con 0x7f4720158120 2024-04-01T01:56:04.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.342+0000 7f471cff9640 1 -- 172.21.15.50:0/820773138 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47180c1070 con 0x7f4720158120 2024-04-01T01:56:04.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.342+0000 7f47265b7640 1 -- 172.21.15.50:0/820773138 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f472014b260 con 0x7f4720158120 2024-04-01T01:56:04.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.342+0000 7f471cff9640 1 -- 172.21.15.50:0/820773138 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4718009450 con 0x7f4720158120 2024-04-01T01:56:04.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.342+0000 7f47265b7640 1 -- 172.21.15.50:0/820773138 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f472014b820 con 0x7f4720158120 2024-04-01T01:56:04.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.342+0000 7f47265b7640 1 -- 172.21.15.50:0/820773138 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4720068230 con 0x7f4720158120 2024-04-01T01:56:04.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.342+0000 7f471cff9640 1 -- 172.21.15.50:0/820773138 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 87103+0+0 (secure 0 0 0) 0x7f47180ba6b0 con 0x7f4720158120 2024-04-01T01:56:04.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.346+0000 7f471cff9640 1 --2- 172.21.15.50:0/820773138 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f470c067450 0x7f470c069910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:04.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.346+0000 7f471cff9640 1 -- 172.21.15.50:0/820773138 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f4718123f80 con 0x7f4720158120 2024-04-01T01:56:04.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.346+0000 7f471ffff640 1 --2- 172.21.15.50:0/820773138 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f470c067450 0x7f470c069910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:04.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.346+0000 7f471ffff640 1 --2- 172.21.15.50:0/820773138 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f470c067450 0x7f470c069910 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4710009bb0 tx=0x7f4710008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:56:04.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.350+0000 7f471cff9640 1 -- 172.21.15.50:0/820773138 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+176632 (secure 0 0 0) 0x7f4718018cb0 con 0x7f4720158120 2024-04-01T01:56:04.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.546+0000 7f47265b7640 1 -- 172.21.15.50:0/820773138 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4720155830 con 0x7f4720158120 2024-04-01T01:56:04.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.546+0000 7f471cff9640 1 -- 172.21.15.50:0/820773138 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+6815 (secure 0 0 0) 0x7f47180f4c80 con 0x7f4720158120 2024-04-01T01:56:04.549 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-01T01:56:04.549 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6839/3495253895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6837","nonce":3495253895},{"type":"v1","addr":"172.21.15.97:6839","nonce":3495253895}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6838/1055159165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":1055159165},{"type":"v1","addr":"172.21.15.97:6838","nonce":1055159165}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4251,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/716162893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":716162893},{"type":"v1","addr":"172.21.15.50:6833","nonce":716162893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6836/194873808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":194873808},{"type":"v1","addr":"172.21.15.50:6836","nonce":194873808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4264,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/2250920298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6835","nonce":2250920298},{"type":"v1","addr":"172.21.15.50:6837","nonce":2250920298}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-01T01:55:48.563827+0000","modified":"2024-04-01T01:55:51.631137+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.97:6835/974386562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":974386562},{"type":"v1","addr":"172.21.15.97:6835","nonce":974386562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4279]},"id":1}]} 2024-04-01T01:56:04.549 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 7 2024-04-01T01:56:04.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.550+0000 7f47265b7640 1 -- 172.21.15.50:0/820773138 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f470c067450 msgr2=0x7f470c069910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:04.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.550+0000 7f47265b7640 1 --2- 172.21.15.50:0/820773138 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f470c067450 0x7f470c069910 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4710009bb0 tx=0x7f4710008040 comp rx=0 tx=0).stop 2024-04-01T01:56:04.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.550+0000 7f47265b7640 1 -- 172.21.15.50:0/820773138 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4720158120 msgr2=0x7f4720149310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:04.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.550+0000 7f47265b7640 1 --2- 172.21.15.50:0/820773138 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4720158120 0x7f4720149310 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4718009d90 tx=0x7f471801bef0 comp rx=0 tx=0).stop 2024-04-01T01:56:04.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.550+0000 7f47265b7640 1 -- 172.21.15.50:0/820773138 shutdown_connections 2024-04-01T01:56:04.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.550+0000 7f47265b7640 1 --2- 172.21.15.50:0/820773138 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f470c067450 0x7f470c069910 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:04.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.550+0000 7f47265b7640 1 --2- 172.21.15.50:0/820773138 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4720158120 0x7f4720149310 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:04.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.550+0000 7f47265b7640 1 --2- 172.21.15.50:0/820773138 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4720151de0 0x7f47200ca090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:04.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.550+0000 7f47265b7640 1 --2- 172.21.15.50:0/820773138 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f47200c2900 0x7f47201ee700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:04.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.550+0000 7f47265b7640 1 -- 172.21.15.50:0/820773138 >> 172.21.15.50:0/820773138 conn(0x7f4720067560 msgr2=0x7f4720146ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:56:04.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.550+0000 7f47265b7640 1 -- 172.21.15.50:0/820773138 shutdown_connections 2024-04-01T01:56:04.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.550+0000 7f47265b7640 1 -- 172.21.15.50:0/820773138 wait complete. 2024-04-01T01:56:04.568 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-01T01:56:04.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.690+0000 7f3ebfee0640 1 Processor -- start 2024-04-01T01:56:04.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.690+0000 7f3ebfee0640 1 -- start start 2024-04-01T01:56:04.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.690+0000 7f3ebfee0640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3eb80c8060 0x7f3eb80c84b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:04.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.690+0000 7f3ebfee0640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3eb815e1b0 con 0x7f3eb80c6270 2024-04-01T01:56:04.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.690+0000 7f3ebfee0640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3eb815a960 con 0x7f3eb8153f70 2024-04-01T01:56:04.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.690+0000 7f3ebfee0640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f3eb80c6ca0 con 0x7f3eb80c8060 2024-04-01T01:56:04.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.690+0000 7f3ebd47b640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f3eb80c6270 0x7f3eb80c7950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44758/0 (socket says 172.21.15.50:44758) 2024-04-01T01:56:04.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.690+0000 7f3ebd47b640 1 -- 172.21.15.50:0/826806307 learned_addr learned my addr 172.21.15.50:0/826806307 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-04-01T01:56:04.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.690+0000 7f3ebe47d640 1 --2- 172.21.15.50:0/826806307 >> v2:172.21.15.50:3300/0 conn(0x7f3eb80c8060 0x7f3eb80c84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:04.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.690+0000 7f3ebcc7a640 1 -- 172.21.15.50:0/826806307 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2899289133 0 0) 0x7f3eb815e1b0 con 0x7f3eb80c6270 2024-04-01T01:56:04.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.690+0000 7f3ebe47d640 1 -- 172.21.15.50:0/826806307 >> v1:172.21.15.97:6789/0 conn(0x7f3eb8153f70 legacy=0x7f3eb8071250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:04.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.690+0000 7f3ebe47d640 1 -- 172.21.15.50:0/826806307 >> v1:172.21.15.50:6789/0 conn(0x7f3eb80c6270 legacy=0x7f3eb80c7950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:04.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.690+0000 7f3ebe47d640 1 -- 172.21.15.50:0/826806307 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3eb815d3f0 con 0x7f3eb80c8060 2024-04-01T01:56:04.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.694+0000 7f3ebe47d640 1 --2- 172.21.15.50:0/826806307 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3eb80c8060 0x7f3eb80c84b0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3eb40097c0 tx=0x7f3eb401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e94f74e799ce02df server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:56:04.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.694+0000 7f3ebcc7a640 1 -- 172.21.15.50:0/826806307 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3eb40b0070 con 0x7f3eb80c8060 2024-04-01T01:56:04.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.694+0000 7f3ebcc7a640 1 -- 172.21.15.50:0/826806307 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3eb40ab600 con 0x7f3eb80c8060 2024-04-01T01:56:04.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.694+0000 7f3ebcc7a640 1 -- 172.21.15.50:0/826806307 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3eb40ab9d0 con 0x7f3eb80c8060 2024-04-01T01:56:04.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.694+0000 7f3ebfee0640 1 -- 172.21.15.50:0/826806307 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3eb80c8060 msgr2=0x7f3eb80c84b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:04.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.694+0000 7f3ebfee0640 1 --2- 172.21.15.50:0/826806307 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3eb80c8060 0x7f3eb80c84b0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3eb40097c0 tx=0x7f3eb401c4a0 comp rx=0 tx=0).stop 2024-04-01T01:56:04.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.694+0000 7f3ebfee0640 1 -- 172.21.15.50:0/826806307 shutdown_connections 2024-04-01T01:56:04.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.694+0000 7f3ebfee0640 1 --2- 172.21.15.50:0/826806307 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3eb80c8060 0x7f3eb80c84b0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:04.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.694+0000 7f3ebfee0640 1 -- 172.21.15.50:0/826806307 >> 172.21.15.50:0/826806307 conn(0x7f3eb8067560 msgr2=0x7f3eb806b220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:56:04.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.694+0000 7f3ebfee0640 1 -- 172.21.15.50:0/826806307 shutdown_connections 2024-04-01T01:56:04.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.694+0000 7f3ebfee0640 1 -- 172.21.15.50:0/826806307 wait complete. 2024-04-01T01:56:04.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.694+0000 7f3ebfee0640 1 Processor -- start 2024-04-01T01:56:04.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.694+0000 7f3ebfee0640 1 -- start start 2024-04-01T01:56:04.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.694+0000 7f3ebfee0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3eb80c6270 0x7f3eb8155390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:04.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.694+0000 7f3ebfee0640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3eb80c8060 0x7f3eb81f0e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:04.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.694+0000 7f3ebfee0640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3eb8153f70 0x7f3eb81463d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:04.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.694+0000 7f3ebfee0640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f3eb80c89f0 con 0x7f3eb80c6270 2024-04-01T01:56:04.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.694+0000 7f3ebfee0640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f3eb8071960 con 0x7f3eb8153f70 2024-04-01T01:56:04.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.694+0000 7f3ebfee0640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f3eb8154350 con 0x7f3eb80c8060 2024-04-01T01:56:04.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.694+0000 7f3ebdc7c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3eb80c6270 0x7f3eb8155390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:04.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.694+0000 7f3ebdc7c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3eb80c6270 0x7f3eb8155390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50938/0 (socket says 172.21.15.50:50938) 2024-04-01T01:56:04.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.694+0000 7f3ebdc7c640 1 -- 172.21.15.50:0/939668697 learned_addr learned my addr 172.21.15.50:0/939668697 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T01:56:04.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.694+0000 7f3ebe47d640 1 --2- 172.21.15.50:0/939668697 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3eb8153f70 0x7f3eb81463d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:04.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.694+0000 7f3ebd47b640 1 --2- 172.21.15.50:0/939668697 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3eb80c8060 0x7f3eb81f0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:04.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.694+0000 7f3ebdc7c640 1 -- 172.21.15.50:0/939668697 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3eb80c8060 msgr2=0x7f3eb81f0e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:04.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.694+0000 7f3ebdc7c640 1 --2- 172.21.15.50:0/939668697 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3eb80c8060 0x7f3eb81f0e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:04.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.694+0000 7f3ebdc7c640 1 -- 172.21.15.50:0/939668697 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3eb8153f70 msgr2=0x7f3eb81463d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:04.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.694+0000 7f3ebdc7c640 1 --2- 172.21.15.50:0/939668697 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3eb8153f70 0x7f3eb81463d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:04.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.694+0000 7f3ebdc7c640 1 -- 172.21.15.50:0/939668697 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3eb81f6e10 con 0x7f3eb80c6270 2024-04-01T01:56:04.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.694+0000 7f3ebd47b640 1 --2- 172.21.15.50:0/939668697 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3eb80c8060 0x7f3eb81f0e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T01:56:04.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.694+0000 7f3ebdc7c640 1 --2- 172.21.15.50:0/939668697 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3eb80c6270 0x7f3eb8155390 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3eb000c7a0 tx=0x7f3eb000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:56:04.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.698+0000 7f3eae7fc640 1 -- 172.21.15.50:0/939668697 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3eb0003b80 con 0x7f3eb80c6270 2024-04-01T01:56:04.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.698+0000 7f3eae7fc640 1 -- 172.21.15.50:0/939668697 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3eb0003d20 con 0x7f3eb80c6270 2024-04-01T01:56:04.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.698+0000 7f3ebfee0640 1 -- 172.21.15.50:0/939668697 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3eb81f70d0 con 0x7f3eb80c6270 2024-04-01T01:56:04.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.698+0000 7f3eae7fc640 1 -- 172.21.15.50:0/939668697 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3eb000aa90 con 0x7f3eb80c6270 2024-04-01T01:56:04.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.698+0000 7f3ebfee0640 1 -- 172.21.15.50:0/939668697 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3eb81f3380 con 0x7f3eb80c6270 2024-04-01T01:56:04.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.698+0000 7f3ebfee0640 1 -- 172.21.15.50:0/939668697 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3eb81f2e90 con 0x7f3eb80c6270 2024-04-01T01:56:04.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.698+0000 7f3eae7fc640 1 -- 172.21.15.50:0/939668697 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 87103+0+0 (secure 0 0 0) 0x7f3eb000ac30 con 0x7f3eb80c6270 2024-04-01T01:56:04.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.698+0000 7f3eae7fc640 1 --2- 172.21.15.50:0/939668697 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f3e9c067450 0x7f3e9c069910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:04.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.698+0000 7f3eae7fc640 1 -- 172.21.15.50:0/939668697 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f3eb00854c0 con 0x7f3eb80c6270 2024-04-01T01:56:04.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.698+0000 7f3ebd47b640 1 --2- 172.21.15.50:0/939668697 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f3e9c067450 0x7f3e9c069910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:04.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.698+0000 7f3ebd47b640 1 --2- 172.21.15.50:0/939668697 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f3e9c067450 0x7f3e9c069910 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3eb8073420 tx=0x7f3ea8007c60 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:56:04.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.702+0000 7f3eae7fc640 1 -- 172.21.15.50:0/939668697 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+176632 (secure 0 0 0) 0x7f3eb00562f0 con 0x7f3eb80c6270 2024-04-01T01:56:04.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.862+0000 7f3ebfee0640 1 -- 172.21.15.50:0/939668697 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3eb8068230 con 0x7f3eb80c6270 2024-04-01T01:56:04.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.866+0000 7f3eae7fc640 1 -- 172.21.15.50:0/939668697 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16525 (secure 0 0 0) 0x7f3eb0055bf0 con 0x7f3eb80c6270 2024-04-01T01:56:04.868 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-01T01:56:04.868 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":21,"fsid":"f67878a9-bc75-426b-962d-fa7bc2517f7d","created":"2024-04-01T01:55:31.562371+0000","modified":"2024-04-01T01:55:50.217570+0000","last_up_change":"2024-04-01T01:55:42.134502+0000","last_in_change":"2024-04-01T01:55:33.849789+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-01T01:55:42.134418+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-01T01:55:47.009880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-01T01:55:47.551516+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"81e8ca4f-bde8-419a-875f-73a1f4a641ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":4170468134},{"type":"v1","addr":"172.21.15.50:6825","nonce":4170468134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":4170468134},{"type":"v1","addr":"172.21.15.50:6827","nonce":4170468134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":4170468134},{"type":"v1","addr":"172.21.15.50:6831","nonce":4170468134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":4170468134},{"type":"v1","addr":"172.21.15.50:6829","nonce":4170468134}]},"public_addr":"172.21.15.50:6825/4170468134","cluster_addr":"172.21.15.50:6827/4170468134","heartbeat_back_addr":"172.21.15.50:6831/4170468134","heartbeat_front_addr":"172.21.15.50:6829/4170468134","state":["exists","up"]},{"osd":1,"uuid":"bd060ca0-7559-4d30-987c-62e59818431d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1794491326},{"type":"v1","addr":"172.21.15.50:6809","nonce":1794491326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1794491326},{"type":"v1","addr":"172.21.15.50:6811","nonce":1794491326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1794491326},{"type":"v1","addr":"172.21.15.50:6815","nonce":1794491326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1794491326},{"type":"v1","addr":"172.21.15.50:6813","nonce":1794491326}]},"public_addr":"172.21.15.50:6809/1794491326","cluster_addr":"172.21.15.50:6811/1794491326","heartbeat_back_addr":"172.21.15.50:6815/1794491326","heartbeat_front_addr":"172.21.15.50:6813/1794491326","state":["exists","up"]},{"osd":2,"uuid":"eac5d816-a281-4acd-aa7d-b96a8e0aa962","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":710247177},{"type":"v1","addr":"172.21.15.50:6801","nonce":710247177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":710247177},{"type":"v1","addr":"172.21.15.50:6803","nonce":710247177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":710247177},{"type":"v1","addr":"172.21.15.50:6807","nonce":710247177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":710247177},{"type":"v1","addr":"172.21.15.50:6805","nonce":710247177}]},"public_addr":"172.21.15.50:6801/710247177","cluster_addr":"172.21.15.50:6803/710247177","heartbeat_back_addr":"172.21.15.50:6807/710247177","heartbeat_front_addr":"172.21.15.50:6805/710247177","state":["exists","up"]},{"osd":3,"uuid":"12b23968-04a7-40b8-98c4-02b16ae28265","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":871680805},{"type":"v1","addr":"172.21.15.50:6817","nonce":871680805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":871680805},{"type":"v1","addr":"172.21.15.50:6819","nonce":871680805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":871680805},{"type":"v1","addr":"172.21.15.50:6823","nonce":871680805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":871680805},{"type":"v1","addr":"172.21.15.50:6821","nonce":871680805}]},"public_addr":"172.21.15.50:6817/871680805","cluster_addr":"172.21.15.50:6819/871680805","heartbeat_back_addr":"172.21.15.50:6823/871680805","heartbeat_front_addr":"172.21.15.50:6821/871680805","state":["exists","up"]},{"osd":4,"uuid":"0e6b1639-23b0-47d9-8b08-40c8ab6df818","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":1095319381},{"type":"v1","addr":"172.21.15.97:6801","nonce":1095319381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":1095319381},{"type":"v1","addr":"172.21.15.97:6803","nonce":1095319381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":1095319381},{"type":"v1","addr":"172.21.15.97:6807","nonce":1095319381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":1095319381},{"type":"v1","addr":"172.21.15.97:6805","nonce":1095319381}]},"public_addr":"172.21.15.97:6801/1095319381","cluster_addr":"172.21.15.97:6803/1095319381","heartbeat_back_addr":"172.21.15.97:6807/1095319381","heartbeat_front_addr":"172.21.15.97:6805/1095319381","state":["exists","up"]},{"osd":5,"uuid":"f0f876ef-0823-46e9-8fe4-9b7a64a94cee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":899031308},{"type":"v1","addr":"172.21.15.97:6817","nonce":899031308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":899031308},{"type":"v1","addr":"172.21.15.97:6819","nonce":899031308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":899031308},{"type":"v1","addr":"172.21.15.97:6823","nonce":899031308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":899031308},{"type":"v1","addr":"172.21.15.97:6821","nonce":899031308}]},"public_addr":"172.21.15.97:6817/899031308","cluster_addr":"172.21.15.97:6819/899031308","heartbeat_back_addr":"172.21.15.97:6823/899031308","heartbeat_front_addr":"172.21.15.97:6821/899031308","state":["exists","up"]},{"osd":6,"uuid":"d29a625e-83bf-40ef-a57e-618220b96b9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2224814961},{"type":"v1","addr":"172.21.15.97:6825","nonce":2224814961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2224814961},{"type":"v1","addr":"172.21.15.97:6827","nonce":2224814961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2224814961},{"type":"v1","addr":"172.21.15.97:6831","nonce":2224814961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2224814961},{"type":"v1","addr":"172.21.15.97:6829","nonce":2224814961}]},"public_addr":"172.21.15.97:6825/2224814961","cluster_addr":"172.21.15.97:6827/2224814961","heartbeat_back_addr":"172.21.15.97:6831/2224814961","heartbeat_front_addr":"172.21.15.97:6829/2224814961","state":["exists","up"]},{"osd":7,"uuid":"7bcfd8f1-7dc0-4013-af17-16da5a8d931d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":284968823},{"type":"v1","addr":"172.21.15.97:6809","nonce":284968823}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":284968823},{"type":"v1","addr":"172.21.15.97:6811","nonce":284968823}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6814","nonce":284968823},{"type":"v1","addr":"172.21.15.97:6815","nonce":284968823}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":284968823},{"type":"v1","addr":"172.21.15.97:6813","nonce":284968823}]},"public_addr":"172.21.15.97:6809/284968823","cluster_addr":"172.21.15.97:6811/284968823","heartbeat_back_addr":"172.21.15.97:6815/284968823","heartbeat_front_addr":"172.21.15.97:6813/284968823","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T01:55:39.369550+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T01:55:39.367285+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T01:55:39.458393+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T01:55:39.456179+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T01:55:39.463649+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T01:55:38.728924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T01:55:39.522411+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T01:55:39.432081+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-01T01:56:04.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.866+0000 7f3ebfee0640 1 -- 172.21.15.50:0/939668697 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f3e9c067450 msgr2=0x7f3e9c069910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:04.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.866+0000 7f3ebfee0640 1 --2- 172.21.15.50:0/939668697 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f3e9c067450 0x7f3e9c069910 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3eb8073420 tx=0x7f3ea8007c60 comp rx=0 tx=0).stop 2024-04-01T01:56:04.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.866+0000 7f3ebfee0640 1 -- 172.21.15.50:0/939668697 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3eb80c6270 msgr2=0x7f3eb8155390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:04.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.866+0000 7f3ebfee0640 1 --2- 172.21.15.50:0/939668697 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3eb80c6270 0x7f3eb8155390 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3eb000c7a0 tx=0x7f3eb000cc60 comp rx=0 tx=0).stop 2024-04-01T01:56:04.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.866+0000 7f3ebfee0640 1 -- 172.21.15.50:0/939668697 shutdown_connections 2024-04-01T01:56:04.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.866+0000 7f3ebfee0640 1 --2- 172.21.15.50:0/939668697 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f3e9c067450 0x7f3e9c069910 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:04.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.866+0000 7f3ebfee0640 1 --2- 172.21.15.50:0/939668697 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3eb8153f70 0x7f3eb81463d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:04.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.866+0000 7f3ebfee0640 1 --2- 172.21.15.50:0/939668697 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3eb80c8060 0x7f3eb81f0e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:04.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.866+0000 7f3ebfee0640 1 --2- 172.21.15.50:0/939668697 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3eb80c6270 0x7f3eb8155390 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:04.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.866+0000 7f3ebfee0640 1 -- 172.21.15.50:0/939668697 >> 172.21.15.50:0/939668697 conn(0x7f3eb8067560 msgr2=0x7f3eb80c9f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:56:04.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.870+0000 7f3ebfee0640 1 -- 172.21.15.50:0/939668697 shutdown_connections 2024-04-01T01:56:04.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:04.870+0000 7f3ebfee0640 1 -- 172.21.15.50:0/939668697 wait complete. 2024-04-01T01:56:04.888 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-01T01:55:42.134418+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-01T01:55:47.009880+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-01T01:55:47.551516+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-01T01:56:04.888 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-01T01:56:05.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.014+0000 7fe001c9a640 1 Processor -- start 2024-04-01T01:56:05.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.014+0000 7fe001c9a640 1 -- start start 2024-04-01T01:56:05.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.014+0000 7fe001c9a640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fdffc0c7750 0x7fdffc0723d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:05.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.014+0000 7fe001c9a640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdffc073790 con 0x7fdffc150d00 2024-04-01T01:56:05.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.014+0000 7fe001c9a640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdffc156e90 con 0x7fdffc1510e0 2024-04-01T01:56:05.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.014+0000 7fe001c9a640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fdffc157170 con 0x7fdffc0c7750 2024-04-01T01:56:05.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.014+0000 7fdffb7fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fdffc150d00 0x7fdffc073080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44772/0 (socket says 172.21.15.50:44772) 2024-04-01T01:56:05.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.014+0000 7fdffb7fe640 1 -- 172.21.15.50:0/2476261137 learned_addr learned my addr 172.21.15.50:0/2476261137 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-04-01T01:56:05.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.014+0000 7fdffbfff640 1 --2- 172.21.15.50:0/2476261137 >> v2:172.21.15.97:3300/0 conn(0x7fdffc0c7750 0x7fdffc0723d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:05.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.018+0000 7fdffa7fc640 1 -- 172.21.15.50:0/2476261137 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2461148583 0 0) 0x7fdffc073790 con 0x7fdffc150d00 2024-04-01T01:56:05.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.018+0000 7fdffa7fc640 1 -- 172.21.15.50:0/2476261137 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdfe4003530 con 0x7fdffc150d00 2024-04-01T01:56:05.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.018+0000 7fdffa7fc640 1 -- 172.21.15.50:0/2476261137 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 468062680 0 0) 0x7fdfe4003530 con 0x7fdffc150d00 2024-04-01T01:56:05.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.018+0000 7fdffa7fc640 1 -- 172.21.15.50:0/2476261137 >> v2:172.21.15.97:3300/0 conn(0x7fdffc0c7750 msgr2=0x7fdffc0723d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:56:05.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.018+0000 7fdffa7fc640 1 --2- 172.21.15.50:0/2476261137 >> v2:172.21.15.97:3300/0 conn(0x7fdffc0c7750 0x7fdffc0723d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:05.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.018+0000 7fdffa7fc640 1 -- 172.21.15.50:0/2476261137 >> v1:172.21.15.97:6789/0 conn(0x7fdffc1510e0 legacy=0x7fdffc06ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:05.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.018+0000 7fdffa7fc640 1 -- 172.21.15.50:0/2476261137 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdffc157450 con 0x7fdffc150d00 2024-04-01T01:56:05.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.018+0000 7fdffa7fc640 1 -- 172.21.15.50:0/2476261137 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2779672543 0 0) 0x7fdff4001a00 con 0x7fdffc150d00 2024-04-01T01:56:05.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.018+0000 7fdffa7fc640 1 -- 172.21.15.50:0/2476261137 >> v1:172.21.15.50:6789/0 conn(0x7fdffc150d00 legacy=0x7fdffc073080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:05.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.018+0000 7fdffa7fc640 1 --2- 172.21.15.50:0/2476261137 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdfe40039f0 0x7fdfe4003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:05.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.018+0000 7fdffa7fc640 1 --2- 172.21.15.50:0/2476261137 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdfe4004810 0x7fdfe4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:05.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.018+0000 7fdffa7fc640 1 --2- 172.21.15.50:0/2476261137 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfe40051d0 0x7fdfe400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:05.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.018+0000 7fdffa7fc640 1 -- 172.21.15.50:0/2476261137 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fdffc157170 con 0x7fdfe40051d0 2024-04-01T01:56:05.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.018+0000 7fdffa7fc640 1 -- 172.21.15.50:0/2476261137 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fdfe400c0a0 con 0x7fdfe40039f0 2024-04-01T01:56:05.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.018+0000 7fdffa7fc640 1 -- 172.21.15.50:0/2476261137 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fdfe400c2a0 con 0x7fdfe4004810 2024-04-01T01:56:05.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.018+0000 7fdffbfff640 1 --2- 172.21.15.50:0/2476261137 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfe40051d0 0x7fdfe400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:05.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.018+0000 7fdffaffd640 1 --2- 172.21.15.50:0/2476261137 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdfe4004810 0x7fdfe4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:05.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.018+0000 7fdffb7fe640 1 --2- 172.21.15.50:0/2476261137 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdfe40039f0 0x7fdfe4003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:05.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.018+0000 7fdffbfff640 1 -- 172.21.15.50:0/2476261137 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdfe4004810 msgr2=0x7fdfe4004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:56:05.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.018+0000 7fdffbfff640 1 --2- 172.21.15.50:0/2476261137 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdfe4004810 0x7fdfe4004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:05.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.018+0000 7fdffbfff640 1 -- 172.21.15.50:0/2476261137 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdfe40039f0 msgr2=0x7fdfe4003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:56:05.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.018+0000 7fdffbfff640 1 --2- 172.21.15.50:0/2476261137 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdfe40039f0 0x7fdfe4003e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:05.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.018+0000 7fdffbfff640 1 -- 172.21.15.50:0/2476261137 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfe4003530 con 0x7fdfe40051d0 2024-04-01T01:56:05.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.018+0000 7fdffbfff640 1 -- 172.21.15.50:0/2476261137 reap_dead start 2024-04-01T01:56:05.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.018+0000 7fdffbfff640 1 --2- 172.21.15.50:0/2476261137 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfe40051d0 0x7fdfe400b9d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fdfec009ae0 tx=0x7fdfec01cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ea0e3396ec9e541 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:56:05.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.018+0000 7fdffa7fc640 1 -- 172.21.15.50:0/2476261137 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfec0096b0 con 0x7fdfe40051d0 2024-04-01T01:56:05.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.018+0000 7fdffa7fc640 1 -- 172.21.15.50:0/2476261137 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfec004020 con 0x7fdfe40051d0 2024-04-01T01:56:05.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.018+0000 7fdffa7fc640 1 -- 172.21.15.50:0/2476261137 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfec004410 con 0x7fdfe40051d0 2024-04-01T01:56:05.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.018+0000 7fe001c9a640 1 -- 172.21.15.50:0/2476261137 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfe40051d0 msgr2=0x7fdfe400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:05.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.018+0000 7fe001c9a640 1 --2- 172.21.15.50:0/2476261137 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfe40051d0 0x7fdfe400b9d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fdfec009ae0 tx=0x7fdfec01cab0 comp rx=0 tx=0).stop 2024-04-01T01:56:05.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.018+0000 7fe001c9a640 1 -- 172.21.15.50:0/2476261137 shutdown_connections 2024-04-01T01:56:05.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.018+0000 7fe001c9a640 1 --2- 172.21.15.50:0/2476261137 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfe40051d0 0x7fdfe400b9d0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:05.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.018+0000 7fe001c9a640 1 -- 172.21.15.50:0/2476261137 >> 172.21.15.50:0/2476261137 conn(0x7fdffc0676f0 msgr2=0x7fdffc0c8010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:56:05.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.018+0000 7fe001c9a640 1 -- 172.21.15.50:0/2476261137 shutdown_connections 2024-04-01T01:56:05.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.018+0000 7fe001c9a640 1 -- 172.21.15.50:0/2476261137 wait complete. 2024-04-01T01:56:05.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.022+0000 7fe001c9a640 1 Processor -- start 2024-04-01T01:56:05.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.022+0000 7fe001c9a640 1 -- start start 2024-04-01T01:56:05.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.022+0000 7fe001c9a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdfe40051d0 0x7fdffc072630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:05.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.022+0000 7fe001c9a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdffc1ec210 0x7fdffc151a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:05.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.022+0000 7fe001c9a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdffc14f630 0x7fdffc151fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:05.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.022+0000 7fe001c9a640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fdffc156b80 con 0x7fdffc1ec210 2024-04-01T01:56:05.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.022+0000 7fe001c9a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fdffc157a10 con 0x7fdffc14f630 2024-04-01T01:56:05.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.022+0000 7fe001c9a640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fdffc151600 con 0x7fdfe40051d0 2024-04-01T01:56:05.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.022+0000 7fdffaffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdffc1ec210 0x7fdffc151a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:05.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.022+0000 7fdffaffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdffc1ec210 0x7fdffc151a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50960/0 (socket says 172.21.15.50:50960) 2024-04-01T01:56:05.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.022+0000 7fdffaffd640 1 -- 172.21.15.50:0/4119710927 learned_addr learned my addr 172.21.15.50:0/4119710927 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T01:56:05.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.022+0000 7fdffb7fe640 1 --2- 172.21.15.50:0/4119710927 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdfe40051d0 0x7fdffc072630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:05.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.022+0000 7fdffbfff640 1 --2- 172.21.15.50:0/4119710927 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdffc14f630 0x7fdffc151fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:05.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.022+0000 7fdffaffd640 1 -- 172.21.15.50:0/4119710927 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdfe40051d0 msgr2=0x7fdffc072630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:05.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.022+0000 7fdffaffd640 1 --2- 172.21.15.50:0/4119710927 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdfe40051d0 0x7fdffc072630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:05.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.022+0000 7fdffaffd640 1 -- 172.21.15.50:0/4119710927 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdffc14f630 msgr2=0x7fdffc151fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:05.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.022+0000 7fdffaffd640 1 --2- 172.21.15.50:0/4119710927 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdffc14f630 0x7fdffc151fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:05.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.022+0000 7fdffaffd640 1 -- 172.21.15.50:0/4119710927 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdffc1ec700 con 0x7fdffc1ec210 2024-04-01T01:56:05.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.022+0000 7fdffaffd640 1 --2- 172.21.15.50:0/4119710927 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdffc1ec210 0x7fdffc151a90 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fdff000e4e0 tx=0x7fdff000e9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:56:05.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.022+0000 7fdfe3fff640 1 -- 172.21.15.50:0/4119710927 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdff00052e0 con 0x7fdffc1ec210 2024-04-01T01:56:05.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.022+0000 7fdfe3fff640 1 -- 172.21.15.50:0/4119710927 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdff0018070 con 0x7fdffc1ec210 2024-04-01T01:56:05.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.022+0000 7fe001c9a640 1 -- 172.21.15.50:0/4119710927 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdffc153bf0 con 0x7fdffc1ec210 2024-04-01T01:56:05.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.022+0000 7fdfe3fff640 1 -- 172.21.15.50:0/4119710927 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdff0005480 con 0x7fdffc1ec210 2024-04-01T01:56:05.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.022+0000 7fe001c9a640 1 -- 172.21.15.50:0/4119710927 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdffc154170 con 0x7fdffc1ec210 2024-04-01T01:56:05.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.022+0000 7fe001c9a640 1 -- 172.21.15.50:0/4119710927 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdffc068230 con 0x7fdffc1ec210 2024-04-01T01:56:05.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.022+0000 7fdfe3fff640 1 -- 172.21.15.50:0/4119710927 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 87103+0+0 (secure 0 0 0) 0x7fdff0003840 con 0x7fdffc1ec210 2024-04-01T01:56:05.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.026+0000 7fdfe3fff640 1 --2- 172.21.15.50:0/4119710927 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fdfe8067450 0x7fdfe8069910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:05.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.026+0000 7fdfe3fff640 1 -- 172.21.15.50:0/4119710927 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fdff0085420 con 0x7fdffc1ec210 2024-04-01T01:56:05.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.026+0000 7fdffb7fe640 1 --2- 172.21.15.50:0/4119710927 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fdfe8067450 0x7fdfe8069910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:05.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.026+0000 7fdffb7fe640 1 --2- 172.21.15.50:0/4119710927 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fdfe8067450 0x7fdfe8069910 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fdff4005fd0 tx=0x7fdff4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:56:05.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.030+0000 7fdfe3fff640 1 -- 172.21.15.50:0/4119710927 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+176632 (secure 0 0 0) 0x7fdff0056090 con 0x7fdffc1ec210 2024-04-01T01:56:05.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.186+0000 7fe001c9a640 1 -- 172.21.15.50:0/4119710927 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fdffc154720 con 0x7fdffc1ec210 2024-04-01T01:56:05.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.186+0000 7fdfe3fff640 1 -- 172.21.15.50:0/4119710927 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7fdff0055990 con 0x7fdffc1ec210 2024-04-01T01:56:05.190 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2024-04-01T01:56:05.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.190+0000 7fe001c9a640 1 -- 172.21.15.50:0/4119710927 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fdfe8067450 msgr2=0x7fdfe8069910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:05.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.190+0000 7fe001c9a640 1 --2- 172.21.15.50:0/4119710927 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fdfe8067450 0x7fdfe8069910 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fdff4005fd0 tx=0x7fdff4009040 comp rx=0 tx=0).stop 2024-04-01T01:56:05.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.190+0000 7fe001c9a640 1 -- 172.21.15.50:0/4119710927 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdffc1ec210 msgr2=0x7fdffc151a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:05.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.190+0000 7fe001c9a640 1 --2- 172.21.15.50:0/4119710927 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdffc1ec210 0x7fdffc151a90 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fdff000e4e0 tx=0x7fdff000e9a0 comp rx=0 tx=0).stop 2024-04-01T01:56:05.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.190+0000 7fe001c9a640 1 -- 172.21.15.50:0/4119710927 shutdown_connections 2024-04-01T01:56:05.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.190+0000 7fe001c9a640 1 --2- 172.21.15.50:0/4119710927 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fdfe8067450 0x7fdfe8069910 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:05.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.190+0000 7fe001c9a640 1 --2- 172.21.15.50:0/4119710927 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdffc14f630 0x7fdffc151fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:05.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.190+0000 7fe001c9a640 1 --2- 172.21.15.50:0/4119710927 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdffc1ec210 0x7fdffc151a90 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:05.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.190+0000 7fe001c9a640 1 --2- 172.21.15.50:0/4119710927 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdfe40051d0 0x7fdffc072630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:05.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.190+0000 7fe001c9a640 1 -- 172.21.15.50:0/4119710927 >> 172.21.15.50:0/4119710927 conn(0x7fdffc0676f0 msgr2=0x7fdffc0c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:56:05.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.190+0000 7fe001c9a640 1 -- 172.21.15.50:0/4119710927 shutdown_connections 2024-04-01T01:56:05.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.190+0000 7fe001c9a640 1 -- 172.21.15.50:0/4119710927 wait complete. 2024-04-01T01:56:05.209 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-01T01:56:05.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.338+0000 7fe09393a640 1 Processor -- start 2024-04-01T01:56:05.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.338+0000 7fe09393a640 1 -- start start 2024-04-01T01:56:05.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.338+0000 7fe09393a640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe08c0c9250 0x7fe08c0c3b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:05.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.338+0000 7fe09393a640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe08c0c81a0 0x7fe08c0c9710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:05.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.338+0000 7fe09393a640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe08c0c8700 con 0x7fe08c152060 2024-04-01T01:56:05.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.338+0000 7fe09393a640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fe08c0c29e0 con 0x7fe08c0c9250 2024-04-01T01:56:05.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.338+0000 7fe09393a640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fe08c158960 con 0x7fe08c0c81a0 2024-04-01T01:56:05.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.338+0000 7fe090ed5640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe08c0c9250 0x7fe08c0c3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:05.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.338+0000 7fe090ed5640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe08c0c9250 0x7fe08c0c3b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50964/0 (socket says 172.21.15.50:50964) 2024-04-01T01:56:05.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.338+0000 7fe090ed5640 1 -- 172.21.15.50:0/1808050656 learned_addr learned my addr 172.21.15.50:0/1808050656 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T01:56:05.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.338+0000 7fe091ed7640 1 --2- 172.21.15.50:0/1808050656 >> v2:172.21.15.97:3300/0 conn(0x7fe08c0c81a0 0x7fe08c0c9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:05.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.338+0000 7fe090ed5640 1 -- 172.21.15.50:0/1808050656 >> v2:172.21.15.97:3300/0 conn(0x7fe08c0c81a0 msgr2=0x7fe08c0c9710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:56:05.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.338+0000 7fe090ed5640 1 --2- 172.21.15.50:0/1808050656 >> v2:172.21.15.97:3300/0 conn(0x7fe08c0c81a0 0x7fe08c0c9710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:05.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.338+0000 7fe090ed5640 1 -- 172.21.15.50:0/1808050656 >> v1:172.21.15.50:6789/0 conn(0x7fe08c152060 legacy=0x7fe08c0cd730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:05.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.338+0000 7fe090ed5640 1 -- 172.21.15.50:0/1808050656 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe08c157d50 con 0x7fe08c0c9250 2024-04-01T01:56:05.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.342+0000 7fe090ed5640 1 --2- 172.21.15.50:0/1808050656 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe08c0c9250 0x7fe08c0c3b90 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe08c158ae0 tx=0x7fe07c01ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3224b8fec948ad72 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:56:05.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.342+0000 7fe083fff640 1 -- 172.21.15.50:0/1808050656 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe07c0b5070 con 0x7fe08c0c9250 2024-04-01T01:56:05.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.342+0000 7fe083fff640 1 -- 172.21.15.50:0/1808050656 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe07c0a8a10 con 0x7fe08c0c9250 2024-04-01T01:56:05.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.342+0000 7fe083fff640 1 -- 172.21.15.50:0/1808050656 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe07c0a8de0 con 0x7fe08c0c9250 2024-04-01T01:56:05.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.342+0000 7fe09393a640 1 -- 172.21.15.50:0/1808050656 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe08c0c9250 msgr2=0x7fe08c0c3b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:05.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.342+0000 7fe09393a640 1 --2- 172.21.15.50:0/1808050656 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe08c0c9250 0x7fe08c0c3b90 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe08c158ae0 tx=0x7fe07c01ed10 comp rx=0 tx=0).stop 2024-04-01T01:56:05.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.342+0000 7fe09393a640 1 -- 172.21.15.50:0/1808050656 shutdown_connections 2024-04-01T01:56:05.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.342+0000 7fe09393a640 1 --2- 172.21.15.50:0/1808050656 >> v2:172.21.15.97:3300/0 conn(0x7fe08c0c81a0 0x7fe08c0c9710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:05.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.342+0000 7fe09393a640 1 --2- 172.21.15.50:0/1808050656 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe08c0c9250 0x7fe08c0c3b90 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:05.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.342+0000 7fe09393a640 1 -- 172.21.15.50:0/1808050656 >> 172.21.15.50:0/1808050656 conn(0x7fe08c06f650 msgr2=0x7fe08c06b220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:56:05.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.342+0000 7fe09393a640 1 -- 172.21.15.50:0/1808050656 shutdown_connections 2024-04-01T01:56:05.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.342+0000 7fe09393a640 1 -- 172.21.15.50:0/1808050656 wait complete. 2024-04-01T01:56:05.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.342+0000 7fe09393a640 1 Processor -- start 2024-04-01T01:56:05.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.342+0000 7fe09393a640 1 -- start start 2024-04-01T01:56:05.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.342+0000 7fe09393a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe08c0c81a0 0x7fe08c1f0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:05.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.342+0000 7fe09393a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe08c0c9250 0x7fe08c0cb800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:05.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.342+0000 7fe09393a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe08c152060 0x7fe08c06cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:05.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.342+0000 7fe09393a640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe08c1585f0 con 0x7fe08c0c9250 2024-04-01T01:56:05.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.342+0000 7fe09393a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fe08c158310 con 0x7fe08c0c81a0 2024-04-01T01:56:05.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.342+0000 7fe09393a640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fe08c0cde40 con 0x7fe08c152060 2024-04-01T01:56:05.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.342+0000 7fe090ed5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe08c0c9250 0x7fe08c0cb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:05.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.342+0000 7fe090ed5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe08c0c9250 0x7fe08c0cb800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50974/0 (socket says 172.21.15.50:50974) 2024-04-01T01:56:05.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.342+0000 7fe090ed5640 1 -- 172.21.15.50:0/1373614248 learned_addr learned my addr 172.21.15.50:0/1373614248 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T01:56:05.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.342+0000 7fe091ed7640 1 --2- 172.21.15.50:0/1373614248 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe08c152060 0x7fe08c06cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:05.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.346+0000 7fe0916d6640 1 --2- 172.21.15.50:0/1373614248 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe08c0c81a0 0x7fe08c1f0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:05.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.346+0000 7fe090ed5640 1 -- 172.21.15.50:0/1373614248 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe08c152060 msgr2=0x7fe08c06cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:05.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.346+0000 7fe090ed5640 1 --2- 172.21.15.50:0/1373614248 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe08c152060 0x7fe08c06cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:05.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.346+0000 7fe090ed5640 1 -- 172.21.15.50:0/1373614248 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe08c0c81a0 msgr2=0x7fe08c1f0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:05.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.346+0000 7fe090ed5640 1 --2- 172.21.15.50:0/1373614248 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe08c0c81a0 0x7fe08c1f0420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:05.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.346+0000 7fe090ed5640 1 -- 172.21.15.50:0/1373614248 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe08c1f0b40 con 0x7fe08c0c9250 2024-04-01T01:56:05.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.346+0000 7fe090ed5640 1 --2- 172.21.15.50:0/1373614248 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe08c0c9250 0x7fe08c0cb800 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe07c01b920 tx=0x7fe07c01bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:56:05.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.346+0000 7fe081ffb640 1 -- 172.21.15.50:0/1373614248 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe07c0b5070 con 0x7fe08c0c9250 2024-04-01T01:56:05.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.346+0000 7fe081ffb640 1 -- 172.21.15.50:0/1373614248 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe07c0b0b40 con 0x7fe08c0c9250 2024-04-01T01:56:05.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.346+0000 7fe09393a640 1 -- 172.21.15.50:0/1373614248 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe08c1f0e20 con 0x7fe08c0c9250 2024-04-01T01:56:05.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.346+0000 7fe081ffb640 1 -- 172.21.15.50:0/1373614248 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe07c0bb410 con 0x7fe08c0c9250 2024-04-01T01:56:05.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.346+0000 7fe09393a640 1 -- 172.21.15.50:0/1373614248 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe08c06c700 con 0x7fe08c0c9250 2024-04-01T01:56:05.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.346+0000 7fe09393a640 1 -- 172.21.15.50:0/1373614248 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe08c1f4990 con 0x7fe08c0c9250 2024-04-01T01:56:05.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.346+0000 7fe081ffb640 1 -- 172.21.15.50:0/1373614248 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 87103+0+0 (secure 0 0 0) 0x7fe07c0c2060 con 0x7fe08c0c9250 2024-04-01T01:56:05.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.346+0000 7fe081ffb640 1 --2- 172.21.15.50:0/1373614248 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fe070067420 0x7fe0700698e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:05.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.346+0000 7fe081ffb640 1 -- 172.21.15.50:0/1373614248 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fe07c1228b0 con 0x7fe08c0c9250 2024-04-01T01:56:05.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.346+0000 7fe0916d6640 1 --2- 172.21.15.50:0/1373614248 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fe070067420 0x7fe0700698e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:05.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.346+0000 7fe0916d6640 1 --2- 172.21.15.50:0/1373614248 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fe070067420 0x7fe0700698e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe088001cb0 tx=0x7fe088009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:56:05.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.350+0000 7fe081ffb640 1 -- 172.21.15.50:0/1373614248 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+176632 (secure 0 0 0) 0x7fe07c018870 con 0x7fe08c0c9250 2024-04-01T01:56:05.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.506+0000 7fe09393a640 1 -- 172.21.15.50:0/1373614248 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fe08c068940 con 0x7fe08c0c9250 2024-04-01T01:56:05.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.506+0000 7fe081ffb640 1 -- 172.21.15.50:0/1373614248 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7fe07c0f3650 con 0x7fe08c0c9250 2024-04-01T01:56:05.507 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2024-04-01T01:56:05.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.506+0000 7fe09393a640 1 -- 172.21.15.50:0/1373614248 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fe070067420 msgr2=0x7fe0700698e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:05.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.506+0000 7fe09393a640 1 --2- 172.21.15.50:0/1373614248 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fe070067420 0x7fe0700698e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe088001cb0 tx=0x7fe088009040 comp rx=0 tx=0).stop 2024-04-01T01:56:05.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.506+0000 7fe09393a640 1 -- 172.21.15.50:0/1373614248 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe08c0c9250 msgr2=0x7fe08c0cb800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:05.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.506+0000 7fe09393a640 1 --2- 172.21.15.50:0/1373614248 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe08c0c9250 0x7fe08c0cb800 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe07c01b920 tx=0x7fe07c01bab0 comp rx=0 tx=0).stop 2024-04-01T01:56:05.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.506+0000 7fe09393a640 1 -- 172.21.15.50:0/1373614248 shutdown_connections 2024-04-01T01:56:05.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.506+0000 7fe09393a640 1 --2- 172.21.15.50:0/1373614248 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fe070067420 0x7fe0700698e0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:05.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.506+0000 7fe09393a640 1 --2- 172.21.15.50:0/1373614248 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe08c152060 0x7fe08c06cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:05.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.506+0000 7fe09393a640 1 --2- 172.21.15.50:0/1373614248 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe08c0c9250 0x7fe08c0cb800 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:05.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.506+0000 7fe09393a640 1 --2- 172.21.15.50:0/1373614248 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe08c0c81a0 0x7fe08c1f0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:05.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.506+0000 7fe09393a640 1 -- 172.21.15.50:0/1373614248 >> 172.21.15.50:0/1373614248 conn(0x7fe08c06f650 msgr2=0x7fe08c0c96c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:56:05.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.506+0000 7fe09393a640 1 -- 172.21.15.50:0/1373614248 shutdown_connections 2024-04-01T01:56:05.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.506+0000 7fe09393a640 1 -- 172.21.15.50:0/1373614248 wait complete. 2024-04-01T01:56:05.525 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-01T01:56:05.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.638+0000 7fb1f815f640 1 Processor -- start 2024-04-01T01:56:05.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.638+0000 7fb1f815f640 1 -- start start 2024-04-01T01:56:05.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.638+0000 7fb1f815f640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb1f0150d00 0x7fb1f0073080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:05.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.638+0000 7fb1f815f640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1f0156e90 con 0x7fb1f01510e0 2024-04-01T01:56:05.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.638+0000 7fb1f815f640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1f0157170 con 0x7fb1f00c7750 2024-04-01T01:56:05.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.638+0000 7fb1f815f640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fb1f0157450 con 0x7fb1f0150d00 2024-04-01T01:56:05.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.638+0000 7fb1f56fa640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fb1f01510e0 0x7fb1f006ee40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44790/0 (socket says 172.21.15.50:44790) 2024-04-01T01:56:05.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.638+0000 7fb1f5efb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb1f0150d00 0x7fb1f0073080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:05.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.638+0000 7fb1f56fa640 1 -- 172.21.15.50:0/3033871039 learned_addr learned my addr 172.21.15.50:0/3033871039 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-04-01T01:56:05.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.638+0000 7fb1f4ef9640 1 -- 172.21.15.50:0/3033871039 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1619657080 0 0) 0x7fb1f0156e90 con 0x7fb1f01510e0 2024-04-01T01:56:05.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.638+0000 7fb1f4ef9640 1 -- 172.21.15.50:0/3033871039 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb1dc003530 con 0x7fb1f01510e0 2024-04-01T01:56:05.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.638+0000 7fb1f5efb640 1 -- 172.21.15.50:0/3033871039 >> v1:172.21.15.97:6789/0 conn(0x7fb1f00c7750 legacy=0x7fb1f00723d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:05.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.638+0000 7fb1f5efb640 1 -- 172.21.15.50:0/3033871039 >> v1:172.21.15.50:6789/0 conn(0x7fb1f01510e0 legacy=0x7fb1f006ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:05.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.638+0000 7fb1f5efb640 1 -- 172.21.15.50:0/3033871039 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1f0157730 con 0x7fb1f0150d00 2024-04-01T01:56:05.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.642+0000 7fb1f5efb640 1 --2- 172.21.15.50:0/3033871039 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1f0150d00 0x7fb1f0073080 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb1ec009820 tx=0x7fb1ec01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6b38bce50742fda server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:56:05.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.642+0000 7fb1f4ef9640 1 -- 172.21.15.50:0/3033871039 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1ec0b1070 con 0x7fb1f0150d00 2024-04-01T01:56:05.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.642+0000 7fb1f4ef9640 1 -- 172.21.15.50:0/3033871039 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1ec0ac5f0 con 0x7fb1f0150d00 2024-04-01T01:56:05.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.642+0000 7fb1f4ef9640 1 -- 172.21.15.50:0/3033871039 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1ec0ac9a0 con 0x7fb1f0150d00 2024-04-01T01:56:05.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.642+0000 7fb1f815f640 1 -- 172.21.15.50:0/3033871039 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1f0150d00 msgr2=0x7fb1f0073080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:05.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.642+0000 7fb1f815f640 1 --2- 172.21.15.50:0/3033871039 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1f0150d00 0x7fb1f0073080 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb1ec009820 tx=0x7fb1ec01c480 comp rx=0 tx=0).stop 2024-04-01T01:56:05.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.642+0000 7fb1f815f640 1 -- 172.21.15.50:0/3033871039 shutdown_connections 2024-04-01T01:56:05.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.642+0000 7fb1f815f640 1 --2- 172.21.15.50:0/3033871039 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1f0150d00 0x7fb1f0073080 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:05.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.642+0000 7fb1f815f640 1 -- 172.21.15.50:0/3033871039 >> 172.21.15.50:0/3033871039 conn(0x7fb1f00676f0 msgr2=0x7fb1f00c8010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:56:05.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.642+0000 7fb1f815f640 1 -- 172.21.15.50:0/3033871039 shutdown_connections 2024-04-01T01:56:05.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.642+0000 7fb1f815f640 1 -- 172.21.15.50:0/3033871039 wait complete. 2024-04-01T01:56:05.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.642+0000 7fb1f815f640 1 Processor -- start 2024-04-01T01:56:05.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.642+0000 7fb1f815f640 1 -- start start 2024-04-01T01:56:05.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.642+0000 7fb1f815f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1f00c7750 0x7fb1f00c21e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:05.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.642+0000 7fb1f815f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb1f0150d00 0x7fb1f014f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:05.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.642+0000 7fb1f815f640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb1f0146870 0x7fb1f01efe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:05.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.642+0000 7fb1f815f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb1f0073740 con 0x7fb1f00c7750 2024-04-01T01:56:05.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.642+0000 7fb1f815f640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fb1f00735c0 con 0x7fb1f0150d00 2024-04-01T01:56:05.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.642+0000 7fb1f815f640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fb1f006b220 con 0x7fb1f0146870 2024-04-01T01:56:05.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.642+0000 7fb1f5efb640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1f00c7750 0x7fb1f00c21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:05.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.642+0000 7fb1f5efb640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1f00c7750 0x7fb1f00c21e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50988/0 (socket says 172.21.15.50:50988) 2024-04-01T01:56:05.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.642+0000 7fb1f5efb640 1 -- 172.21.15.50:0/541977412 learned_addr learned my addr 172.21.15.50:0/541977412 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T01:56:05.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.642+0000 7fb1f66fc640 1 --2- 172.21.15.50:0/541977412 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb1f0146870 0x7fb1f01efe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:05.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.642+0000 7fb1f56fa640 1 --2- 172.21.15.50:0/541977412 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb1f0150d00 0x7fb1f014f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:05.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.642+0000 7fb1f5efb640 1 -- 172.21.15.50:0/541977412 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb1f0146870 msgr2=0x7fb1f01efe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:05.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.642+0000 7fb1f5efb640 1 --2- 172.21.15.50:0/541977412 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb1f0146870 0x7fb1f01efe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:05.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.642+0000 7fb1f5efb640 1 -- 172.21.15.50:0/541977412 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb1f0150d00 msgr2=0x7fb1f014f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:05.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.642+0000 7fb1f5efb640 1 --2- 172.21.15.50:0/541977412 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb1f0150d00 0x7fb1f014f230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:05.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.642+0000 7fb1f5efb640 1 -- 172.21.15.50:0/541977412 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1f0159230 con 0x7fb1f00c7750 2024-04-01T01:56:05.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.642+0000 7fb1f5efb640 1 --2- 172.21.15.50:0/541977412 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1f00c7750 0x7fb1f00c21e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb1ec009820 tx=0x7fb1ec01acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:56:05.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.642+0000 7fb1e67fc640 1 -- 172.21.15.50:0/541977412 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1ec0b1070 con 0x7fb1f00c7750 2024-04-01T01:56:05.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.642+0000 7fb1e67fc640 1 -- 172.21.15.50:0/541977412 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1ec0bb070 con 0x7fb1f00c7750 2024-04-01T01:56:05.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.642+0000 7fb1f815f640 1 -- 172.21.15.50:0/541977412 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1f015ac40 con 0x7fb1f00c7750 2024-04-01T01:56:05.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.642+0000 7fb1e67fc640 1 -- 172.21.15.50:0/541977412 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1ec0acdb0 con 0x7fb1f00c7750 2024-04-01T01:56:05.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.642+0000 7fb1f815f640 1 -- 172.21.15.50:0/541977412 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1f0158020 con 0x7fb1f00c7750 2024-04-01T01:56:05.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.646+0000 7fb1f815f640 1 -- 172.21.15.50:0/541977412 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1f0068230 con 0x7fb1f00c7750 2024-04-01T01:56:05.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.646+0000 7fb1e67fc640 1 -- 172.21.15.50:0/541977412 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 87103+0+0 (secure 0 0 0) 0x7fb1ec0ac470 con 0x7fb1f00c7750 2024-04-01T01:56:05.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.646+0000 7fb1e67fc640 1 --2- 172.21.15.50:0/541977412 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fb1d4067420 0x7fb1d40698e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:05.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.646+0000 7fb1e67fc640 1 -- 172.21.15.50:0/541977412 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fb1ec11f610 con 0x7fb1f00c7750 2024-04-01T01:56:05.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.646+0000 7fb1f56fa640 1 --2- 172.21.15.50:0/541977412 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fb1d4067420 0x7fb1d40698e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:05.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.646+0000 7fb1f56fa640 1 --2- 172.21.15.50:0/541977412 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fb1d4067420 0x7fb1d40698e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb1f014fbe0 tx=0x7fb1e0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:56:05.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.650+0000 7fb1e67fc640 1 -- 172.21.15.50:0/541977412 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+176632 (secure 0 0 0) 0x7fb1ec0a9070 con 0x7fb1f00c7750 2024-04-01T01:56:05.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.802+0000 7fb1f815f640 1 -- 172.21.15.50:0/541977412 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fb1f0158de0 con 0x7fb1f00c7750 2024-04-01T01:56:05.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.802+0000 7fb1e67fc640 1 -- 172.21.15.50:0/541977412 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7fb1ec016070 con 0x7fb1f00c7750 2024-04-01T01:56:05.806 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2024-04-01T01:56:05.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.806+0000 7fb1f815f640 1 -- 172.21.15.50:0/541977412 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fb1d4067420 msgr2=0x7fb1d40698e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:05.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.806+0000 7fb1f815f640 1 --2- 172.21.15.50:0/541977412 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fb1d4067420 0x7fb1d40698e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb1f014fbe0 tx=0x7fb1e0009040 comp rx=0 tx=0).stop 2024-04-01T01:56:05.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.806+0000 7fb1f815f640 1 -- 172.21.15.50:0/541977412 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1f00c7750 msgr2=0x7fb1f00c21e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:05.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.806+0000 7fb1f815f640 1 --2- 172.21.15.50:0/541977412 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1f00c7750 0x7fb1f00c21e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb1ec009820 tx=0x7fb1ec01acc0 comp rx=0 tx=0).stop 2024-04-01T01:56:05.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.806+0000 7fb1f815f640 1 -- 172.21.15.50:0/541977412 shutdown_connections 2024-04-01T01:56:05.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.806+0000 7fb1f815f640 1 --2- 172.21.15.50:0/541977412 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fb1d4067420 0x7fb1d40698e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:05.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.806+0000 7fb1f815f640 1 --2- 172.21.15.50:0/541977412 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb1f0146870 0x7fb1f01efe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:05.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.806+0000 7fb1f815f640 1 --2- 172.21.15.50:0/541977412 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb1f0150d00 0x7fb1f014f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:05.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.806+0000 7fb1f815f640 1 --2- 172.21.15.50:0/541977412 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1f00c7750 0x7fb1f00c21e0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:05.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.806+0000 7fb1f815f640 1 -- 172.21.15.50:0/541977412 >> 172.21.15.50:0/541977412 conn(0x7fb1f00676f0 msgr2=0x7fb1f006b5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:56:05.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.806+0000 7fb1f815f640 1 -- 172.21.15.50:0/541977412 shutdown_connections 2024-04-01T01:56:05.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.806+0000 7fb1f815f640 1 -- 172.21.15.50:0/541977412 wait complete. 2024-04-01T01:56:05.824 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-01T01:56:05.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.942+0000 7f965f209640 1 Processor -- start 2024-04-01T01:56:05.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.942+0000 7f965f209640 1 -- start start 2024-04-01T01:56:05.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.942+0000 7f965f209640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f965806c2c0 0x7f9658072430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:05.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.942+0000 7f965f209640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f965806bd40 0x7f9658072970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:05.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.942+0000 7f965f209640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9658073610 con 0x7f9658154360 2024-04-01T01:56:05.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.942+0000 7f965f209640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f965815a8a0 con 0x7f965806bd40 2024-04-01T01:56:05.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.942+0000 7f965f209640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f965815add0 con 0x7f965806c2c0 2024-04-01T01:56:05.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.942+0000 7f965d7a6640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f965806bd40 0x7f9658072970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:05.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.942+0000 7f965d7a6640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f965806bd40 0x7f9658072970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51004/0 (socket says 172.21.15.50:51004) 2024-04-01T01:56:05.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.942+0000 7f965d7a6640 1 -- 172.21.15.50:0/966905511 learned_addr learned my addr 172.21.15.50:0/966905511 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T01:56:05.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.942+0000 7f9657fff640 1 --2- 172.21.15.50:0/966905511 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f965806c2c0 0x7f9658072430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:05.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.942+0000 7f965d7a6640 1 -- 172.21.15.50:0/966905511 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f965806c2c0 msgr2=0x7f9658072430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:56:05.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.942+0000 7f965d7a6640 1 --2- 172.21.15.50:0/966905511 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f965806c2c0 0x7f9658072430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:05.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.942+0000 7f965d7a6640 1 -- 172.21.15.50:0/966905511 >> v1:172.21.15.97:6789/0 conn(0x7f9658154360 legacy=0x7f9658066f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:05.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.942+0000 7f965d7a6640 1 -- 172.21.15.50:0/966905511 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f965815aaf0 con 0x7f965806bd40 2024-04-01T01:56:05.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.942+0000 7f9657fff640 1 --2- 172.21.15.50:0/966905511 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f965806c2c0 0x7f9658072430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T01:56:05.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.946+0000 7f965d7a6640 1 --2- 172.21.15.50:0/966905511 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f965806bd40 0x7f9658072970 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f9650009e50 tx=0x7f965001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f60a5c606c6ede8 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:56:05.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.946+0000 7f96577fe640 1 -- 172.21.15.50:0/966905511 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96500a5770 con 0x7f965806bd40 2024-04-01T01:56:05.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.946+0000 7f96577fe640 1 -- 172.21.15.50:0/966905511 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96500a5910 con 0x7f965806bd40 2024-04-01T01:56:05.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.946+0000 7f96577fe640 1 -- 172.21.15.50:0/966905511 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96500a5ce0 con 0x7f965806bd40 2024-04-01T01:56:05.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.946+0000 7f965f209640 1 -- 172.21.15.50:0/966905511 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f965806bd40 msgr2=0x7f9658072970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:05.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.946+0000 7f965f209640 1 --2- 172.21.15.50:0/966905511 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f965806bd40 0x7f9658072970 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f9650009e50 tx=0x7f965001c9a0 comp rx=0 tx=0).stop 2024-04-01T01:56:05.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.946+0000 7f965f209640 1 -- 172.21.15.50:0/966905511 shutdown_connections 2024-04-01T01:56:05.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.946+0000 7f965f209640 1 --2- 172.21.15.50:0/966905511 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f965806bd40 0x7f9658072970 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:05.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.946+0000 7f965f209640 1 --2- 172.21.15.50:0/966905511 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f965806c2c0 0x7f9658072430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:05.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.946+0000 7f965f209640 1 -- 172.21.15.50:0/966905511 >> 172.21.15.50:0/966905511 conn(0x7f965806b220 msgr2=0x7f965806b630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:56:05.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.946+0000 7f965f209640 1 -- 172.21.15.50:0/966905511 shutdown_connections 2024-04-01T01:56:05.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.946+0000 7f965f209640 1 -- 172.21.15.50:0/966905511 wait complete. 2024-04-01T01:56:05.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.946+0000 7f965f209640 1 Processor -- start 2024-04-01T01:56:05.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.946+0000 7f965f209640 1 -- start start 2024-04-01T01:56:05.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.946+0000 7f965f209640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f965806bd40 0x7f96581f25b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:05.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.946+0000 7f965f209640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f965806c2c0 0x7f96581f6520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:05.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.946+0000 7f965f209640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9658154360 0x7f965814a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:05.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.946+0000 7f965f209640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f965806ec70 con 0x7f965806bd40 2024-04-01T01:56:05.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.946+0000 7f965f209640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f965806eaf0 con 0x7f9658154360 2024-04-01T01:56:05.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.946+0000 7f965f209640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f9658166ee0 con 0x7f965806c2c0 2024-04-01T01:56:05.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.946+0000 7f965cfa5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f965806bd40 0x7f96581f25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:05.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.946+0000 7f965cfa5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f965806bd40 0x7f96581f25b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51020/0 (socket says 172.21.15.50:51020) 2024-04-01T01:56:05.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.946+0000 7f965cfa5640 1 -- 172.21.15.50:0/3468733758 learned_addr learned my addr 172.21.15.50:0/3468733758 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T01:56:05.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.946+0000 7f9657fff640 1 --2- 172.21.15.50:0/3468733758 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f965806c2c0 0x7f96581f6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:05.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.946+0000 7f965d7a6640 1 --2- 172.21.15.50:0/3468733758 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9658154360 0x7f965814a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:05.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.946+0000 7f965cfa5640 1 -- 172.21.15.50:0/3468733758 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f965806c2c0 msgr2=0x7f96581f6520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:05.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.946+0000 7f965cfa5640 1 --2- 172.21.15.50:0/3468733758 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f965806c2c0 0x7f96581f6520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:05.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.946+0000 7f965cfa5640 1 -- 172.21.15.50:0/3468733758 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9658154360 msgr2=0x7f965814a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:05.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.946+0000 7f965cfa5640 1 --2- 172.21.15.50:0/3468733758 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9658154360 0x7f965814a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:05.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.946+0000 7f965cfa5640 1 -- 172.21.15.50:0/3468733758 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96581f6a60 con 0x7f965806bd40 2024-04-01T01:56:05.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.946+0000 7f965d7a6640 1 --2- 172.21.15.50:0/3468733758 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9658154360 0x7f965814a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T01:56:05.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.950+0000 7f965cfa5640 1 --2- 172.21.15.50:0/3468733758 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f965806bd40 0x7f96581f25b0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f964800c370 tx=0x7f964800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:56:05.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.950+0000 7f96557fa640 1 -- 172.21.15.50:0/3468733758 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96480052d0 con 0x7f965806bd40 2024-04-01T01:56:05.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.950+0000 7f96557fa640 1 -- 172.21.15.50:0/3468733758 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9648005470 con 0x7f965806bd40 2024-04-01T01:56:05.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.950+0000 7f965f209640 1 -- 172.21.15.50:0/3468733758 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96581f2d40 con 0x7f965806bd40 2024-04-01T01:56:05.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.950+0000 7f96557fa640 1 -- 172.21.15.50:0/3468733758 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9648007260 con 0x7f965806bd40 2024-04-01T01:56:05.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.950+0000 7f965f209640 1 -- 172.21.15.50:0/3468733758 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96581f3300 con 0x7f965806bd40 2024-04-01T01:56:05.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.950+0000 7f965f209640 1 -- 172.21.15.50:0/3468733758 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9658068230 con 0x7f965806bd40 2024-04-01T01:56:05.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.950+0000 7f96557fa640 1 -- 172.21.15.50:0/3468733758 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 87103+0+0 (secure 0 0 0) 0x7f9648007400 con 0x7f965806bd40 2024-04-01T01:56:05.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.950+0000 7f96557fa640 1 --2- 172.21.15.50:0/3468733758 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f9644067450 0x7f9644069910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:05.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.950+0000 7f96557fa640 1 -- 172.21.15.50:0/3468733758 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f9648084a40 con 0x7f965806bd40 2024-04-01T01:56:05.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.950+0000 7f9657fff640 1 --2- 172.21.15.50:0/3468733758 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f9644067450 0x7f9644069910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:05.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.950+0000 7f9657fff640 1 --2- 172.21.15.50:0/3468733758 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f9644067450 0x7f9644069910 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f965814b110 tx=0x7f964c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:56:05.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:05.954+0000 7f96557fa640 1 -- 172.21.15.50:0/3468733758 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+176632 (secure 0 0 0) 0x7f9648055870 con 0x7f965806bd40 2024-04-01T01:56:06.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.154+0000 7f965f209640 1 -- 172.21.15.50:0/3468733758 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f96580b1970 con 0x7f965806bd40 2024-04-01T01:56:06.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.154+0000 7f96557fa640 1 -- 172.21.15.50:0/3468733758 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+6815 (secure 0 0 0) 0x7f9648084e20 con 0x7f965806bd40 2024-04-01T01:56:06.159 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-01T01:56:06.159 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6839/3495253895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6837","nonce":3495253895},{"type":"v1","addr":"172.21.15.97:6839","nonce":3495253895}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6838/1055159165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":1055159165},{"type":"v1","addr":"172.21.15.97:6838","nonce":1055159165}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4251,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/716162893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":716162893},{"type":"v1","addr":"172.21.15.50:6833","nonce":716162893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6836/194873808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":194873808},{"type":"v1","addr":"172.21.15.50:6836","nonce":194873808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4264,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/2250920298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6835","nonce":2250920298},{"type":"v1","addr":"172.21.15.50:6837","nonce":2250920298}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-01T01:55:48.563827+0000","modified":"2024-04-01T01:55:51.631137+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.97:6835/974386562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":974386562},{"type":"v1","addr":"172.21.15.97:6835","nonce":974386562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4279]},"id":1}]} 2024-04-01T01:56:06.159 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 7 2024-04-01T01:56:06.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.158+0000 7f965f209640 1 -- 172.21.15.50:0/3468733758 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f9644067450 msgr2=0x7f9644069910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:06.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.158+0000 7f965f209640 1 --2- 172.21.15.50:0/3468733758 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f9644067450 0x7f9644069910 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f965814b110 tx=0x7f964c008040 comp rx=0 tx=0).stop 2024-04-01T01:56:06.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.158+0000 7f965f209640 1 -- 172.21.15.50:0/3468733758 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f965806bd40 msgr2=0x7f96581f25b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:06.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.158+0000 7f965f209640 1 --2- 172.21.15.50:0/3468733758 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f965806bd40 0x7f96581f25b0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f964800c370 tx=0x7f964800c830 comp rx=0 tx=0).stop 2024-04-01T01:56:06.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.158+0000 7f965f209640 1 -- 172.21.15.50:0/3468733758 shutdown_connections 2024-04-01T01:56:06.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.158+0000 7f965f209640 1 --2- 172.21.15.50:0/3468733758 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f9644067450 0x7f9644069910 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:06.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.158+0000 7f965f209640 1 --2- 172.21.15.50:0/3468733758 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9658154360 0x7f965814a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:06.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.158+0000 7f965f209640 1 --2- 172.21.15.50:0/3468733758 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f965806c2c0 0x7f96581f6520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:06.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.158+0000 7f965f209640 1 --2- 172.21.15.50:0/3468733758 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f965806bd40 0x7f96581f25b0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:06.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.158+0000 7f965f209640 1 -- 172.21.15.50:0/3468733758 >> 172.21.15.50:0/3468733758 conn(0x7f965806b220 msgr2=0x7f9658152ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:56:06.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.158+0000 7f965f209640 1 -- 172.21.15.50:0/3468733758 shutdown_connections 2024-04-01T01:56:06.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.158+0000 7f965f209640 1 -- 172.21.15.50:0/3468733758 wait complete. 2024-04-01T01:56:06.178 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-01T01:56:06.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.290+0000 7f7b6b630640 1 Processor -- start 2024-04-01T01:56:06.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.290+0000 7f7b6b630640 1 -- start start 2024-04-01T01:56:06.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.294+0000 7f7b6b630640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7b640c2900 0x7f7b640c5f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:06.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.294+0000 7f7b6b630640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f7b640c7850 0x7f7b640c6460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:06.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.294+0000 7f7b6b630640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b640c30d0 con 0x7f7b64151de0 2024-04-01T01:56:06.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.294+0000 7f7b6b630640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f7b6415b370 con 0x7f7b640c7850 2024-04-01T01:56:06.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.294+0000 7f7b6b630640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f7b6415c0f0 con 0x7f7b640c2900 2024-04-01T01:56:06.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.294+0000 7f7b693cc640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f7b64151de0 0x7f7b64157be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.50:50528/0 (socket says 172.21.15.50:50528) 2024-04-01T01:56:06.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.294+0000 7f7b693cc640 1 -- 172.21.15.50:0/3779391447 learned_addr learned my addr 172.21.15.50:0/3779391447 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-04-01T01:56:06.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.294+0000 7f7b68bcb640 1 --2- 172.21.15.50:0/3779391447 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7b640c2900 0x7f7b640c5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:06.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.294+0000 7f7b69bcd640 1 --2- 172.21.15.50:0/3779391447 >> v2:172.21.15.97:3300/0 conn(0x7f7b640c7850 0x7f7b640c6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:06.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.294+0000 7f7b5bfff640 1 -- 172.21.15.50:0/3779391447 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2965994876 0 0) 0x7f7b640c30d0 con 0x7f7b64151de0 2024-04-01T01:56:06.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.294+0000 7f7b5bfff640 1 -- 172.21.15.50:0/3779391447 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7b50003530 con 0x7f7b64151de0 2024-04-01T01:56:06.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.294+0000 7f7b68bcb640 1 -- 172.21.15.50:0/3779391447 >> v2:172.21.15.97:3300/0 conn(0x7f7b640c7850 msgr2=0x7f7b640c6460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:56:06.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.294+0000 7f7b68bcb640 1 --2- 172.21.15.50:0/3779391447 >> v2:172.21.15.97:3300/0 conn(0x7f7b640c7850 0x7f7b640c6460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:06.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.294+0000 7f7b68bcb640 1 -- 172.21.15.50:0/3779391447 >> v1:172.21.15.97:6789/0 conn(0x7f7b64151de0 legacy=0x7f7b64157be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:06.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.294+0000 7f7b68bcb640 1 -- 172.21.15.50:0/3779391447 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b640c2df0 con 0x7f7b640c2900 2024-04-01T01:56:06.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.298+0000 7f7b68bcb640 1 --2- 172.21.15.50:0/3779391447 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7b640c2900 0x7f7b640c5f20 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7b600097c0 tx=0x7f7b6001ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f9d795f18a10421 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:56:06.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.298+0000 7f7b5bfff640 1 -- 172.21.15.50:0/3779391447 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b600b5070 con 0x7f7b640c2900 2024-04-01T01:56:06.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.298+0000 7f7b5bfff640 1 -- 172.21.15.50:0/3779391447 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b600a8990 con 0x7f7b640c2900 2024-04-01T01:56:06.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.298+0000 7f7b5bfff640 1 -- 172.21.15.50:0/3779391447 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b600a8d60 con 0x7f7b640c2900 2024-04-01T01:56:06.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.298+0000 7f7b6b630640 1 -- 172.21.15.50:0/3779391447 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7b640c2900 msgr2=0x7f7b640c5f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:06.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.298+0000 7f7b6b630640 1 --2- 172.21.15.50:0/3779391447 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7b640c2900 0x7f7b640c5f20 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7b600097c0 tx=0x7f7b6001ec90 comp rx=0 tx=0).stop 2024-04-01T01:56:06.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.298+0000 7f7b6b630640 1 -- 172.21.15.50:0/3779391447 shutdown_connections 2024-04-01T01:56:06.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.298+0000 7f7b6b630640 1 --2- 172.21.15.50:0/3779391447 >> v2:172.21.15.97:3300/0 conn(0x7f7b640c7850 0x7f7b640c6460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:06.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.298+0000 7f7b6b630640 1 --2- 172.21.15.50:0/3779391447 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7b640c2900 0x7f7b640c5f20 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:06.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.298+0000 7f7b6b630640 1 -- 172.21.15.50:0/3779391447 >> 172.21.15.50:0/3779391447 conn(0x7f7b64067560 msgr2=0x7f7b6406b220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:56:06.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.298+0000 7f7b6b630640 1 -- 172.21.15.50:0/3779391447 shutdown_connections 2024-04-01T01:56:06.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.298+0000 7f7b6b630640 1 -- 172.21.15.50:0/3779391447 wait complete. 2024-04-01T01:56:06.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.298+0000 7f7b6b630640 1 Processor -- start 2024-04-01T01:56:06.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.298+0000 7f7b6b630640 1 -- start start 2024-04-01T01:56:06.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.298+0000 7f7b6b630640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7b640c2900 0x7f7b64147b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:06.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.298+0000 7f7b6b630640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b640c7850 0x7f7b641f05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:06.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.298+0000 7f7b6b630640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7b64151de0 0x7f7b6406ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:06.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.298+0000 7f7b6b630640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7b6415bbd0 con 0x7f7b640c7850 2024-04-01T01:56:06.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.298+0000 7f7b6b630640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f7b6415b8f0 con 0x7f7b640c2900 2024-04-01T01:56:06.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.298+0000 7f7b6b630640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f7b641582f0 con 0x7f7b64151de0 2024-04-01T01:56:06.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.298+0000 7f7b68bcb640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b640c7850 0x7f7b641f05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:06.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.298+0000 7f7b68bcb640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b640c7850 0x7f7b641f05e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51034/0 (socket says 172.21.15.50:51034) 2024-04-01T01:56:06.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.298+0000 7f7b68bcb640 1 -- 172.21.15.50:0/2124219005 learned_addr learned my addr 172.21.15.50:0/2124219005 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T01:56:06.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.298+0000 7f7b693cc640 1 --2- 172.21.15.50:0/2124219005 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7b640c2900 0x7f7b64147b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:06.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.298+0000 7f7b69bcd640 1 --2- 172.21.15.50:0/2124219005 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7b64151de0 0x7f7b6406ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:06.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.298+0000 7f7b68bcb640 1 -- 172.21.15.50:0/2124219005 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7b64151de0 msgr2=0x7f7b6406ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:06.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.298+0000 7f7b68bcb640 1 --2- 172.21.15.50:0/2124219005 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7b64151de0 0x7f7b6406ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:06.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.298+0000 7f7b68bcb640 1 -- 172.21.15.50:0/2124219005 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7b640c2900 msgr2=0x7f7b64147b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:06.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.298+0000 7f7b68bcb640 1 --2- 172.21.15.50:0/2124219005 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7b640c2900 0x7f7b64147b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:06.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.298+0000 7f7b68bcb640 1 -- 172.21.15.50:0/2124219005 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b641f0b20 con 0x7f7b640c7850 2024-04-01T01:56:06.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.302+0000 7f7b68bcb640 1 --2- 172.21.15.50:0/2124219005 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b640c7850 0x7f7b641f05e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f7b600b3040 tx=0x7f7b6001ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:56:06.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.302+0000 7f7b59ffb640 1 -- 172.21.15.50:0/2124219005 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b600bf070 con 0x7f7b640c7850 2024-04-01T01:56:06.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.302+0000 7f7b6b630640 1 -- 172.21.15.50:0/2124219005 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b64148270 con 0x7f7b640c7850 2024-04-01T01:56:06.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.302+0000 7f7b59ffb640 1 -- 172.21.15.50:0/2124219005 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b600b0700 con 0x7f7b640c7850 2024-04-01T01:56:06.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.302+0000 7f7b59ffb640 1 -- 172.21.15.50:0/2124219005 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b600b5040 con 0x7f7b640c7850 2024-04-01T01:56:06.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.302+0000 7f7b6b630640 1 -- 172.21.15.50:0/2124219005 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b64159120 con 0x7f7b640c7850 2024-04-01T01:56:06.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.302+0000 7f7b6b630640 1 -- 172.21.15.50:0/2124219005 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b64068230 con 0x7f7b640c7850 2024-04-01T01:56:06.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.302+0000 7f7b59ffb640 1 -- 172.21.15.50:0/2124219005 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 87103+0+0 (secure 0 0 0) 0x7f7b600c2070 con 0x7f7b640c7850 2024-04-01T01:56:06.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.302+0000 7f7b59ffb640 1 --2- 172.21.15.50:0/2124219005 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f7b48067450 0x7f7b48069910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:06.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.302+0000 7f7b59ffb640 1 -- 172.21.15.50:0/2124219005 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f7b60121c60 con 0x7f7b640c7850 2024-04-01T01:56:06.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.302+0000 7f7b693cc640 1 --2- 172.21.15.50:0/2124219005 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f7b48067450 0x7f7b48069910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:06.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.302+0000 7f7b693cc640 1 --2- 172.21.15.50:0/2124219005 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f7b48067450 0x7f7b48069910 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7b54005890 tx=0x7f7b54009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:56:06.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.306+0000 7f7b59ffb640 1 -- 172.21.15.50:0/2124219005 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+176632 (secure 0 0 0) 0x7f7b600187f0 con 0x7f7b640c7850 2024-04-01T01:56:06.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.470+0000 7f7b6b630640 1 -- 172.21.15.50:0/2124219005 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7b640c7280 con 0x7f7b640c7850 2024-04-01T01:56:06.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.470+0000 7f7b59ffb640 1 -- 172.21.15.50:0/2124219005 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16525 (secure 0 0 0) 0x7f7b600f2a90 con 0x7f7b640c7850 2024-04-01T01:56:06.474 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-01T01:56:06.474 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":21,"fsid":"f67878a9-bc75-426b-962d-fa7bc2517f7d","created":"2024-04-01T01:55:31.562371+0000","modified":"2024-04-01T01:55:50.217570+0000","last_up_change":"2024-04-01T01:55:42.134502+0000","last_in_change":"2024-04-01T01:55:33.849789+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-01T01:55:42.134418+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-01T01:55:47.009880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-01T01:55:47.551516+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"81e8ca4f-bde8-419a-875f-73a1f4a641ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":4170468134},{"type":"v1","addr":"172.21.15.50:6825","nonce":4170468134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":4170468134},{"type":"v1","addr":"172.21.15.50:6827","nonce":4170468134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":4170468134},{"type":"v1","addr":"172.21.15.50:6831","nonce":4170468134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":4170468134},{"type":"v1","addr":"172.21.15.50:6829","nonce":4170468134}]},"public_addr":"172.21.15.50:6825/4170468134","cluster_addr":"172.21.15.50:6827/4170468134","heartbeat_back_addr":"172.21.15.50:6831/4170468134","heartbeat_front_addr":"172.21.15.50:6829/4170468134","state":["exists","up"]},{"osd":1,"uuid":"bd060ca0-7559-4d30-987c-62e59818431d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1794491326},{"type":"v1","addr":"172.21.15.50:6809","nonce":1794491326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1794491326},{"type":"v1","addr":"172.21.15.50:6811","nonce":1794491326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1794491326},{"type":"v1","addr":"172.21.15.50:6815","nonce":1794491326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1794491326},{"type":"v1","addr":"172.21.15.50:6813","nonce":1794491326}]},"public_addr":"172.21.15.50:6809/1794491326","cluster_addr":"172.21.15.50:6811/1794491326","heartbeat_back_addr":"172.21.15.50:6815/1794491326","heartbeat_front_addr":"172.21.15.50:6813/1794491326","state":["exists","up"]},{"osd":2,"uuid":"eac5d816-a281-4acd-aa7d-b96a8e0aa962","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":710247177},{"type":"v1","addr":"172.21.15.50:6801","nonce":710247177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":710247177},{"type":"v1","addr":"172.21.15.50:6803","nonce":710247177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":710247177},{"type":"v1","addr":"172.21.15.50:6807","nonce":710247177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":710247177},{"type":"v1","addr":"172.21.15.50:6805","nonce":710247177}]},"public_addr":"172.21.15.50:6801/710247177","cluster_addr":"172.21.15.50:6803/710247177","heartbeat_back_addr":"172.21.15.50:6807/710247177","heartbeat_front_addr":"172.21.15.50:6805/710247177","state":["exists","up"]},{"osd":3,"uuid":"12b23968-04a7-40b8-98c4-02b16ae28265","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":871680805},{"type":"v1","addr":"172.21.15.50:6817","nonce":871680805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":871680805},{"type":"v1","addr":"172.21.15.50:6819","nonce":871680805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":871680805},{"type":"v1","addr":"172.21.15.50:6823","nonce":871680805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":871680805},{"type":"v1","addr":"172.21.15.50:6821","nonce":871680805}]},"public_addr":"172.21.15.50:6817/871680805","cluster_addr":"172.21.15.50:6819/871680805","heartbeat_back_addr":"172.21.15.50:6823/871680805","heartbeat_front_addr":"172.21.15.50:6821/871680805","state":["exists","up"]},{"osd":4,"uuid":"0e6b1639-23b0-47d9-8b08-40c8ab6df818","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":1095319381},{"type":"v1","addr":"172.21.15.97:6801","nonce":1095319381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":1095319381},{"type":"v1","addr":"172.21.15.97:6803","nonce":1095319381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":1095319381},{"type":"v1","addr":"172.21.15.97:6807","nonce":1095319381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":1095319381},{"type":"v1","addr":"172.21.15.97:6805","nonce":1095319381}]},"public_addr":"172.21.15.97:6801/1095319381","cluster_addr":"172.21.15.97:6803/1095319381","heartbeat_back_addr":"172.21.15.97:6807/1095319381","heartbeat_front_addr":"172.21.15.97:6805/1095319381","state":["exists","up"]},{"osd":5,"uuid":"f0f876ef-0823-46e9-8fe4-9b7a64a94cee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":899031308},{"type":"v1","addr":"172.21.15.97:6817","nonce":899031308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":899031308},{"type":"v1","addr":"172.21.15.97:6819","nonce":899031308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":899031308},{"type":"v1","addr":"172.21.15.97:6823","nonce":899031308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":899031308},{"type":"v1","addr":"172.21.15.97:6821","nonce":899031308}]},"public_addr":"172.21.15.97:6817/899031308","cluster_addr":"172.21.15.97:6819/899031308","heartbeat_back_addr":"172.21.15.97:6823/899031308","heartbeat_front_addr":"172.21.15.97:6821/899031308","state":["exists","up"]},{"osd":6,"uuid":"d29a625e-83bf-40ef-a57e-618220b96b9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2224814961},{"type":"v1","addr":"172.21.15.97:6825","nonce":2224814961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2224814961},{"type":"v1","addr":"172.21.15.97:6827","nonce":2224814961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2224814961},{"type":"v1","addr":"172.21.15.97:6831","nonce":2224814961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2224814961},{"type":"v1","addr":"172.21.15.97:6829","nonce":2224814961}]},"public_addr":"172.21.15.97:6825/2224814961","cluster_addr":"172.21.15.97:6827/2224814961","heartbeat_back_addr":"172.21.15.97:6831/2224814961","heartbeat_front_addr":"172.21.15.97:6829/2224814961","state":["exists","up"]},{"osd":7,"uuid":"7bcfd8f1-7dc0-4013-af17-16da5a8d931d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":284968823},{"type":"v1","addr":"172.21.15.97:6809","nonce":284968823}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":284968823},{"type":"v1","addr":"172.21.15.97:6811","nonce":284968823}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6814","nonce":284968823},{"type":"v1","addr":"172.21.15.97:6815","nonce":284968823}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":284968823},{"type":"v1","addr":"172.21.15.97:6813","nonce":284968823}]},"public_addr":"172.21.15.97:6809/284968823","cluster_addr":"172.21.15.97:6811/284968823","heartbeat_back_addr":"172.21.15.97:6815/284968823","heartbeat_front_addr":"172.21.15.97:6813/284968823","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T01:55:39.369550+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T01:55:39.367285+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T01:55:39.458393+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T01:55:39.456179+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T01:55:39.463649+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T01:55:38.728924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T01:55:39.522411+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T01:55:39.432081+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-01T01:56:06.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.474+0000 7f7b6b630640 1 -- 172.21.15.50:0/2124219005 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f7b48067450 msgr2=0x7f7b48069910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:06.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.474+0000 7f7b6b630640 1 --2- 172.21.15.50:0/2124219005 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f7b48067450 0x7f7b48069910 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7b54005890 tx=0x7f7b54009040 comp rx=0 tx=0).stop 2024-04-01T01:56:06.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.474+0000 7f7b6b630640 1 -- 172.21.15.50:0/2124219005 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b640c7850 msgr2=0x7f7b641f05e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:06.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.474+0000 7f7b6b630640 1 --2- 172.21.15.50:0/2124219005 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b640c7850 0x7f7b641f05e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f7b600b3040 tx=0x7f7b6001ba30 comp rx=0 tx=0).stop 2024-04-01T01:56:06.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.474+0000 7f7b6b630640 1 -- 172.21.15.50:0/2124219005 shutdown_connections 2024-04-01T01:56:06.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.474+0000 7f7b6b630640 1 --2- 172.21.15.50:0/2124219005 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f7b48067450 0x7f7b48069910 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:06.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.474+0000 7f7b6b630640 1 --2- 172.21.15.50:0/2124219005 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7b64151de0 0x7f7b6406ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:06.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.474+0000 7f7b6b630640 1 --2- 172.21.15.50:0/2124219005 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b640c7850 0x7f7b641f05e0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:06.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.474+0000 7f7b6b630640 1 --2- 172.21.15.50:0/2124219005 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7b640c2900 0x7f7b64147b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:06.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.474+0000 7f7b6b630640 1 -- 172.21.15.50:0/2124219005 >> 172.21.15.50:0/2124219005 conn(0x7f7b64067560 msgr2=0x7f7b6414df00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:56:06.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.474+0000 7f7b6b630640 1 -- 172.21.15.50:0/2124219005 shutdown_connections 2024-04-01T01:56:06.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.474+0000 7f7b6b630640 1 -- 172.21.15.50:0/2124219005 wait complete. 2024-04-01T01:56:06.494 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-01T01:56:06.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.606+0000 7fc348538640 1 Processor -- start 2024-04-01T01:56:06.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.606+0000 7fc348538640 1 -- start start 2024-04-01T01:56:06.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.606+0000 7fc348538640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fc340150e60 0x7fc340072f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:06.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.606+0000 7fc348538640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc3400c73a0 0x7fc3400c2900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:06.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.606+0000 7fc348538640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc340073470 con 0x7fc3400c77c0 2024-04-01T01:56:06.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.606+0000 7fc348538640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fc3401578f0 con 0x7fc340150e60 2024-04-01T01:56:06.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.606+0000 7fc348538640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fc340156a20 con 0x7fc3400c73a0 2024-04-01T01:56:06.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.610+0000 7fc345ad3640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc3400c73a0 0x7fc3400c2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:06.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.610+0000 7fc3462d4640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fc340150e60 0x7fc340072f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:06.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.610+0000 7fc346ad5640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fc3400c77c0 0x7fc34015a2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.50:50532/0 (socket says 172.21.15.50:50532) 2024-04-01T01:56:06.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.610+0000 7fc346ad5640 1 -- 172.21.15.50:0/2666692118 learned_addr learned my addr 172.21.15.50:0/2666692118 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-04-01T01:56:06.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.610+0000 7fc3462d4640 1 -- 172.21.15.50:0/2666692118 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc3400c73a0 msgr2=0x7fc3400c2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:56:06.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.610+0000 7fc3462d4640 1 --2- 172.21.15.50:0/2666692118 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc3400c73a0 0x7fc3400c2900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:06.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.610+0000 7fc3462d4640 1 -- 172.21.15.50:0/2666692118 >> v1:172.21.15.97:6789/0 conn(0x7fc3400c77c0 legacy=0x7fc34015a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:06.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.610+0000 7fc3462d4640 1 -- 172.21.15.50:0/2666692118 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc340156ce0 con 0x7fc340150e60 2024-04-01T01:56:06.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.610+0000 7fc3462d4640 1 --2- 172.21.15.50:0/2666692118 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc340150e60 0x7fc340072f30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc3300097c0 tx=0x7fc33001ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5bdfd7ef9a35a037 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:56:06.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.610+0000 7fc3452d2640 1 -- 172.21.15.50:0/2666692118 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3300b5070 con 0x7fc340150e60 2024-04-01T01:56:06.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.610+0000 7fc3452d2640 1 -- 172.21.15.50:0/2666692118 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3300a8990 con 0x7fc340150e60 2024-04-01T01:56:06.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.610+0000 7fc3452d2640 1 -- 172.21.15.50:0/2666692118 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3300a8d60 con 0x7fc340150e60 2024-04-01T01:56:06.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.610+0000 7fc348538640 1 -- 172.21.15.50:0/2666692118 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc340150e60 msgr2=0x7fc340072f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:06.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.610+0000 7fc348538640 1 --2- 172.21.15.50:0/2666692118 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc340150e60 0x7fc340072f30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc3300097c0 tx=0x7fc33001ec90 comp rx=0 tx=0).stop 2024-04-01T01:56:06.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.610+0000 7fc348538640 1 -- 172.21.15.50:0/2666692118 shutdown_connections 2024-04-01T01:56:06.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.610+0000 7fc348538640 1 --2- 172.21.15.50:0/2666692118 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc3400c73a0 0x7fc3400c2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:06.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.610+0000 7fc348538640 1 --2- 172.21.15.50:0/2666692118 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc340150e60 0x7fc340072f30 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:06.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.610+0000 7fc348538640 1 -- 172.21.15.50:0/2666692118 >> 172.21.15.50:0/2666692118 conn(0x7fc340067560 msgr2=0x7fc34006b220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:56:06.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.614+0000 7fc348538640 1 -- 172.21.15.50:0/2666692118 shutdown_connections 2024-04-01T01:56:06.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.614+0000 7fc348538640 1 -- 172.21.15.50:0/2666692118 wait complete. 2024-04-01T01:56:06.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.614+0000 7fc348538640 1 Processor -- start 2024-04-01T01:56:06.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.614+0000 7fc348538640 1 -- start start 2024-04-01T01:56:06.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.614+0000 7fc348538640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc3400c73a0 0x7fc340151570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:06.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.614+0000 7fc348538640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc340150e60 0x7fc340147b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:06.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.614+0000 7fc348538640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3401480d0 0x7fc340158160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:06.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.614+0000 7fc348538640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc340157580 con 0x7fc3401480d0 2024-04-01T01:56:06.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.614+0000 7fc348538640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fc3401572a0 con 0x7fc3400c73a0 2024-04-01T01:56:06.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.614+0000 7fc348538640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fc34015aa00 con 0x7fc340150e60 2024-04-01T01:56:06.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.614+0000 7fc346ad5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3401480d0 0x7fc340158160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:06.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.614+0000 7fc346ad5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3401480d0 0x7fc340158160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51048/0 (socket says 172.21.15.50:51048) 2024-04-01T01:56:06.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.614+0000 7fc346ad5640 1 -- 172.21.15.50:0/3612638166 learned_addr learned my addr 172.21.15.50:0/3612638166 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T01:56:06.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.614+0000 7fc345ad3640 1 --2- 172.21.15.50:0/3612638166 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc340150e60 0x7fc340147b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:06.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.614+0000 7fc3462d4640 1 --2- 172.21.15.50:0/3612638166 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc3400c73a0 0x7fc340151570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:06.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.614+0000 7fc346ad5640 1 -- 172.21.15.50:0/3612638166 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc340150e60 msgr2=0x7fc340147b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:06.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.614+0000 7fc346ad5640 1 --2- 172.21.15.50:0/3612638166 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc340150e60 0x7fc340147b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:06.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.614+0000 7fc346ad5640 1 -- 172.21.15.50:0/3612638166 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc3400c73a0 msgr2=0x7fc340151570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:06.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.614+0000 7fc346ad5640 1 --2- 172.21.15.50:0/3612638166 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc3400c73a0 0x7fc340151570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:06.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.614+0000 7fc346ad5640 1 -- 172.21.15.50:0/3612638166 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc340157c80 con 0x7fc3401480d0 2024-04-01T01:56:06.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.614+0000 7fc346ad5640 1 --2- 172.21.15.50:0/3612638166 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3401480d0 0x7fc340158160 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc33800cbf0 tx=0x7fc33800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:56:06.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.614+0000 7fc336ffd640 1 -- 172.21.15.50:0/3612638166 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc338017070 con 0x7fc3401480d0 2024-04-01T01:56:06.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.614+0000 7fc336ffd640 1 -- 172.21.15.50:0/3612638166 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc33800ad40 con 0x7fc3401480d0 2024-04-01T01:56:06.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.614+0000 7fc348538640 1 -- 172.21.15.50:0/3612638166 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3401efee0 con 0x7fc3401480d0 2024-04-01T01:56:06.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.614+0000 7fc336ffd640 1 -- 172.21.15.50:0/3612638166 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc338012600 con 0x7fc3401480d0 2024-04-01T01:56:06.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.614+0000 7fc348538640 1 -- 172.21.15.50:0/3612638166 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3401f04a0 con 0x7fc3401480d0 2024-04-01T01:56:06.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.614+0000 7fc348538640 1 -- 172.21.15.50:0/3612638166 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc340068230 con 0x7fc3401480d0 2024-04-01T01:56:06.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.618+0000 7fc336ffd640 1 -- 172.21.15.50:0/3612638166 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 87103+0+0 (secure 0 0 0) 0x7fc33801a070 con 0x7fc3401480d0 2024-04-01T01:56:06.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.618+0000 7fc336ffd640 1 --2- 172.21.15.50:0/3612638166 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fc324067450 0x7fc324069910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:06.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.618+0000 7fc336ffd640 1 -- 172.21.15.50:0/3612638166 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fc338085360 con 0x7fc3401480d0 2024-04-01T01:56:06.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.618+0000 7fc3462d4640 1 --2- 172.21.15.50:0/3612638166 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fc324067450 0x7fc324069910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:06.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.618+0000 7fc3462d4640 1 --2- 172.21.15.50:0/3612638166 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fc324067450 0x7fc324069910 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc3300b2000 tx=0x7fc330008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:56:06.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.622+0000 7fc336ffd640 1 -- 172.21.15.50:0/3612638166 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+176632 (secure 0 0 0) 0x7fc338055a10 con 0x7fc3401480d0 2024-04-01T01:56:06.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.814+0000 7fc348538640 1 -- 172.21.15.50:0/3612638166 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc340154340 con 0x7fc3401480d0 2024-04-01T01:56:06.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.818+0000 7fc336ffd640 1 -- 172.21.15.50:0/3612638166 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+6815 (secure 0 0 0) 0x7fc338059ab0 con 0x7fc3401480d0 2024-04-01T01:56:06.819 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-01T01:56:06.819 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6839/3495253895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6837","nonce":3495253895},{"type":"v1","addr":"172.21.15.97:6839","nonce":3495253895}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6838/1055159165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":1055159165},{"type":"v1","addr":"172.21.15.97:6838","nonce":1055159165}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4251,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/716162893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":716162893},{"type":"v1","addr":"172.21.15.50:6833","nonce":716162893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6836/194873808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":194873808},{"type":"v1","addr":"172.21.15.50:6836","nonce":194873808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4264,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/2250920298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6835","nonce":2250920298},{"type":"v1","addr":"172.21.15.50:6837","nonce":2250920298}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-01T01:55:48.563827+0000","modified":"2024-04-01T01:55:51.631137+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.97:6835/974386562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":974386562},{"type":"v1","addr":"172.21.15.97:6835","nonce":974386562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4279]},"id":1}]} 2024-04-01T01:56:06.819 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 7 2024-04-01T01:56:06.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.818+0000 7fc348538640 1 -- 172.21.15.50:0/3612638166 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fc324067450 msgr2=0x7fc324069910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:06.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.818+0000 7fc348538640 1 --2- 172.21.15.50:0/3612638166 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fc324067450 0x7fc324069910 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc3300b2000 tx=0x7fc330008040 comp rx=0 tx=0).stop 2024-04-01T01:56:06.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.818+0000 7fc348538640 1 -- 172.21.15.50:0/3612638166 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3401480d0 msgr2=0x7fc340158160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:06.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.818+0000 7fc348538640 1 --2- 172.21.15.50:0/3612638166 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3401480d0 0x7fc340158160 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc33800cbf0 tx=0x7fc33800a430 comp rx=0 tx=0).stop 2024-04-01T01:56:06.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.818+0000 7fc348538640 1 -- 172.21.15.50:0/3612638166 shutdown_connections 2024-04-01T01:56:06.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.818+0000 7fc348538640 1 --2- 172.21.15.50:0/3612638166 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fc324067450 0x7fc324069910 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:06.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.818+0000 7fc348538640 1 --2- 172.21.15.50:0/3612638166 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3401480d0 0x7fc340158160 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:06.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.818+0000 7fc348538640 1 --2- 172.21.15.50:0/3612638166 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc340150e60 0x7fc340147b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:06.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.818+0000 7fc348538640 1 --2- 172.21.15.50:0/3612638166 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc3400c73a0 0x7fc340151570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:06.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.818+0000 7fc348538640 1 -- 172.21.15.50:0/3612638166 >> 172.21.15.50:0/3612638166 conn(0x7fc340067560 msgr2=0x7fc340146f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:56:06.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.818+0000 7fc348538640 1 -- 172.21.15.50:0/3612638166 shutdown_connections 2024-04-01T01:56:06.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:06.818+0000 7fc348538640 1 -- 172.21.15.50:0/3612638166 wait complete. 2024-04-01T01:56:07.441 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-01T01:55:48.563827+0000', 'modified': '2024-04-01T01:55:51.631137+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4279}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4279': {'gid': 4279, 'name': 'f', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.97:6835/974386562', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.97:6834', 'nonce': 974386562}, {'type': 'v1', 'addr': '172.21.15.97:6835', 'nonce': 974386562}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4279, 'qdb_cluster': [4279]} 2024-04-01T01:56:07.442 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-01T01:56:07.442 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2024-04-01T01:56:07.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.574+0000 7f67a2f42640 1 Processor -- start 2024-04-01T01:56:07.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.574+0000 7f67a2f42640 1 -- start start 2024-04-01T01:56:07.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.574+0000 7f67a2f42640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f679c151de0 0x7f679c157be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:07.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.574+0000 7f67a2f42640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f679c158120 0x7f679c162560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:07.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.574+0000 7f67a2f42640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f679c0c30d0 con 0x7f679c0c2900 2024-04-01T01:56:07.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.574+0000 7f67a2f42640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f679c15b370 con 0x7f679c158120 2024-04-01T01:56:07.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.574+0000 7f67a2f42640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f679c15c0f0 con 0x7f679c151de0 2024-04-01T01:56:07.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.574+0000 7f67a14df640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f679c158120 0x7f679c162560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:07.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.574+0000 7f67a14df640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f679c158120 0x7f679c162560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51060/0 (socket says 172.21.15.50:51060) 2024-04-01T01:56:07.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.574+0000 7f67a14df640 1 -- 172.21.15.50:0/2861770083 learned_addr learned my addr 172.21.15.50:0/2861770083 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T01:56:07.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.574+0000 7f6793fff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f679c0c2900 0x7f679c0c5f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44796/0 (socket says 172.21.15.50:44796) 2024-04-01T01:56:07.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.574+0000 7f67a0cde640 1 --2- 172.21.15.50:0/2861770083 >> v2:172.21.15.97:3300/0 conn(0x7f679c151de0 0x7f679c157be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:07.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.574+0000 7f67a14df640 1 -- 172.21.15.50:0/2861770083 >> v2:172.21.15.97:3300/0 conn(0x7f679c151de0 msgr2=0x7f679c157be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:56:07.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.574+0000 7f67a14df640 1 --2- 172.21.15.50:0/2861770083 >> v2:172.21.15.97:3300/0 conn(0x7f679c151de0 0x7f679c157be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:07.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.574+0000 7f67a14df640 1 -- 172.21.15.50:0/2861770083 >> v1:172.21.15.50:6789/0 conn(0x7f679c0c2900 legacy=0x7f679c0c5f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:07.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.574+0000 7f67937fe640 1 -- 172.21.15.50:0/2861770083 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 605268682 0 0) 0x7f679c0c30d0 con 0x7f679c0c2900 2024-04-01T01:56:07.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.574+0000 7f67a14df640 1 -- 172.21.15.50:0/2861770083 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f679c0c2df0 con 0x7f679c158120 2024-04-01T01:56:07.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.578+0000 7f67a14df640 1 --2- 172.21.15.50:0/2861770083 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f679c158120 0x7f679c162560 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f679c06bf50 tx=0x7f679401f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42c8c25b897e4c0d server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:56:07.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.578+0000 7f67937fe640 1 -- 172.21.15.50:0/2861770083 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67940b4070 con 0x7f679c158120 2024-04-01T01:56:07.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.578+0000 7f67937fe640 1 -- 172.21.15.50:0/2861770083 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67940af400 con 0x7f679c158120 2024-04-01T01:56:07.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.578+0000 7f67937fe640 1 -- 172.21.15.50:0/2861770083 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67940af7d0 con 0x7f679c158120 2024-04-01T01:56:07.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.578+0000 7f67a2f42640 1 -- 172.21.15.50:0/2861770083 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f679c158120 msgr2=0x7f679c162560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:07.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.578+0000 7f67a2f42640 1 --2- 172.21.15.50:0/2861770083 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f679c158120 0x7f679c162560 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f679c06bf50 tx=0x7f679401f1e0 comp rx=0 tx=0).stop 2024-04-01T01:56:07.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.578+0000 7f67a2f42640 1 -- 172.21.15.50:0/2861770083 shutdown_connections 2024-04-01T01:56:07.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.578+0000 7f67a2f42640 1 --2- 172.21.15.50:0/2861770083 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f679c158120 0x7f679c162560 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:07.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.578+0000 7f67a2f42640 1 --2- 172.21.15.50:0/2861770083 >> v2:172.21.15.97:3300/0 conn(0x7f679c151de0 0x7f679c157be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:07.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.578+0000 7f67a2f42640 1 -- 172.21.15.50:0/2861770083 >> 172.21.15.50:0/2861770083 conn(0x7f679c067560 msgr2=0x7f679c06b220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:56:07.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.578+0000 7f67a2f42640 1 -- 172.21.15.50:0/2861770083 shutdown_connections 2024-04-01T01:56:07.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.578+0000 7f67a2f42640 1 -- 172.21.15.50:0/2861770083 wait complete. 2024-04-01T01:56:07.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.578+0000 7f67a2f42640 1 Processor -- start 2024-04-01T01:56:07.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.578+0000 7f67a2f42640 1 -- start start 2024-04-01T01:56:07.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.582+0000 7f67a2f42640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f679c0c2900 0x7f679c1ed790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:07.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.582+0000 7f67a2f42640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f679c151de0 0x7f679c14a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:07.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.582+0000 7f67a2f42640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f679c158120 0x7f679c14a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:07.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.582+0000 7f67a2f42640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f679c15bbd0 con 0x7f679c151de0 2024-04-01T01:56:07.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.582+0000 7f67a2f42640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f679c15b8f0 con 0x7f679c158120 2024-04-01T01:56:07.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.582+0000 7f67a2f42640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f679c0c88a0 con 0x7f679c0c2900 2024-04-01T01:56:07.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.582+0000 7f6793fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f679c151de0 0x7f679c14a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:07.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.582+0000 7f6793fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f679c151de0 0x7f679c14a2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51066/0 (socket says 172.21.15.50:51066) 2024-04-01T01:56:07.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.582+0000 7f6793fff640 1 -- 172.21.15.50:0/3501262718 learned_addr learned my addr 172.21.15.50:0/3501262718 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T01:56:07.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.582+0000 7f67a0cde640 1 --2- 172.21.15.50:0/3501262718 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f679c0c2900 0x7f679c1ed790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:07.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.582+0000 7f67a14df640 1 --2- 172.21.15.50:0/3501262718 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f679c158120 0x7f679c14a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:07.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.582+0000 7f6793fff640 1 -- 172.21.15.50:0/3501262718 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f679c0c2900 msgr2=0x7f679c1ed790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:07.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.582+0000 7f6793fff640 1 --2- 172.21.15.50:0/3501262718 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f679c0c2900 0x7f679c1ed790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:07.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.582+0000 7f6793fff640 1 -- 172.21.15.50:0/3501262718 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f679c158120 msgr2=0x7f679c14a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:07.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.582+0000 7f6793fff640 1 --2- 172.21.15.50:0/3501262718 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f679c158120 0x7f679c14a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:07.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.582+0000 7f6793fff640 1 -- 172.21.15.50:0/3501262718 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f679c157750 con 0x7f679c151de0 2024-04-01T01:56:07.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.582+0000 7f6793fff640 1 --2- 172.21.15.50:0/3501262718 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f679c151de0 0x7f679c14a2d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f678c00c520 tx=0x7f678c00c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:56:07.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.582+0000 7f67917fa640 1 -- 172.21.15.50:0/3501262718 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f678c018070 con 0x7f679c151de0 2024-04-01T01:56:07.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.582+0000 7f67917fa640 1 -- 172.21.15.50:0/3501262718 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f678c0074e0 con 0x7f679c151de0 2024-04-01T01:56:07.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.582+0000 7f67a2f42640 1 -- 172.21.15.50:0/3501262718 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f679c1ee140 con 0x7f679c151de0 2024-04-01T01:56:07.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.582+0000 7f67917fa640 1 -- 172.21.15.50:0/3501262718 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f678c0049f0 con 0x7f679c151de0 2024-04-01T01:56:07.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.582+0000 7f67a2f42640 1 -- 172.21.15.50:0/3501262718 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f679c14e8c0 con 0x7f679c151de0 2024-04-01T01:56:07.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.582+0000 7f67917fa640 1 -- 172.21.15.50:0/3501262718 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 87103+0+0 (secure 0 0 0) 0x7f678c01b070 con 0x7f679c151de0 2024-04-01T01:56:07.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.582+0000 7f67917fa640 1 --2- 172.21.15.50:0/3501262718 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f6788067420 0x7f67880698e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:07.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.582+0000 7f67917fa640 1 -- 172.21.15.50:0/3501262718 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f678c084b20 con 0x7f679c151de0 2024-04-01T01:56:07.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.582+0000 7f67a0cde640 1 --2- 172.21.15.50:0/3501262718 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f6788067420 0x7f67880698e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:07.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.586+0000 7f67a60bb000 1 Processor -- start 2024-04-01T01:56:07.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.586+0000 7f67a60bb000 1 -- start start 2024-04-01T01:56:07.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.586+0000 7f67a0cde640 1 --2- 172.21.15.50:0/3501262718 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f6788067420 0x7f67880698e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f679800b9d0 tx=0x7f6798008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:56:07.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.586+0000 7f67a60bb000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55bac3cc0e80 0x55bac3cc1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:07.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.586+0000 7f67a60bb000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55bac3cc17a0 0x55bac3cc1b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:07.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.586+0000 7f67a60bb000 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bac3cc20c0 0x55bac3ce5520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:07.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.586+0000 7f67a60bb000 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55bac3b80e30 con 0x55bac3cc20c0 2024-04-01T01:56:07.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.586+0000 7f67a60bb000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55bac3ae8350 con 0x55bac3cc0e80 2024-04-01T01:56:07.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.586+0000 7f67a60bb000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55bac3a70180 con 0x55bac3cc17a0 2024-04-01T01:56:07.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.586+0000 7f67a14df640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bac3cc20c0 0x55bac3ce5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:07.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.586+0000 7f67a14df640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bac3cc20c0 0x55bac3ce5520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51068/0 (socket says 172.21.15.50:51068) 2024-04-01T01:56:07.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.586+0000 7f67a14df640 1 -- 172.21.15.50:0/2534050913 learned_addr learned my addr 172.21.15.50:0/2534050913 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T01:56:07.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.586+0000 7f6793fff640 1 --2- 172.21.15.50:0/2534050913 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55bac3cc17a0 0x55bac3cc1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:07.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.586+0000 7f67a0cde640 1 --2- 172.21.15.50:0/2534050913 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55bac3cc0e80 0x55bac3cc1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:07.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.586+0000 7f67a14df640 1 -- 172.21.15.50:0/2534050913 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55bac3cc17a0 msgr2=0x55bac3cc1b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:56:07.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.586+0000 7f67a14df640 1 --2- 172.21.15.50:0/2534050913 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55bac3cc17a0 0x55bac3cc1b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:07.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.586+0000 7f67a14df640 1 -- 172.21.15.50:0/2534050913 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55bac3cc0e80 msgr2=0x55bac3cc1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:56:07.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.586+0000 7f67a14df640 1 --2- 172.21.15.50:0/2534050913 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55bac3cc0e80 0x55bac3cc1260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:07.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.586+0000 7f67a14df640 1 -- 172.21.15.50:0/2534050913 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bac3ab1060 con 0x55bac3cc20c0 2024-04-01T01:56:07.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.586+0000 7f67a14df640 1 --2- 172.21.15.50:0/2534050913 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bac3cc20c0 0x55bac3ce5520 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f679401ce10 tx=0x7f6794004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f23e2442d2888efc server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:56:07.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.586+0000 7f67827fc640 1 -- 172.21.15.50:0/2534050913 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67940bf070 con 0x55bac3cc20c0 2024-04-01T01:56:07.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.586+0000 7f67827fc640 1 -- 172.21.15.50:0/2534050913 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67940bb460 con 0x55bac3cc20c0 2024-04-01T01:56:07.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.586+0000 7f67827fc640 1 -- 172.21.15.50:0/2534050913 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67940b4040 con 0x55bac3cc20c0 2024-04-01T01:56:07.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.586+0000 7f67a60bb000 1 -- 172.21.15.50:0/2534050913 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bac3cc20c0 msgr2=0x55bac3ce5520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:07.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.586+0000 7f67a60bb000 1 --2- 172.21.15.50:0/2534050913 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bac3cc20c0 0x55bac3ce5520 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f679401ce10 tx=0x7f6794004ac0 comp rx=0 tx=0).stop 2024-04-01T01:56:07.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.586+0000 7f67a60bb000 1 -- 172.21.15.50:0/2534050913 shutdown_connections 2024-04-01T01:56:07.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.586+0000 7f67a60bb000 1 --2- 172.21.15.50:0/2534050913 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bac3cc20c0 0x55bac3ce5520 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:07.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.586+0000 7f67a60bb000 1 --2- 172.21.15.50:0/2534050913 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55bac3cc17a0 0x55bac3cc1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:07.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.586+0000 7f67a60bb000 1 --2- 172.21.15.50:0/2534050913 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55bac3cc0e80 0x55bac3cc1260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:07.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.586+0000 7f67a60bb000 1 -- 172.21.15.50:0/2534050913 >> 172.21.15.50:0/2534050913 conn(0x55bac3c90960 msgr2=0x55bac3cd8050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:56:07.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.586+0000 7f67a60bb000 1 -- 172.21.15.50:0/2534050913 shutdown_connections 2024-04-01T01:56:07.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.586+0000 7f67a60bb000 1 -- 172.21.15.50:0/2534050913 wait complete. 2024-04-01T01:56:07.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.586+0000 7f67a60bb000 1 -- start start 2024-04-01T01:56:07.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.586+0000 7f67a60bb000 1 Processor -- start 2024-04-01T01:56:07.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.586+0000 7f67a60bb000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55bac3cc0e80 0x55bac3cbea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:07.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.586+0000 7f67a60bb000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55bac3cc17a0 0x55bac3cbef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:07.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.590+0000 7f67a60bb000 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bac3cc20c0 0x55bac3cbf4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:07.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.590+0000 7f67a60bb000 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55bac3aa2a20 con 0x55bac3cc20c0 2024-04-01T01:56:07.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.590+0000 7f67a60bb000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55bac3ae43f0 con 0x55bac3cc0e80 2024-04-01T01:56:07.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.590+0000 7f67a60bb000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55bac3a8e810 con 0x55bac3cc17a0 2024-04-01T01:56:07.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.590+0000 7f67a60bb000 10 client.0 _ll_register_callbacks cb 0x55bac3aa6280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-01T01:56:07.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.590+0000 7f67a14df640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bac3cc20c0 0x55bac3cbf4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:07.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.590+0000 7f67a14df640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bac3cc20c0 0x55bac3cbf4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:32978/0 (socket says 172.21.15.50:32978) 2024-04-01T01:56:07.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.590+0000 7f67a14df640 1 -- 172.21.15.50:0/2286581479 learned_addr learned my addr 172.21.15.50:0/2286581479 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T01:56:07.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.590+0000 7f6793fff640 1 --2- 172.21.15.50:0/2286581479 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55bac3cc17a0 0x55bac3cbef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:07.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.590+0000 7f67a0cde640 1 --2- 172.21.15.50:0/2286581479 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55bac3cc0e80 0x55bac3cbea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:07.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.590+0000 7f67a14df640 1 -- 172.21.15.50:0/2286581479 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55bac3cc17a0 msgr2=0x55bac3cbef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:56:07.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.590+0000 7f67a14df640 1 --2- 172.21.15.50:0/2286581479 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55bac3cc17a0 0x55bac3cbef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:07.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.590+0000 7f67a14df640 1 -- 172.21.15.50:0/2286581479 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55bac3cc0e80 msgr2=0x55bac3cbea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:56:07.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.590+0000 7f67a14df640 1 --2- 172.21.15.50:0/2286581479 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55bac3cc0e80 0x55bac3cbea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:07.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.590+0000 7f67a14df640 1 -- 172.21.15.50:0/2286581479 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bac3a703d0 con 0x55bac3cc20c0 2024-04-01T01:56:07.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.590+0000 7f6793fff640 1 --2- 172.21.15.50:0/2286581479 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55bac3cc17a0 0x55bac3cbef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T01:56:07.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.590+0000 7f67a14df640 1 --2- 172.21.15.50:0/2286581479 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bac3cc20c0 0x55bac3cbf4c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f679401d890 tx=0x7f679401da20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a82fa684fffeeb27 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:56:07.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.590+0000 7f677b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-04-01T01:56:07.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.590+0000 7f677b7fe640 1 -- 172.21.15.50:0/2286581479 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67940bf070 con 0x55bac3cc20c0 2024-04-01T01:56:07.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.590+0000 7f67a60bb000 1 -- 172.21.15.50:0/2286581479 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f67940bb460 con 0x55bac3cc20c0 2024-04-01T01:56:07.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.590+0000 7f677b7fe640 1 -- 172.21.15.50:0/2286581479 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f67940091d0 con 0x55bac3cc20c0 2024-04-01T01:56:07.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.590+0000 7f677b7fe640 1 -- 172.21.15.50:0/2286581479 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7f67940cf050 con 0x55bac3cc20c0 2024-04-01T01:56:07.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.590+0000 7f67a60bb000 10 client.4665 fetch_fsmap learned FSMap version 7 2024-04-01T01:56:07.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.590+0000 7f67a60bb000 1 -- 172.21.15.50:0/2286581479 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x55bac3a70e80 con 0x55bac3cc20c0 2024-04-01T01:56:07.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.590+0000 7f677b7fe640 1 -- 172.21.15.50:0/2286581479 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67940bb460 con 0x55bac3cc20c0 2024-04-01T01:56:07.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.590+0000 7f677b7fe640 1 -- 172.21.15.50:0/2286581479 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 7) ==== 4704+0+0 (secure 0 0 0) 0x7f67940d2020 con 0x55bac3cc20c0 2024-04-01T01:56:07.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.590+0000 7f67a60bb000 10 client.4665 fetch_fsmap finished waiting for FSMap version 7 2024-04-01T01:56:07.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.590+0000 7f67a60bb000 10 client.4665 resolve_mds: resolved name 'f' to daemon mds.f 2024-04-01T01:56:07.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.590+0000 7f67a60bb000 20 client.4665 populate_metadata read hostname 'smithi050' 2024-04-01T01:56:07.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.590+0000 7f67a60bb000 1 --2- 172.21.15.50:0/2286581479 >> [v2:172.21.15.97:6834/974386562,v1:172.21.15.97:6835/974386562] conn(0x55bac3cee720 0x55bac3cf0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:07.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.590+0000 7f67a60bb000 4 client.4665 mds_command: new command op to 4279 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-01T01:56:07.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.590+0000 7f67a60bb000 1 -- 172.21.15.50:0/2286581479 --> [v2:172.21.15.97:6834/974386562,v1:172.21.15.97:6835/974386562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bac3a83ab0 con 0x55bac3cee720 2024-04-01T01:56:07.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.590+0000 7f67a0cde640 1 --2- 172.21.15.50:0/2286581479 >> [v2:172.21.15.97:6834/974386562,v1:172.21.15.97:6835/974386562] conn(0x55bac3cee720 0x55bac3cf0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:07.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.590+0000 7f67a0cde640 1 --2- 172.21.15.50:0/2286581479 >> [v2:172.21.15.97:6834/974386562,v1:172.21.15.97:6835/974386562] conn(0x55bac3cee720 0x55bac3cf0b10 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=448e1a9d08b3554d server_cookie=8e09655add973a8b in_seq=0 out_seq=0 2024-04-01T01:56:07.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.590+0000 7f677b7fe640 10 client.4665 ms_handle_connect on v2:172.21.15.97:6834/974386562 2024-04-01T01:56:07.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.594+0000 7f677b7fe640 1 -- 172.21.15.50:0/2286581479 <== mds.0 v2:172.21.15.97:6834/974386562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55bac3a83ab0 con 0x55bac3cee720 2024-04-01T01:56:07.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.594+0000 7f677b7fe640 10 client.4665 handle_command_reply: tid=0 2024-04-01T01:56:07.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.594+0000 7f67a60bb000 1 client.4665 shutdown 2024-04-01T01:56:07.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.594+0000 7f67a60bb000 1 -- 172.21.15.50:0/2286581479 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bac3cc20c0 msgr2=0x55bac3cbf4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:07.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.594+0000 7f67a60bb000 1 --2- 172.21.15.50:0/2286581479 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bac3cc20c0 0x55bac3cbf4c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f679401d890 tx=0x7f679401da20 comp rx=0 tx=0).stop 2024-04-01T01:56:07.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.594+0000 7f67a60bb000 1 -- 172.21.15.50:0/2286581479 shutdown_connections 2024-04-01T01:56:07.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.594+0000 7f67a60bb000 1 --2- 172.21.15.50:0/2286581479 >> [v2:172.21.15.97:6834/974386562,v1:172.21.15.97:6835/974386562] conn(0x55bac3cee720 0x55bac3cf0b10 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:07.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.594+0000 7f67a60bb000 1 --2- 172.21.15.50:0/2286581479 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bac3cc20c0 0x55bac3cbf4c0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:07.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.594+0000 7f67a60bb000 1 --2- 172.21.15.50:0/2286581479 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55bac3cc17a0 0x55bac3cbef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:07.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.594+0000 7f67a60bb000 1 --2- 172.21.15.50:0/2286581479 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55bac3cc0e80 0x55bac3cbea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:07.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.594+0000 7f677b7fe640 0 client.4665 ms_handle_reset on v2:172.21.15.97:6834/974386562 2024-04-01T01:56:07.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.594+0000 7f67a60bb000 1 -- 172.21.15.50:0/2286581479 >> 172.21.15.50:0/2286581479 conn(0x55bac3c90960 msgr2=0x55bac3cc04f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:56:07.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.594+0000 7f67a60bb000 1 -- 172.21.15.50:0/2286581479 shutdown_connections 2024-04-01T01:56:07.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.594+0000 7f67a60bb000 1 -- 172.21.15.50:0/2286581479 wait complete. 2024-04-01T01:56:07.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.594+0000 7f67a60bb000 20 client.4665 trim_cache size 0 max 16384 2024-04-01T01:56:07.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.610+0000 7f67a60bb000 1 Processor -- start 2024-04-01T01:56:07.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.610+0000 7f67a60bb000 1 -- start start 2024-04-01T01:56:07.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.610+0000 7f67a60bb000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55bac3cc0e80 0x55bac3cf3d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:07.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.610+0000 7f67a60bb000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55bac3cc17a0 0x55bac3c950e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:07.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.610+0000 7f67a60bb000 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bac3cc20c0 0x55bac3c95620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:07.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.610+0000 7f67a60bb000 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f679c1f8fb0 con 0x55bac3cc20c0 2024-04-01T01:56:07.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.610+0000 7f67a60bb000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55bac3ca2050 con 0x55bac3cc17a0 2024-04-01T01:56:07.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.610+0000 7f67a60bb000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55bac3aec980 con 0x55bac3cc0e80 2024-04-01T01:56:07.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.610+0000 7f67a14df640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bac3cc20c0 0x55bac3c95620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:07.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.610+0000 7f67a14df640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bac3cc20c0 0x55bac3c95620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:32986/0 (socket says 172.21.15.50:32986) 2024-04-01T01:56:07.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.610+0000 7f67a14df640 1 -- 172.21.15.50:0/1259533731 learned_addr learned my addr 172.21.15.50:0/1259533731 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T01:56:07.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.610+0000 7f67a0cde640 1 --2- 172.21.15.50:0/1259533731 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55bac3cc0e80 0x55bac3cf3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:07.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.610+0000 7f6793fff640 1 --2- 172.21.15.50:0/1259533731 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55bac3cc17a0 0x55bac3c950e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:07.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.610+0000 7f67a14df640 1 -- 172.21.15.50:0/1259533731 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55bac3cc0e80 msgr2=0x55bac3cf3d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:56:07.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.610+0000 7f67a14df640 1 --2- 172.21.15.50:0/1259533731 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55bac3cc0e80 0x55bac3cf3d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:07.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.610+0000 7f67a14df640 1 -- 172.21.15.50:0/1259533731 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55bac3cc17a0 msgr2=0x55bac3c950e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:56:07.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.610+0000 7f67a14df640 1 --2- 172.21.15.50:0/1259533731 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55bac3cc17a0 0x55bac3c950e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:07.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.610+0000 7f67a14df640 1 -- 172.21.15.50:0/1259533731 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bac3a87410 con 0x55bac3cc20c0 2024-04-01T01:56:07.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.610+0000 7f6793fff640 1 --2- 172.21.15.50:0/1259533731 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55bac3cc17a0 0x55bac3c950e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T01:56:07.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.610+0000 7f67a14df640 1 --2- 172.21.15.50:0/1259533731 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bac3cc20c0 0x55bac3c95620 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6794004a90 tx=0x7f67940b1070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cdc03302d3c85d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:56:07.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.614+0000 7f6781ffb640 1 -- 172.21.15.50:0/1259533731 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67940bf040 con 0x55bac3cc20c0 2024-04-01T01:56:07.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.614+0000 7f6781ffb640 1 -- 172.21.15.50:0/1259533731 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6794002030 con 0x55bac3cc20c0 2024-04-01T01:56:07.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.614+0000 7f6781ffb640 1 -- 172.21.15.50:0/1259533731 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67940b4040 con 0x55bac3cc20c0 2024-04-01T01:56:07.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.614+0000 7f67a60bb000 1 -- 172.21.15.50:0/1259533731 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bac3cc20c0 msgr2=0x55bac3c95620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:07.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.614+0000 7f67a60bb000 1 --2- 172.21.15.50:0/1259533731 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bac3cc20c0 0x55bac3c95620 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6794004a90 tx=0x7f67940b1070 comp rx=0 tx=0).stop 2024-04-01T01:56:07.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.614+0000 7f67a60bb000 1 -- 172.21.15.50:0/1259533731 shutdown_connections 2024-04-01T01:56:07.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.614+0000 7f67a60bb000 1 --2- 172.21.15.50:0/1259533731 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bac3cc20c0 0x55bac3c95620 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:07.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.614+0000 7f67a60bb000 1 --2- 172.21.15.50:0/1259533731 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55bac3cc17a0 0x55bac3c950e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:07.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.614+0000 7f67a60bb000 1 --2- 172.21.15.50:0/1259533731 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55bac3cc0e80 0x55bac3cf3d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:07.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.614+0000 7f67a60bb000 1 -- 172.21.15.50:0/1259533731 >> 172.21.15.50:0/1259533731 conn(0x55bac3c90960 msgr2=0x55bac3cd51e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:56:07.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.614+0000 7f67a60bb000 1 -- 172.21.15.50:0/1259533731 shutdown_connections 2024-04-01T01:56:07.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.614+0000 7f67a60bb000 1 -- 172.21.15.50:0/1259533731 wait complete. 2024-04-01T01:56:07.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.614+0000 7f67a60bb000 1 -- start start 2024-04-01T01:56:07.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.614+0000 7f67a60bb000 1 Processor -- start 2024-04-01T01:56:07.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.614+0000 7f67a60bb000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55bac3cc0e80 0x55bac3c99270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:07.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.614+0000 7f67a60bb000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55bac3cc17a0 0x55bac3c997b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:07.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.614+0000 7f67a60bb000 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bac3cc20c0 0x55bac3cefb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:07.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.614+0000 7f67a60bb000 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55bac3aa2a20 con 0x55bac3cc20c0 2024-04-01T01:56:07.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.614+0000 7f67a60bb000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55bac3ae7660 con 0x55bac3cc17a0 2024-04-01T01:56:07.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.614+0000 7f67a60bb000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55bac3a9cc40 con 0x55bac3cc0e80 2024-04-01T01:56:07.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.614+0000 7f67a60bb000 10 client.0 _ll_register_callbacks cb 0x7f6794009d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-01T01:56:07.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.614+0000 7f67a14df640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bac3cc20c0 0x55bac3cefb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:07.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.614+0000 7f67a14df640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bac3cc20c0 0x55bac3cefb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:32998/0 (socket says 172.21.15.50:32998) 2024-04-01T01:56:07.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.614+0000 7f67a14df640 1 -- 172.21.15.50:0/698941894 learned_addr learned my addr 172.21.15.50:0/698941894 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T01:56:07.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.614+0000 7f67a0cde640 1 --2- 172.21.15.50:0/698941894 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55bac3cc0e80 0x55bac3c99270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:07.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.614+0000 7f6793fff640 1 --2- 172.21.15.50:0/698941894 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55bac3cc17a0 0x55bac3c997b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:07.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.614+0000 7f67a14df640 1 -- 172.21.15.50:0/698941894 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55bac3cc0e80 msgr2=0x55bac3c99270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:56:07.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.614+0000 7f67a14df640 1 --2- 172.21.15.50:0/698941894 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55bac3cc0e80 0x55bac3c99270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:07.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.614+0000 7f67a14df640 1 -- 172.21.15.50:0/698941894 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55bac3cc17a0 msgr2=0x55bac3c997b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:56:07.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.614+0000 7f67a14df640 1 --2- 172.21.15.50:0/698941894 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55bac3cc17a0 0x55bac3c997b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:07.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.614+0000 7f67a14df640 1 -- 172.21.15.50:0/698941894 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bac3a7cae0 con 0x55bac3cc20c0 2024-04-01T01:56:07.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.614+0000 7f6793fff640 1 --2- 172.21.15.50:0/698941894 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55bac3cc17a0 0x55bac3c997b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T01:56:07.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.614+0000 7f67a14df640 1 --2- 172.21.15.50:0/698941894 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bac3cc20c0 0x55bac3cefb50 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f67940a8c50 tx=0x7f67940aa000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6924be4231fc792c server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:56:07.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.614+0000 7f677b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-04-01T01:56:07.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.614+0000 7f677b7fe640 1 -- 172.21.15.50:0/698941894 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67940b4040 con 0x55bac3cc20c0 2024-04-01T01:56:07.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.614+0000 7f677b7fe640 1 -- 172.21.15.50:0/698941894 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f67940c8070 con 0x55bac3cc20c0 2024-04-01T01:56:07.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.614+0000 7f67a60bb000 1 -- 172.21.15.50:0/698941894 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6794002030 con 0x55bac3cc20c0 2024-04-01T01:56:07.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.614+0000 7f677b7fe640 1 -- 172.21.15.50:0/698941894 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7f67940e1050 con 0x55bac3cc20c0 2024-04-01T01:56:07.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.614+0000 7f67a60bb000 10 client.4671 fetch_fsmap learned FSMap version 7 2024-04-01T01:56:07.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.614+0000 7f67a60bb000 1 -- 172.21.15.50:0/698941894 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x55bac3a8f0d0 con 0x55bac3cc20c0 2024-04-01T01:56:07.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.614+0000 7f677b7fe640 1 -- 172.21.15.50:0/698941894 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6794002030 con 0x55bac3cc20c0 2024-04-01T01:56:07.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.614+0000 7f677b7fe640 1 -- 172.21.15.50:0/698941894 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 7) ==== 4704+0+0 (secure 0 0 0) 0x7f67940e4020 con 0x55bac3cc20c0 2024-04-01T01:56:07.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.614+0000 7f67a60bb000 10 client.4671 fetch_fsmap finished waiting for FSMap version 7 2024-04-01T01:56:07.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.614+0000 7f67a60bb000 10 client.4671 resolve_mds: resolved name 'f' to daemon mds.f 2024-04-01T01:56:07.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.614+0000 7f67a60bb000 20 client.4671 populate_metadata read hostname 'smithi050' 2024-04-01T01:56:07.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.614+0000 7f67a60bb000 1 --2- 172.21.15.50:0/698941894 >> [v2:172.21.15.97:6834/974386562,v1:172.21.15.97:6835/974386562] conn(0x55bac3cf0090 0x55bac3cf0470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:07.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.614+0000 7f67a60bb000 4 client.4671 mds_command: new command op to 4279 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-01T01:56:07.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.614+0000 7f67a60bb000 1 -- 172.21.15.50:0/698941894 --> [v2:172.21.15.97:6834/974386562,v1:172.21.15.97:6835/974386562] -- command(tid 0: {"prefix": "status"}) -- 0x55bac3c9e140 con 0x55bac3cf0090 2024-04-01T01:56:07.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.614+0000 7f67a0cde640 1 --2- 172.21.15.50:0/698941894 >> [v2:172.21.15.97:6834/974386562,v1:172.21.15.97:6835/974386562] conn(0x55bac3cf0090 0x55bac3cf0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:07.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.618+0000 7f67a0cde640 1 --2- 172.21.15.50:0/698941894 >> [v2:172.21.15.97:6834/974386562,v1:172.21.15.97:6835/974386562] conn(0x55bac3cf0090 0x55bac3cf0470 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9e264c8cd040b586 server_cookie=47f2c85c08b64efe in_seq=0 out_seq=0 2024-04-01T01:56:07.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.618+0000 7f677b7fe640 10 client.4671 ms_handle_connect on v2:172.21.15.97:6834/974386562 2024-04-01T01:56:07.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.618+0000 7f677b7fe640 1 -- 172.21.15.50:0/698941894 <== mds.0 v2:172.21.15.97:6834/974386562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x55bac3c9e140 con 0x55bac3cf0090 2024-04-01T01:56:07.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.618+0000 7f677b7fe640 10 client.4671 handle_command_reply: tid=0 2024-04-01T01:56:07.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.618+0000 7f67a60bb000 1 client.4671 shutdown 2024-04-01T01:56:07.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.618+0000 7f67a60bb000 1 -- 172.21.15.50:0/698941894 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bac3cc20c0 msgr2=0x55bac3cefb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:07.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.618+0000 7f67a60bb000 1 --2- 172.21.15.50:0/698941894 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bac3cc20c0 0x55bac3cefb50 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f67940a8c50 tx=0x7f67940aa000 comp rx=0 tx=0).stop 2024-04-01T01:56:07.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.618+0000 7f67a60bb000 1 -- 172.21.15.50:0/698941894 shutdown_connections 2024-04-01T01:56:07.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.618+0000 7f67a60bb000 1 --2- 172.21.15.50:0/698941894 >> [v2:172.21.15.97:6834/974386562,v1:172.21.15.97:6835/974386562] conn(0x55bac3cf0090 0x55bac3cf0470 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:07.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.618+0000 7f67a60bb000 1 --2- 172.21.15.50:0/698941894 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bac3cc20c0 0x55bac3cefb50 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:07.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.618+0000 7f67a60bb000 1 --2- 172.21.15.50:0/698941894 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55bac3cc17a0 0x55bac3c997b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:07.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.618+0000 7f677b7fe640 0 client.4671 ms_handle_reset on v2:172.21.15.97:6834/974386562 2024-04-01T01:56:07.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.618+0000 7f67a60bb000 1 --2- 172.21.15.50:0/698941894 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55bac3cc0e80 0x55bac3c99270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:07.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.618+0000 7f67a60bb000 1 -- 172.21.15.50:0/698941894 >> 172.21.15.50:0/698941894 conn(0x55bac3c90960 msgr2=0x55bac3c98b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:56:07.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.618+0000 7f67a60bb000 1 -- 172.21.15.50:0/698941894 shutdown_connections 2024-04-01T01:56:07.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.618+0000 7f67a60bb000 1 -- 172.21.15.50:0/698941894 wait complete. 2024-04-01T01:56:07.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.618+0000 7f67a60bb000 20 client.4671 trim_cache size 0 max 16384 2024-04-01T01:56:07.626 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-04-01T01:56:07.626 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "f67878a9-bc75-426b-962d-fa7bc2517f7d", 2024-04-01T01:56:07.626 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 0, 2024-04-01T01:56:07.627 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 4279, 2024-04-01T01:56:07.627 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2024-04-01T01:56:07.627 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2024-04-01T01:56:07.627 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs", 2024-04-01T01:56:07.627 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 18.402013141000001, 2024-04-01T01:56:07.627 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 7, 2024-04-01T01:56:07.627 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 21, 2024-04-01T01:56:07.627 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 21, 2024-04-01T01:56:07.627 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 25.184465313 2024-04-01T01:56:07.627 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-04-01T01:56:07.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.618+0000 7f67a2f42640 1 -- 172.21.15.50:0/3501262718 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f6788067420 msgr2=0x7f67880698e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:07.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.618+0000 7f67a2f42640 1 --2- 172.21.15.50:0/3501262718 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f6788067420 0x7f67880698e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f679800b9d0 tx=0x7f6798008040 comp rx=0 tx=0).stop 2024-04-01T01:56:07.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.618+0000 7f67a2f42640 1 -- 172.21.15.50:0/3501262718 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f679c151de0 msgr2=0x7f679c14a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:07.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.618+0000 7f67a2f42640 1 --2- 172.21.15.50:0/3501262718 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f679c151de0 0x7f679c14a2d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f678c00c520 tx=0x7f678c00c9e0 comp rx=0 tx=0).stop 2024-04-01T01:56:07.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.618+0000 7f67a2f42640 1 -- 172.21.15.50:0/3501262718 shutdown_connections 2024-04-01T01:56:07.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.618+0000 7f67a2f42640 1 --2- 172.21.15.50:0/3501262718 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f6788067420 0x7f67880698e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:07.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.618+0000 7f67a2f42640 1 --2- 172.21.15.50:0/3501262718 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f679c158120 0x7f679c14a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:07.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.618+0000 7f67a2f42640 1 --2- 172.21.15.50:0/3501262718 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f679c151de0 0x7f679c14a2d0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:07.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.618+0000 7f67a2f42640 1 --2- 172.21.15.50:0/3501262718 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f679c0c2900 0x7f679c1ed790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:07.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.618+0000 7f67a2f42640 1 -- 172.21.15.50:0/3501262718 >> 172.21.15.50:0/3501262718 conn(0x7f679c067560 msgr2=0x7f679c146c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:56:07.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.618+0000 7f67a2f42640 1 -- 172.21.15.50:0/3501262718 shutdown_connections 2024-04-01T01:56:07.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.618+0000 7f67a2f42640 1 -- 172.21.15.50:0/3501262718 wait complete. 2024-04-01T01:56:07.637 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-04-01T01:56:07.665 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-04-01T01:56:07.666 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-04-01T01:56:07.666 INFO:tasks.ceph_fuse:client.0 config is {} 2024-04-01T01:56:07.666 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-01T01:56:07.666 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-01T01:56:07.666 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T01:56:07.666 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2024-04-01T01:56:07.672 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T01:56:07.672 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link delete ceph-brx 2024-04-01T01:56:07.727 INFO:teuthology.orchestra.run.smithi050.stderr:Cannot find device "ceph-brx" 2024-04-01T01:56:07.728 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-01T01:56:07.728 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-04-01T01:56:07.728 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-01T01:56:07.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.890+0000 7f1a959bd640 1 Processor -- start 2024-04-01T01:56:07.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.890+0000 7f1a959bd640 1 -- start start 2024-04-01T01:56:07.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.894+0000 7f1a959bd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f1a90151de0 0x7f1a90157be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:07.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.894+0000 7f1a959bd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1a90158120 0x7f1a90162560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:07.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.894+0000 7f1a959bd640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a900c30d0 con 0x7f1a900c2900 2024-04-01T01:56:07.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.894+0000 7f1a959bd640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f1a9015b370 con 0x7f1a90151de0 2024-04-01T01:56:07.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.894+0000 7f1a959bd640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f1a9015c0f0 con 0x7f1a90158120 2024-04-01T01:56:07.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.894+0000 7f1a8e7fc640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f1a900c2900 0x7f1a900c5f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39608/0 (socket says 172.21.15.50:39608) 2024-04-01T01:56:07.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.894+0000 7f1a8e7fc640 1 -- 172.21.15.50:0/1179336883 learned_addr learned my addr 172.21.15.50:0/1179336883 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-04-01T01:56:07.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.894+0000 7f1a8f7fe640 1 --2- 172.21.15.50:0/1179336883 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1a90158120 0x7f1a90162560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:07.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.894+0000 7f1a8effd640 1 --2- 172.21.15.50:0/1179336883 >> v2:172.21.15.97:3300/0 conn(0x7f1a90151de0 0x7f1a90157be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:07.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.894+0000 7f1a8dffb640 1 -- 172.21.15.50:0/1179336883 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3829389162 0 0) 0x7f1a900c30d0 con 0x7f1a900c2900 2024-04-01T01:56:07.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.894+0000 7f1a8dffb640 1 -- 172.21.15.50:0/1179336883 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1a78003530 con 0x7f1a900c2900 2024-04-01T01:56:07.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.894+0000 7f1a8dffb640 1 -- 172.21.15.50:0/1179336883 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2237379712 0 0) 0x7f1a78003530 con 0x7f1a900c2900 2024-04-01T01:56:07.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.894+0000 7f1a8dffb640 1 -- 172.21.15.50:0/1179336883 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1a90158120 msgr2=0x7f1a90162560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:56:07.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.894+0000 7f1a8dffb640 1 --2- 172.21.15.50:0/1179336883 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1a90158120 0x7f1a90162560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:07.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.894+0000 7f1a8dffb640 1 -- 172.21.15.50:0/1179336883 >> v2:172.21.15.97:3300/0 conn(0x7f1a90151de0 msgr2=0x7f1a90157be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:56:07.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.894+0000 7f1a8dffb640 1 --2- 172.21.15.50:0/1179336883 >> v2:172.21.15.97:3300/0 conn(0x7f1a90151de0 0x7f1a90157be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:07.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.894+0000 7f1a8dffb640 1 -- 172.21.15.50:0/1179336883 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a900c2df0 con 0x7f1a900c2900 2024-04-01T01:56:07.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.894+0000 7f1a8dffb640 1 -- 172.21.15.50:0/1179336883 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2779672543 0 0) 0x7f1a80001680 con 0x7f1a900c2900 2024-04-01T01:56:07.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.894+0000 7f1a8dffb640 1 -- 172.21.15.50:0/1179336883 >> v1:172.21.15.50:6789/0 conn(0x7f1a900c2900 legacy=0x7f1a900c5f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:07.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.894+0000 7f1a8dffb640 1 --2- 172.21.15.50:0/1179336883 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1a780039c0 0x7f1a78003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:07.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.894+0000 7f1a8dffb640 1 --2- 172.21.15.50:0/1179336883 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a78004810 0x7f1a78004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:07.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.894+0000 7f1a8dffb640 1 --2- 172.21.15.50:0/1179336883 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1a90158120 0x7f1a780051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:07.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.894+0000 7f1a8dffb640 1 -- 172.21.15.50:0/1179336883 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f1a9015b370 con 0x7f1a78004810 2024-04-01T01:56:07.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.894+0000 7f1a8dffb640 1 -- 172.21.15.50:0/1179336883 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f1a9015c0f0 con 0x7f1a780039c0 2024-04-01T01:56:07.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.894+0000 7f1a8dffb640 1 -- 172.21.15.50:0/1179336883 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f1a7800b9d0 con 0x7f1a90158120 2024-04-01T01:56:07.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.894+0000 7f1a8e7fc640 1 --2- 172.21.15.50:0/1179336883 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a78004810 0x7f1a78004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:07.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.894+0000 7f1a8f7fe640 1 --2- 172.21.15.50:0/1179336883 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1a90158120 0x7f1a780051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:07.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.894+0000 7f1a8effd640 1 --2- 172.21.15.50:0/1179336883 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1a780039c0 0x7f1a78003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:07.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.894+0000 7f1a8e7fc640 1 -- 172.21.15.50:0/1179336883 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1a90158120 msgr2=0x7f1a780051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:56:07.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.894+0000 7f1a8e7fc640 1 --2- 172.21.15.50:0/1179336883 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1a90158120 0x7f1a780051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:07.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.894+0000 7f1a8e7fc640 1 -- 172.21.15.50:0/1179336883 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1a780039c0 msgr2=0x7f1a78003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T01:56:07.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.894+0000 7f1a8e7fc640 1 --2- 172.21.15.50:0/1179336883 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1a780039c0 0x7f1a78003de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:07.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.894+0000 7f1a8e7fc640 1 -- 172.21.15.50:0/1179336883 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a78003530 con 0x7f1a78004810 2024-04-01T01:56:07.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.894+0000 7f1a8f7fe640 1 --2- 172.21.15.50:0/1179336883 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1a90158120 0x7f1a780051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T01:56:07.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.894+0000 7f1a8e7fc640 1 --2- 172.21.15.50:0/1179336883 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a78004810 0x7f1a78004c90 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1a8000c210 tx=0x7f1a8001cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a0ed7a720a7767d server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:56:07.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.898+0000 7f1a8dffb640 1 -- 172.21.15.50:0/1179336883 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a80007d60 con 0x7f1a78004810 2024-04-01T01:56:07.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.898+0000 7f1a8dffb640 1 -- 172.21.15.50:0/1179336883 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a800a9020 con 0x7f1a78004810 2024-04-01T01:56:07.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.898+0000 7f1a8dffb640 1 -- 172.21.15.50:0/1179336883 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a80005b20 con 0x7f1a78004810 2024-04-01T01:56:07.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.898+0000 7f1a959bd640 1 -- 172.21.15.50:0/1179336883 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a78004810 msgr2=0x7f1a78004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:07.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.898+0000 7f1a959bd640 1 --2- 172.21.15.50:0/1179336883 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a78004810 0x7f1a78004c90 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1a8000c210 tx=0x7f1a8001cca0 comp rx=0 tx=0).stop 2024-04-01T01:56:07.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.898+0000 7f1a8f7fe640 1 -- 172.21.15.50:0/1179336883 reap_dead start 2024-04-01T01:56:07.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.898+0000 7f1a959bd640 1 -- 172.21.15.50:0/1179336883 shutdown_connections 2024-04-01T01:56:07.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.898+0000 7f1a959bd640 1 -- 172.21.15.50:0/1179336883 >> 172.21.15.50:0/1179336883 conn(0x7f1a90067560 msgr2=0x7f1a9006b220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:56:07.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.898+0000 7f1a959bd640 1 -- 172.21.15.50:0/1179336883 shutdown_connections 2024-04-01T01:56:07.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.898+0000 7f1a959bd640 1 -- 172.21.15.50:0/1179336883 wait complete. 2024-04-01T01:56:07.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.898+0000 7f1a959bd640 1 Processor -- start 2024-04-01T01:56:07.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.898+0000 7f1a959bd640 1 -- start start 2024-04-01T01:56:07.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.898+0000 7f1a959bd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1a78004810 0x7f1a901ed610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:07.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.898+0000 7f1a959bd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1a9014b970 0x7f1a901eea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:07.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.898+0000 7f1a959bd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a90156dd0 0x7f1a90152250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:07.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.898+0000 7f1a959bd640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f1a9015bbd0 con 0x7f1a90156dd0 2024-04-01T01:56:07.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.898+0000 7f1a959bd640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f1a9015b8f0 con 0x7f1a9014b970 2024-04-01T01:56:07.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.898+0000 7f1a959bd640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f1a900c88a0 con 0x7f1a78004810 2024-04-01T01:56:07.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.898+0000 7f1a8f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a90156dd0 0x7f1a90152250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:07.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.898+0000 7f1a8f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a90156dd0 0x7f1a90152250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33018/0 (socket says 172.21.15.50:33018) 2024-04-01T01:56:07.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.898+0000 7f1a8f7fe640 1 -- 172.21.15.50:0/2504962270 learned_addr learned my addr 172.21.15.50:0/2504962270 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T01:56:07.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.898+0000 7f1a8effd640 1 --2- 172.21.15.50:0/2504962270 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1a78004810 0x7f1a901ed610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:07.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.898+0000 7f1a8e7fc640 1 --2- 172.21.15.50:0/2504962270 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1a9014b970 0x7f1a901eea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:07.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.898+0000 7f1a8f7fe640 1 -- 172.21.15.50:0/2504962270 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1a78004810 msgr2=0x7f1a901ed610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:07.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.898+0000 7f1a8f7fe640 1 --2- 172.21.15.50:0/2504962270 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1a78004810 0x7f1a901ed610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:07.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.898+0000 7f1a8f7fe640 1 -- 172.21.15.50:0/2504962270 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1a9014b970 msgr2=0x7f1a901eea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:07.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.898+0000 7f1a8f7fe640 1 --2- 172.21.15.50:0/2504962270 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1a9014b970 0x7f1a901eea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:07.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.898+0000 7f1a8f7fe640 1 -- 172.21.15.50:0/2504962270 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a90157400 con 0x7f1a90156dd0 2024-04-01T01:56:07.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.898+0000 7f1a8e7fc640 1 --2- 172.21.15.50:0/2504962270 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1a9014b970 0x7f1a901eea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T01:56:07.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.898+0000 7f1a8f7fe640 1 --2- 172.21.15.50:0/2504962270 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a90156dd0 0x7f1a90152250 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f1a900c8fc0 tx=0x7f1a8800f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:56:07.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.898+0000 7f1a77fff640 1 -- 172.21.15.50:0/2504962270 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a8801c070 con 0x7f1a90156dd0 2024-04-01T01:56:07.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.898+0000 7f1a77fff640 1 -- 172.21.15.50:0/2504962270 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a88017400 con 0x7f1a90156dd0 2024-04-01T01:56:07.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.898+0000 7f1a959bd640 1 -- 172.21.15.50:0/2504962270 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a90155a50 con 0x7f1a90156dd0 2024-04-01T01:56:07.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.898+0000 7f1a77fff640 1 -- 172.21.15.50:0/2504962270 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a880177d0 con 0x7f1a90156dd0 2024-04-01T01:56:07.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.898+0000 7f1a959bd640 1 -- 172.21.15.50:0/2504962270 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a90156010 con 0x7f1a90156dd0 2024-04-01T01:56:07.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.902+0000 7f1a959bd640 1 -- 172.21.15.50:0/2504962270 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a90068230 con 0x7f1a90156dd0 2024-04-01T01:56:07.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.902+0000 7f1a77fff640 1 -- 172.21.15.50:0/2504962270 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 87103+0+0 (secure 0 0 0) 0x7f1a8801f070 con 0x7f1a90156dd0 2024-04-01T01:56:07.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.902+0000 7f1a77fff640 1 --2- 172.21.15.50:0/2504962270 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f1a7c067450 0x7f1a7c069910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T01:56:07.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.902+0000 7f1a77fff640 1 -- 172.21.15.50:0/2504962270 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f1a880856d0 con 0x7f1a90156dd0 2024-04-01T01:56:07.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.902+0000 7f1a8effd640 1 --2- 172.21.15.50:0/2504962270 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f1a7c067450 0x7f1a7c069910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T01:56:07.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.902+0000 7f1a8effd640 1 --2- 172.21.15.50:0/2504962270 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f1a7c067450 0x7f1a7c069910 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1a84009ae0 tx=0x7f1a84008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T01:56:07.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:07.906+0000 7f1a77fff640 1 -- 172.21.15.50:0/2504962270 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+176632 (secure 0 0 0) 0x7f1a88012070 con 0x7f1a90156dd0 2024-04-01T01:56:08.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:08.102+0000 7f1a959bd640 1 -- 172.21.15.50:0/2504962270 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f1a900c7280 con 0x7f1a90156dd0 2024-04-01T01:56:08.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:08.102+0000 7f1a77fff640 1 -- 172.21.15.50:0/2504962270 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+73 (secure 0 0 0) 0x7f1a88055d90 con 0x7f1a90156dd0 2024-04-01T01:56:08.104 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-01T01:56:08.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:08.102+0000 7f1a959bd640 1 -- 172.21.15.50:0/2504962270 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f1a7c067450 msgr2=0x7f1a7c069910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:08.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:08.102+0000 7f1a959bd640 1 --2- 172.21.15.50:0/2504962270 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f1a7c067450 0x7f1a7c069910 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1a84009ae0 tx=0x7f1a84008040 comp rx=0 tx=0).stop 2024-04-01T01:56:08.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:08.102+0000 7f1a959bd640 1 -- 172.21.15.50:0/2504962270 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a90156dd0 msgr2=0x7f1a90152250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T01:56:08.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:08.102+0000 7f1a959bd640 1 --2- 172.21.15.50:0/2504962270 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a90156dd0 0x7f1a90152250 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f1a900c8fc0 tx=0x7f1a8800f4a0 comp rx=0 tx=0).stop 2024-04-01T01:56:08.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:08.102+0000 7f1a959bd640 1 -- 172.21.15.50:0/2504962270 shutdown_connections 2024-04-01T01:56:08.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:08.102+0000 7f1a959bd640 1 --2- 172.21.15.50:0/2504962270 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f1a7c067450 0x7f1a7c069910 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:08.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:08.102+0000 7f1a959bd640 1 --2- 172.21.15.50:0/2504962270 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a90156dd0 0x7f1a90152250 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:08.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:08.102+0000 7f1a959bd640 1 --2- 172.21.15.50:0/2504962270 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1a9014b970 0x7f1a901eea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:08.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:08.102+0000 7f1a959bd640 1 --2- 172.21.15.50:0/2504962270 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1a78004810 0x7f1a901ed610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T01:56:08.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:08.102+0000 7f1a959bd640 1 -- 172.21.15.50:0/2504962270 >> 172.21.15.50:0/2504962270 conn(0x7f1a90067560 msgr2=0x7f1a9014fe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T01:56:08.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:08.102+0000 7f1a959bd640 1 -- 172.21.15.50:0/2504962270 shutdown_connections 2024-04-01T01:56:08.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:08.102+0000 7f1a959bd640 1 -- 172.21.15.50:0/2504962270 wait complete. 2024-04-01T01:56:08.122 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-01T01:56:08.122 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-01T01:56:08.122 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi050.front.sepia.ceph.com 2024-04-01T01:56:08.122 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-01T01:56:08.122 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-01T01:56:08.122 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-01T01:56:08.122 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-01T01:56:08.122 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-01T01:56:08.123 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-01T01:56:08.123 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T01:56:08.123 DEBUG:teuthology.orchestra.run.smithi050:> ip addr 2024-04-01T01:56:08.129 INFO:teuthology.orchestra.run.smithi050.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-01T01:56:08.129 INFO:teuthology.orchestra.run.smithi050.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-01T01:56:08.129 INFO:teuthology.orchestra.run.smithi050.stdout: inet 127.0.0.1/8 scope host lo 2024-04-01T01:56:08.129 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-04-01T01:56:08.129 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 ::1/128 scope host 2024-04-01T01:56:08.129 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-04-01T01:56:08.129 INFO:teuthology.orchestra.run.smithi050.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-01T01:56:08.129 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f8 brd ff:ff:ff:ff:ff:ff 2024-04-01T01:56:08.129 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f0 2024-04-01T01:56:08.130 INFO:teuthology.orchestra.run.smithi050.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-01T01:56:08.130 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f9 brd ff:ff:ff:ff:ff:ff 2024-04-01T01:56:08.130 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f1 2024-04-01T01:56:08.130 INFO:teuthology.orchestra.run.smithi050.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-01T01:56:08.130 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:84 brd ff:ff:ff:ff:ff:ff 2024-04-01T01:56:08.130 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f0 2024-04-01T01:56:08.130 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.21.15.50/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-04-01T01:56:08.130 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft 42501sec preferred_lft 42501sec 2024-04-01T01:56:08.130 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::ec4:7aff:febd:1584/64 scope link 2024-04-01T01:56:08.130 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-04-01T01:56:08.130 INFO:teuthology.orchestra.run.smithi050.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-01T01:56:08.130 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:85 brd ff:ff:ff:ff:ff:ff 2024-04-01T01:56:08.131 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f1 2024-04-01T01:56:08.131 INFO:teuthology.orchestra.run.smithi050.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-01T01:56:08.131 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 02:42:dc:46:59:49 brd ff:ff:ff:ff:ff:ff 2024-04-01T01:56:08.131 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-01T01:56:08.131 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-04-01T01:56:08.131 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-01T01:56:08.131 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-01T01:56:08.132 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-04-01T01:56:08.132 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link add name ceph-brx type bridge 2024-04-01T01:56:08.132 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip addr flush dev ceph-brx 2024-04-01T01:56:08.132 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set ceph-brx up 2024-04-01T01:56:08.132 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-01T01:56:08.132 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-04-01T01:56:08.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-01T01:56:08.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-01T01:56:08.254 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T01:56:08.254 DEBUG:teuthology.orchestra.run.smithi050:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-01T01:56:08.307 INFO:teuthology.orchestra.run.smithi050.stdout:1 2024-04-01T01:56:08.308 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T01:56:08.309 DEBUG:teuthology.orchestra.run.smithi050:> route 2024-04-01T01:56:08.366 INFO:teuthology.orchestra.run.smithi050.stdout:Kernel IP routing table 2024-04-01T01:56:08.366 INFO:teuthology.orchestra.run.smithi050.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-01T01:56:08.366 INFO:teuthology.orchestra.run.smithi050.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-04-01T01:56:08.366 INFO:teuthology.orchestra.run.smithi050.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-01T01:56:08.366 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-04-01T01:56:08.366 INFO:teuthology.orchestra.run.smithi050.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-01T01:56:08.367 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-01T01:56:08.367 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-04-01T01:56:08.368 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-01T01:56:08.368 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-01T01:56:08.368 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-01T01:56:08.368 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-04-01T01:56:08.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-01T01:56:08.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-01T01:56:08.487 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T01:56:08.487 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2024-04-01T01:56:08.536 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T01:56:08.536 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list-id 2024-04-01T01:56:08.583 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-01T01:56:08.583 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-04-01T01:56:08.583 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-01T01:56:08.583 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-01T01:56:08.584 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-04-01T01:56:08.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-01T01:56:08.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-01T01:56:08.703 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-01T01:56:08.703 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-01T01:56:08.703 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-04-01T01:56:08.703 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-01T01:56:08.703 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-01T01:56:08.703 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-01T01:56:08.704 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-01T01:56:08.704 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-01T01:56:08.704 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-04-01T01:56:08.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-01T01:56:08.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-01T01:56:08.809 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-01T01:56:08.809 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-04-01T01:56:08.809 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set brx.0 up 2024-04-01T01:56:08.809 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set dev brx.0 master ceph-brx 2024-04-01T01:56:08.809 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-04-01T01:56:08.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-01T01:56:08.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-01T01:56:08.912 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-04-01T01:56:08.912 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-01T01:56:08.912 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-01T01:56:08.959 INFO:teuthology.orchestra.run.smithi050.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-01T01:56:08.959 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-01T01:56:08.959 DEBUG:teuthology.orchestra.run.smithi050:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-01T01:56:09.007 DEBUG:teuthology.orchestra.run.smithi050:> sudo modprobe fuse 2024-04-01T01:56:09.064 DEBUG:teuthology.orchestra.run.smithi050:> cat /proc/self/mounts | awk '{print $2}' 2024-04-01T01:56:09.113 INFO:teuthology.orchestra.run.smithi050.stdout:/sys 2024-04-01T01:56:09.114 INFO:teuthology.orchestra.run.smithi050.stdout:/proc 2024-04-01T01:56:09.114 INFO:teuthology.orchestra.run.smithi050.stdout:/dev 2024-04-01T01:56:09.114 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/pts 2024-04-01T01:56:09.114 INFO:teuthology.orchestra.run.smithi050.stdout:/run 2024-04-01T01:56:09.114 INFO:teuthology.orchestra.run.smithi050.stdout:/ 2024-04-01T01:56:09.114 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/security 2024-04-01T01:56:09.114 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/shm 2024-04-01T01:56:09.114 INFO:teuthology.orchestra.run.smithi050.stdout:/run/lock 2024-04-01T01:56:09.114 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/cgroup 2024-04-01T01:56:09.114 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/pstore 2024-04-01T01:56:09.114 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/bpf 2024-04-01T01:56:09.115 INFO:teuthology.orchestra.run.smithi050.stdout:/proc/sys/fs/binfmt_misc 2024-04-01T01:56:09.115 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/hugepages 2024-04-01T01:56:09.115 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/mqueue 2024-04-01T01:56:09.115 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/debug 2024-04-01T01:56:09.115 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/tracing 2024-04-01T01:56:09.115 INFO:teuthology.orchestra.run.smithi050.stdout:/proc/fs/nfsd 2024-04-01T01:56:09.115 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/fuse/connections 2024-04-01T01:56:09.115 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/config 2024-04-01T01:56:09.115 INFO:teuthology.orchestra.run.smithi050.stdout:/run/credentials/systemd-sysusers.service 2024-04-01T01:56:09.115 INFO:teuthology.orchestra.run.smithi050.stdout:/run/rpc_pipefs 2024-04-01T01:56:09.115 INFO:teuthology.orchestra.run.smithi050.stdout:/run/user/1000 2024-04-01T01:56:09.115 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph 2024-04-01T01:56:09.115 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph/osd/ceph-0 2024-04-01T01:56:09.115 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph/osd/ceph-1 2024-04-01T01:56:09.116 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph/osd/ceph-2 2024-04-01T01:56:09.116 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph/osd/ceph-3 2024-04-01T01:56:09.116 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns 2024-04-01T01:56:09.116 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-01T01:56:09.116 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-01T01:56:09.117 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T01:56:09.117 DEBUG:teuthology.orchestra.run.smithi050:> ls /sys/fs/fuse/connections 2024-04-01T01:56:09.163 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-01T01:56:09.163 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-04-01T01:56:09.208 DEBUG:teuthology.orchestra.run.smithi050:> sudo modprobe fuse 2024-04-01T01:56:09.222 DEBUG:teuthology.orchestra.run.smithi050:> cat /proc/self/mounts | awk '{print $2}' 2024-04-01T01:56:09.271 INFO:teuthology.orchestra.run.smithi050.stdout:/sys 2024-04-01T01:56:09.272 INFO:teuthology.orchestra.run.smithi050.stdout:/proc 2024-04-01T01:56:09.272 INFO:teuthology.orchestra.run.smithi050.stdout:/dev 2024-04-01T01:56:09.272 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/pts 2024-04-01T01:56:09.272 INFO:teuthology.orchestra.run.smithi050.stdout:/run 2024-04-01T01:56:09.272 INFO:teuthology.orchestra.run.smithi050.stdout:/ 2024-04-01T01:56:09.272 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/security 2024-04-01T01:56:09.272 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/shm 2024-04-01T01:56:09.272 INFO:teuthology.orchestra.run.smithi050.stdout:/run/lock 2024-04-01T01:56:09.272 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/cgroup 2024-04-01T01:56:09.272 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/pstore 2024-04-01T01:56:09.272 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/bpf 2024-04-01T01:56:09.272 INFO:teuthology.orchestra.run.smithi050.stdout:/proc/sys/fs/binfmt_misc 2024-04-01T01:56:09.272 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/hugepages 2024-04-01T01:56:09.273 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/mqueue 2024-04-01T01:56:09.273 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/debug 2024-04-01T01:56:09.273 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/tracing 2024-04-01T01:56:09.273 INFO:teuthology.orchestra.run.smithi050.stdout:/proc/fs/nfsd 2024-04-01T01:56:09.273 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/fuse/connections 2024-04-01T01:56:09.273 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/config 2024-04-01T01:56:09.273 INFO:teuthology.orchestra.run.smithi050.stdout:/run/credentials/systemd-sysusers.service 2024-04-01T01:56:09.273 INFO:teuthology.orchestra.run.smithi050.stdout:/run/rpc_pipefs 2024-04-01T01:56:09.273 INFO:teuthology.orchestra.run.smithi050.stdout:/run/user/1000 2024-04-01T01:56:09.273 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph 2024-04-01T01:56:09.273 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph/osd/ceph-0 2024-04-01T01:56:09.273 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph/osd/ceph-1 2024-04-01T01:56:09.273 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph/osd/ceph-2 2024-04-01T01:56:09.273 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph/osd/ceph-3 2024-04-01T01:56:09.273 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns 2024-04-01T01:56:09.274 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-01T01:56:09.274 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-01T01:56:09.274 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T01:56:09.275 DEBUG:teuthology.orchestra.run.smithi050:> ls /sys/fs/fuse/connections 2024-04-01T01:56:09.292 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi050.stderr:2024-04-01T01:56:09.290+0000 7f1314b25580 -1 init, newargv = 0x5569a6b8cd30 newargc=15 2024-04-01T01:56:09.292 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi050.stderr:ceph-fuse[33064]: starting ceph client 2024-04-01T01:56:09.298 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi050.stderr:ceph-fuse[33064]: starting fuse 2024-04-01T01:56:10.398 DEBUG:teuthology.orchestra.run.smithi050:> sudo modprobe fuse 2024-04-01T01:56:10.414 DEBUG:teuthology.orchestra.run.smithi050:> cat /proc/self/mounts | awk '{print $2}' 2024-04-01T01:56:10.469 INFO:teuthology.orchestra.run.smithi050.stdout:/sys 2024-04-01T01:56:10.470 INFO:teuthology.orchestra.run.smithi050.stdout:/proc 2024-04-01T01:56:10.470 INFO:teuthology.orchestra.run.smithi050.stdout:/dev 2024-04-01T01:56:10.470 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/pts 2024-04-01T01:56:10.470 INFO:teuthology.orchestra.run.smithi050.stdout:/run 2024-04-01T01:56:10.470 INFO:teuthology.orchestra.run.smithi050.stdout:/ 2024-04-01T01:56:10.470 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/security 2024-04-01T01:56:10.470 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/shm 2024-04-01T01:56:10.470 INFO:teuthology.orchestra.run.smithi050.stdout:/run/lock 2024-04-01T01:56:10.470 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/cgroup 2024-04-01T01:56:10.470 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/pstore 2024-04-01T01:56:10.470 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/bpf 2024-04-01T01:56:10.470 INFO:teuthology.orchestra.run.smithi050.stdout:/proc/sys/fs/binfmt_misc 2024-04-01T01:56:10.471 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/hugepages 2024-04-01T01:56:10.471 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/mqueue 2024-04-01T01:56:10.471 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/debug 2024-04-01T01:56:10.471 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/tracing 2024-04-01T01:56:10.471 INFO:teuthology.orchestra.run.smithi050.stdout:/proc/fs/nfsd 2024-04-01T01:56:10.471 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/fuse/connections 2024-04-01T01:56:10.471 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/config 2024-04-01T01:56:10.471 INFO:teuthology.orchestra.run.smithi050.stdout:/run/credentials/systemd-sysusers.service 2024-04-01T01:56:10.471 INFO:teuthology.orchestra.run.smithi050.stdout:/run/rpc_pipefs 2024-04-01T01:56:10.471 INFO:teuthology.orchestra.run.smithi050.stdout:/run/user/1000 2024-04-01T01:56:10.471 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph 2024-04-01T01:56:10.471 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph/osd/ceph-0 2024-04-01T01:56:10.471 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph/osd/ceph-1 2024-04-01T01:56:10.472 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph/osd/ceph-2 2024-04-01T01:56:10.472 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph/osd/ceph-3 2024-04-01T01:56:10.472 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns 2024-04-01T01:56:10.472 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-01T01:56:10.472 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-01T01:56:10.472 INFO:teuthology.orchestra.run.smithi050.stdout:/home/ubuntu/cephtest/mnt.0 2024-04-01T01:56:10.473 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T01:56:10.473 DEBUG:teuthology.orchestra.run.smithi050:> ls /sys/fs/fuse/connections 2024-04-01T01:56:10.519 INFO:teuthology.orchestra.run.smithi050.stdout:45 2024-04-01T01:56:10.520 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-04-01T01:56:10.520 DEBUG:teuthology.orchestra.run.smithi050:> sudo stdin-killer -- python3 -c ' 2024-04-01T01:56:10.520 DEBUG:teuthology.orchestra.run.smithi050:> import glob 2024-04-01T01:56:10.520 DEBUG:teuthology.orchestra.run.smithi050:> import re 2024-04-01T01:56:10.520 DEBUG:teuthology.orchestra.run.smithi050:> import os 2024-04-01T01:56:10.520 DEBUG:teuthology.orchestra.run.smithi050:> import subprocess 2024-04-01T01:56:10.520 DEBUG:teuthology.orchestra.run.smithi050:> 2024-04-01T01:56:10.520 DEBUG:teuthology.orchestra.run.smithi050:> def _find_admin_socket(client_name): 2024-04-01T01:56:10.521 DEBUG:teuthology.orchestra.run.smithi050:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-04-01T01:56:10.521 DEBUG:teuthology.orchestra.run.smithi050:> files = glob.glob(asok_path) 2024-04-01T01:56:10.521 DEBUG:teuthology.orchestra.run.smithi050:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-04-01T01:56:10.521 DEBUG:teuthology.orchestra.run.smithi050:> 2024-04-01T01:56:10.521 DEBUG:teuthology.orchestra.run.smithi050:> # Given a non-glob path, it better be there 2024-04-01T01:56:10.521 DEBUG:teuthology.orchestra.run.smithi050:> if "*" not in asok_path: 2024-04-01T01:56:10.521 DEBUG:teuthology.orchestra.run.smithi050:> assert(len(files) == 1) 2024-04-01T01:56:10.521 DEBUG:teuthology.orchestra.run.smithi050:> return files[0] 2024-04-01T01:56:10.521 DEBUG:teuthology.orchestra.run.smithi050:> 2024-04-01T01:56:10.521 DEBUG:teuthology.orchestra.run.smithi050:> for f in files: 2024-04-01T01:56:10.521 DEBUG:teuthology.orchestra.run.smithi050:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-01T01:56:10.521 DEBUG:teuthology.orchestra.run.smithi050:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-01T01:56:10.522 DEBUG:teuthology.orchestra.run.smithi050:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-01T01:56:10.522 DEBUG:teuthology.orchestra.run.smithi050:> contents = proc_f.read() 2024-04-01T01:56:10.522 DEBUG:teuthology.orchestra.run.smithi050:> if mountpoint in contents: 2024-04-01T01:56:10.522 DEBUG:teuthology.orchestra.run.smithi050:> return f 2024-04-01T01:56:10.522 DEBUG:teuthology.orchestra.run.smithi050:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-01T01:56:10.522 DEBUG:teuthology.orchestra.run.smithi050:> 2024-04-01T01:56:10.523 DEBUG:teuthology.orchestra.run.smithi050:> print(_find_admin_socket("client.0")) 2024-04-01T01:56:10.523 DEBUG:teuthology.orchestra.run.smithi050:> ' 2024-04-01T01:56:10.647 INFO:teuthology.orchestra.run.smithi050.stdout:/var/run/ceph/ceph-client.0.33064.asok 2024-04-01T01:56:10.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T01:56:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-01T01:56:10.659 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.33064.asok 2024-04-01T01:56:10.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T01:56:10.660 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.33064.asok status 2024-04-01T01:56:10.819 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-04-01T01:56:10.819 INFO:teuthology.orchestra.run.smithi050.stdout: "metadata": { 2024-04-01T01:56:10.819 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_sha1": "384f31f3d3aee7f8ba3f60846b8844c049165583", 2024-04-01T01:56:10.819 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_version": "ceph version 19.0.0-1977-g384f31f3 (384f31f3d3aee7f8ba3f60846b8844c049165583) squid (dev)", 2024-04-01T01:56:10.819 INFO:teuthology.orchestra.run.smithi050.stdout: "entity_id": "0", 2024-04-01T01:56:10.819 INFO:teuthology.orchestra.run.smithi050.stdout: "hostname": "smithi050", 2024-04-01T01:56:10.820 INFO:teuthology.orchestra.run.smithi050.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-04-01T01:56:10.820 INFO:teuthology.orchestra.run.smithi050.stdout: "pid": "33064", 2024-04-01T01:56:10.820 INFO:teuthology.orchestra.run.smithi050.stdout: "root": "/" 2024-04-01T01:56:10.820 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-04-01T01:56:10.820 INFO:teuthology.orchestra.run.smithi050.stdout: "dentry_count": 0, 2024-04-01T01:56:10.820 INFO:teuthology.orchestra.run.smithi050.stdout: "dentry_pinned_count": 0, 2024-04-01T01:56:10.820 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 4683, 2024-04-01T01:56:10.820 INFO:teuthology.orchestra.run.smithi050.stdout: "inst": { 2024-04-01T01:56:10.820 INFO:teuthology.orchestra.run.smithi050.stdout: "name": { 2024-04-01T01:56:10.820 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "client", 2024-04-01T01:56:10.820 INFO:teuthology.orchestra.run.smithi050.stdout: "num": 4683 2024-04-01T01:56:10.820 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-04-01T01:56:10.820 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": { 2024-04-01T01:56:10.820 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-04-01T01:56:10.821 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "192.168.0.1:0", 2024-04-01T01:56:10.821 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2698718967 2024-04-01T01:56:10.821 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-04-01T01:56:10.821 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-04-01T01:56:10.821 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": { 2024-04-01T01:56:10.821 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-04-01T01:56:10.821 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "192.168.0.1:0", 2024-04-01T01:56:10.821 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2698718967 2024-04-01T01:56:10.821 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-04-01T01:56:10.821 INFO:teuthology.orchestra.run.smithi050.stdout: "inst_str": "client.4683 192.168.0.1:0/2698718967", 2024-04-01T01:56:10.821 INFO:teuthology.orchestra.run.smithi050.stdout: "addr_str": "192.168.0.1:0/2698718967", 2024-04-01T01:56:10.821 INFO:teuthology.orchestra.run.smithi050.stdout: "inode_count": 1, 2024-04-01T01:56:10.821 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_epoch": 7, 2024-04-01T01:56:10.821 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_epoch": 21, 2024-04-01T01:56:10.822 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_epoch_barrier": 0, 2024-04-01T01:56:10.822 INFO:teuthology.orchestra.run.smithi050.stdout: "blocklisted": false, 2024-04-01T01:56:10.822 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs" 2024-04-01T01:56:10.822 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-04-01T01:56:10.833 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T01:56:10.833 DEBUG:teuthology.orchestra.run.smithi050:> stat --file-system '--printf=%T 2024-04-01T01:56:10.834 DEBUG:teuthology.orchestra.run.smithi050:> ' -- /home/ubuntu/cephtest/mnt.0 2024-04-01T01:56:10.840 INFO:teuthology.orchestra.run.smithi050.stdout:fuseblk 2024-04-01T01:56:10.840 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-04-01T01:56:10.840 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T01:56:10.840 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-01T01:56:10.896 INFO:teuthology.run_tasks:Running task workunit... 2024-04-01T01:56:10.908 INFO:tasks.workunit:Pulling workunits from ref 384f31f3d3aee7f8ba3f60846b8844c049165583 2024-04-01T01:56:10.909 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-04-01T01:56:10.909 INFO:tasks.workunit:timeout=3h 2024-04-01T01:56:10.909 INFO:tasks.workunit:cleanup=True 2024-04-01T01:56:10.909 DEBUG:teuthology.orchestra.run.smithi050:> stat -- /home/ubuntu/cephtest/mnt.0 2024-04-01T01:56:10.945 INFO:teuthology.orchestra.run.smithi050.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-04-01T01:56:10.945 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-04-01T01:56:10.945 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 2dh/45d Inode: 1 Links: 2 2024-04-01T01:56:10.945 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-01T01:56:10.946 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-04-01T01:56:10.946 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2024-04-01 01:55:49.220134058 +0000 2024-04-01T01:56:10.946 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2024-04-01 01:56:10.895938589 +0000 2024-04-01T01:56:10.946 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: - 2024-04-01T01:56:10.946 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-04-01T01:56:10.946 DEBUG:teuthology.orchestra.run.smithi050:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-04-01T01:56:11.017 DEBUG:teuthology.orchestra.run.smithi050:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 384f31f3d3aee7f8ba3f60846b8844c049165583 2024-04-01T01:56:11.066 INFO:tasks.workunit.client.0.smithi050.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-04-01T01:56:21.656 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T01:56:21.659 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T01:56:51.771 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T01:56:51.775 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T01:57:17.519 INFO:tasks.workunit.client.0.smithi050.stderr:Updating files: 97% (12098/12435) Updating files: 98% (12187/12435) Updating files: 99% (12311/12435) Updating files: 100% (12435/12435) Updating files: 100% (12435/12435), done. 2024-04-01T01:57:18.121 INFO:tasks.workunit.client.0.smithi050.stderr:Note: switching to '384f31f3d3aee7f8ba3f60846b8844c049165583'. 2024-04-01T01:57:18.121 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-04-01T01:57:18.121 INFO:tasks.workunit.client.0.smithi050.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-01T01:57:18.121 INFO:tasks.workunit.client.0.smithi050.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-01T01:57:18.122 INFO:tasks.workunit.client.0.smithi050.stderr:state without impacting any branches by switching back to a branch. 2024-04-01T01:57:18.122 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-04-01T01:57:18.122 INFO:tasks.workunit.client.0.smithi050.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-01T01:57:18.122 INFO:tasks.workunit.client.0.smithi050.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-01T01:57:18.122 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-04-01T01:57:18.122 INFO:tasks.workunit.client.0.smithi050.stderr: git switch -c 2024-04-01T01:57:18.122 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-04-01T01:57:18.122 INFO:tasks.workunit.client.0.smithi050.stderr:Or undo this operation with: 2024-04-01T01:57:18.123 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-04-01T01:57:18.123 INFO:tasks.workunit.client.0.smithi050.stderr: git switch - 2024-04-01T01:57:18.123 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-04-01T01:57:18.123 INFO:tasks.workunit.client.0.smithi050.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-01T01:57:18.123 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-04-01T01:57:18.123 INFO:tasks.workunit.client.0.smithi050.stderr:HEAD is now at 384f31f3d3a Merge pull request #56593 from zdover23/wip-doc-2024-03-31-backport-56592-to-squid 2024-04-01T01:57:18.126 DEBUG:teuthology.orchestra.run.smithi050:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-04-01T01:57:18.135 INFO:tasks.workunit.client.0.smithi050.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-01T01:57:18.138 INFO:tasks.workunit.client.0.smithi050.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-01T01:57:18.138 INFO:tasks.workunit.client.0.smithi050.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-01T01:57:18.991 INFO:tasks.workunit.client.0.smithi050.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-01T01:57:19.075 INFO:tasks.workunit.client.0.smithi050.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-01T01:57:19.138 INFO:tasks.workunit.client.0.smithi050.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-01T01:57:19.139 INFO:tasks.workunit.client.0.smithi050.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-01T01:57:19.139 INFO:tasks.workunit.client.0.smithi050.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-01T01:57:19.190 INFO:tasks.workunit.client.0.smithi050.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-01T01:57:19.194 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-04-01T01:57:19.194 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-04-01T01:57:19.240 INFO:tasks.workunit:Running workunits matching suites/dbench.sh on client.0... 2024-04-01T01:57:19.242 INFO:tasks.workunit:Running workunit suites/dbench.sh... 2024-04-01T01:57:19.242 DEBUG:teuthology.orchestra.run.smithi050:workunit test suites/dbench.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=384f31f3d3aee7f8ba3f60846b8844c049165583 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/dbench.sh 2024-04-01T01:57:19.306 INFO:tasks.workunit.client.0.smithi050.stderr:+ dbench 1 2024-04-01T01:57:19.315 INFO:tasks.workunit.client.0.smithi050.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2024-04-01T01:57:19.315 INFO:tasks.workunit.client.0.smithi050.stdout: 2024-04-01T01:57:19.316 INFO:tasks.workunit.client.0.smithi050.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2024-04-01T01:57:19.318 INFO:tasks.workunit.client.0.smithi050.stdout:0 of 1 processes prepared for launch 0 sec 2024-04-01T01:57:19.418 INFO:tasks.workunit.client.0.smithi050.stdout:1 of 1 processes prepared for launch 0 sec 2024-04-01T01:57:19.418 INFO:tasks.workunit.client.0.smithi050.stdout:releasing clients 2024-04-01T01:57:20.418 INFO:tasks.workunit.client.0.smithi050.stdout: 1 453 15.91 MB/sec warmup 1 sec latency 20.015 ms 2024-04-01T01:57:21.418 INFO:tasks.workunit.client.0.smithi050.stdout: 1 813 10.74 MB/sec warmup 2 sec latency 30.836 ms 2024-04-01T01:57:21.893 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T01:57:21.897 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T01:57:22.418 INFO:tasks.workunit.client.0.smithi050.stdout: 1 1060 7.63 MB/sec warmup 3 sec latency 30.845 ms 2024-04-01T01:57:23.418 INFO:tasks.workunit.client.0.smithi050.stdout: 1 1284 5.79 MB/sec warmup 4 sec latency 37.225 ms 2024-04-01T01:57:24.418 INFO:tasks.workunit.client.0.smithi050.stdout: 1 1589 5.23 MB/sec warmup 5 sec latency 33.172 ms 2024-04-01T01:57:25.418 INFO:tasks.workunit.client.0.smithi050.stdout: 1 1855 4.39 MB/sec warmup 6 sec latency 31.146 ms 2024-04-01T01:57:26.419 INFO:tasks.workunit.client.0.smithi050.stdout: 1 2093 3.81 MB/sec warmup 7 sec latency 32.049 ms 2024-04-01T01:57:27.419 INFO:tasks.workunit.client.0.smithi050.stdout: 1 2364 3.49 MB/sec warmup 8 sec latency 33.175 ms 2024-04-01T01:57:28.419 INFO:tasks.workunit.client.0.smithi050.stdout: 1 2580 3.22 MB/sec warmup 9 sec latency 34.144 ms 2024-04-01T01:57:29.419 INFO:tasks.workunit.client.0.smithi050.stdout: 1 2968 3.35 MB/sec warmup 10 sec latency 35.582 ms 2024-04-01T01:57:30.419 INFO:tasks.workunit.client.0.smithi050.stdout: 1 3295 3.21 MB/sec warmup 11 sec latency 31.357 ms 2024-04-01T01:57:31.419 INFO:tasks.workunit.client.0.smithi050.stdout: 1 3358 2.95 MB/sec warmup 12 sec latency 37.529 ms 2024-04-01T01:57:32.419 INFO:tasks.workunit.client.0.smithi050.stdout: 1 3686 2.98 MB/sec warmup 13 sec latency 37.479 ms 2024-04-01T01:57:33.419 INFO:tasks.workunit.client.0.smithi050.stdout: 1 3870 2.84 MB/sec warmup 14 sec latency 35.345 ms 2024-04-01T01:57:34.419 INFO:tasks.workunit.client.0.smithi050.stdout: 1 4017 2.67 MB/sec warmup 15 sec latency 35.353 ms 2024-04-01T01:57:35.419 INFO:tasks.workunit.client.0.smithi050.stdout: 1 4181 2.51 MB/sec warmup 16 sec latency 34.938 ms 2024-04-01T01:57:36.419 INFO:tasks.workunit.client.0.smithi050.stdout: 1 4450 2.40 MB/sec warmup 17 sec latency 54.487 ms 2024-04-01T01:57:37.419 INFO:tasks.workunit.client.0.smithi050.stdout: 1 4703 2.34 MB/sec warmup 18 sec latency 31.280 ms 2024-04-01T01:57:38.419 INFO:tasks.workunit.client.0.smithi050.stdout: 1 4963 2.38 MB/sec warmup 19 sec latency 41.930 ms 2024-04-01T01:57:39.420 INFO:tasks.workunit.client.0.smithi050.stdout: 1 5182 2.26 MB/sec warmup 20 sec latency 36.763 ms 2024-04-01T01:57:40.420 INFO:tasks.workunit.client.0.smithi050.stdout: 1 5460 2.17 MB/sec warmup 21 sec latency 36.227 ms 2024-04-01T01:57:41.420 INFO:tasks.workunit.client.0.smithi050.stdout: 1 5735 2.09 MB/sec warmup 22 sec latency 31.901 ms 2024-04-01T01:57:42.420 INFO:tasks.workunit.client.0.smithi050.stdout: 1 5954 2.05 MB/sec warmup 23 sec latency 38.350 ms 2024-04-01T01:57:43.420 INFO:tasks.workunit.client.0.smithi050.stdout: 1 6161 2.01 MB/sec warmup 24 sec latency 34.502 ms 2024-04-01T01:57:44.420 INFO:tasks.workunit.client.0.smithi050.stdout: 1 6551 2.11 MB/sec warmup 25 sec latency 31.681 ms 2024-04-01T01:57:45.420 INFO:tasks.workunit.client.0.smithi050.stdout: 1 6854 2.10 MB/sec warmup 26 sec latency 38.877 ms 2024-04-01T01:57:46.420 INFO:tasks.workunit.client.0.smithi050.stdout: 1 6919 2.02 MB/sec warmup 27 sec latency 33.825 ms 2024-04-01T01:57:47.420 INFO:tasks.workunit.client.0.smithi050.stdout: 1 7223 2.07 MB/sec warmup 28 sec latency 46.617 ms 2024-04-01T01:57:48.420 INFO:tasks.workunit.client.0.smithi050.stdout: 1 7410 2.03 MB/sec warmup 29 sec latency 33.458 ms 2024-04-01T01:57:49.420 INFO:tasks.workunit.client.0.smithi050.stdout: 1 7550 1.97 MB/sec warmup 30 sec latency 34.328 ms 2024-04-01T01:57:50.420 INFO:tasks.workunit.client.0.smithi050.stdout: 1 7715 1.91 MB/sec warmup 31 sec latency 38.302 ms 2024-04-01T01:57:51.420 INFO:tasks.workunit.client.0.smithi050.stdout: 1 7966 1.87 MB/sec warmup 32 sec latency 52.536 ms 2024-04-01T01:57:52.018 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T01:57:52.021 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T01:57:52.420 INFO:tasks.workunit.client.0.smithi050.stdout: 1 8210 1.85 MB/sec warmup 33 sec latency 34.498 ms 2024-04-01T01:57:53.420 INFO:tasks.workunit.client.0.smithi050.stdout: 1 8505 1.89 MB/sec warmup 34 sec latency 39.219 ms 2024-04-01T01:57:54.421 INFO:tasks.workunit.client.0.smithi050.stdout: 1 8733 1.84 MB/sec warmup 35 sec latency 33.709 ms 2024-04-01T01:57:55.421 INFO:tasks.workunit.client.0.smithi050.stdout: 1 9006 1.80 MB/sec warmup 36 sec latency 31.404 ms 2024-04-01T01:57:56.421 INFO:tasks.workunit.client.0.smithi050.stdout: 1 9266 1.76 MB/sec warmup 37 sec latency 36.760 ms 2024-04-01T01:57:57.421 INFO:tasks.workunit.client.0.smithi050.stdout: 1 9487 1.74 MB/sec warmup 38 sec latency 36.582 ms 2024-04-01T01:57:58.421 INFO:tasks.workunit.client.0.smithi050.stdout: 1 9702 1.72 MB/sec warmup 39 sec latency 32.467 ms 2024-04-01T01:57:59.421 INFO:tasks.workunit.client.0.smithi050.stdout: 1 10093 1.79 MB/sec warmup 40 sec latency 33.156 ms 2024-04-01T01:58:00.421 INFO:tasks.workunit.client.0.smithi050.stdout: 1 10407 1.80 MB/sec warmup 41 sec latency 32.570 ms 2024-04-01T01:58:01.421 INFO:tasks.workunit.client.0.smithi050.stdout: 1 10478 1.75 MB/sec warmup 42 sec latency 37.849 ms 2024-04-01T01:58:02.421 INFO:tasks.workunit.client.0.smithi050.stdout: 1 10786 1.79 MB/sec warmup 43 sec latency 36.646 ms 2024-04-01T01:58:03.421 INFO:tasks.workunit.client.0.smithi050.stdout: 1 10976 1.77 MB/sec warmup 44 sec latency 32.504 ms 2024-04-01T01:58:04.421 INFO:tasks.workunit.client.0.smithi050.stdout: 1 11117 1.74 MB/sec warmup 45 sec latency 30.602 ms 2024-04-01T01:58:05.422 INFO:tasks.workunit.client.0.smithi050.stdout: 1 11275 1.70 MB/sec warmup 46 sec latency 51.074 ms 2024-04-01T01:58:06.422 INFO:tasks.workunit.client.0.smithi050.stdout: 1 11561 1.68 MB/sec warmup 47 sec latency 29.421 ms 2024-04-01T01:58:07.422 INFO:tasks.workunit.client.0.smithi050.stdout: 1 11790 1.67 MB/sec warmup 48 sec latency 35.693 ms 2024-04-01T01:58:08.422 INFO:tasks.workunit.client.0.smithi050.stdout: 1 12074 1.70 MB/sec warmup 49 sec latency 35.555 ms 2024-04-01T01:58:09.422 INFO:tasks.workunit.client.0.smithi050.stdout: 1 12299 1.67 MB/sec warmup 50 sec latency 34.073 ms 2024-04-01T01:58:10.422 INFO:tasks.workunit.client.0.smithi050.stdout: 1 12568 1.64 MB/sec warmup 51 sec latency 37.635 ms 2024-04-01T01:58:11.422 INFO:tasks.workunit.client.0.smithi050.stdout: 1 12833 1.62 MB/sec warmup 52 sec latency 35.028 ms 2024-04-01T01:58:12.422 INFO:tasks.workunit.client.0.smithi050.stdout: 1 13078 1.61 MB/sec warmup 53 sec latency 31.815 ms 2024-04-01T01:58:13.422 INFO:tasks.workunit.client.0.smithi050.stdout: 1 13272 1.60 MB/sec warmup 54 sec latency 37.560 ms 2024-04-01T01:58:14.422 INFO:tasks.workunit.client.0.smithi050.stdout: 1 13817 1.66 MB/sec warmup 55 sec latency 33.048 ms 2024-04-01T01:58:15.422 INFO:tasks.workunit.client.0.smithi050.stdout: 1 13965 1.66 MB/sec warmup 56 sec latency 35.436 ms 2024-04-01T01:58:16.422 INFO:tasks.workunit.client.0.smithi050.stdout: 1 14176 1.68 MB/sec warmup 57 sec latency 33.605 ms 2024-04-01T01:58:17.422 INFO:tasks.workunit.client.0.smithi050.stdout: 1 14429 1.67 MB/sec warmup 58 sec latency 31.925 ms 2024-04-01T01:58:18.422 INFO:tasks.workunit.client.0.smithi050.stdout: 1 14577 1.65 MB/sec warmup 59 sec latency 31.269 ms 2024-04-01T01:58:19.422 INFO:tasks.workunit.client.0.smithi050.stdout: 1 14709 1.62 MB/sec warmup 60 sec latency 37.085 ms 2024-04-01T01:58:20.422 INFO:tasks.workunit.client.0.smithi050.stdout: 1 14928 1.60 MB/sec warmup 61 sec latency 43.857 ms 2024-04-01T01:58:21.423 INFO:tasks.workunit.client.0.smithi050.stdout: 1 15174 1.59 MB/sec warmup 62 sec latency 32.968 ms 2024-04-01T01:58:22.423 INFO:tasks.workunit.client.0.smithi050.stdout: 1 15404 1.58 MB/sec warmup 63 sec latency 38.080 ms 2024-04-01T01:58:22.676 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T01:58:22.679 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T01:58:23.423 INFO:tasks.workunit.client.0.smithi050.stdout: 1 15690 1.60 MB/sec warmup 64 sec latency 34.241 ms 2024-04-01T01:58:24.423 INFO:tasks.workunit.client.0.smithi050.stdout: 1 15939 1.58 MB/sec warmup 65 sec latency 34.937 ms 2024-04-01T01:58:25.423 INFO:tasks.workunit.client.0.smithi050.stdout: 1 16205 1.56 MB/sec warmup 66 sec latency 32.849 ms 2024-04-01T01:58:26.423 INFO:tasks.workunit.client.0.smithi050.stdout: 1 16489 1.56 MB/sec warmup 67 sec latency 35.926 ms 2024-04-01T01:58:27.423 INFO:tasks.workunit.client.0.smithi050.stdout: 1 16663 1.55 MB/sec warmup 68 sec latency 31.496 ms 2024-04-01T01:58:28.423 INFO:tasks.workunit.client.0.smithi050.stdout: 1 17064 1.58 MB/sec warmup 69 sec latency 31.013 ms 2024-04-01T01:58:29.424 INFO:tasks.workunit.client.0.smithi050.stdout: 1 17463 1.60 MB/sec warmup 70 sec latency 39.442 ms 2024-04-01T01:58:30.424 INFO:tasks.workunit.client.0.smithi050.stdout: 1 17523 1.58 MB/sec warmup 71 sec latency 33.297 ms 2024-04-01T01:58:31.424 INFO:tasks.workunit.client.0.smithi050.stdout: 1 17813 1.60 MB/sec warmup 72 sec latency 33.044 ms 2024-04-01T01:58:32.424 INFO:tasks.workunit.client.0.smithi050.stdout: 1 18019 1.59 MB/sec warmup 73 sec latency 36.066 ms 2024-04-01T01:58:33.424 INFO:tasks.workunit.client.0.smithi050.stdout: 1 18158 1.57 MB/sec warmup 74 sec latency 30.453 ms 2024-04-01T01:58:34.424 INFO:tasks.workunit.client.0.smithi050.stdout: 1 18318 1.55 MB/sec warmup 75 sec latency 33.468 ms 2024-04-01T01:58:35.424 INFO:tasks.workunit.client.0.smithi050.stdout: 1 18566 1.54 MB/sec warmup 76 sec latency 41.509 ms 2024-04-01T01:58:36.424 INFO:tasks.workunit.client.0.smithi050.stdout: 1 18800 1.54 MB/sec warmup 77 sec latency 33.318 ms 2024-04-01T01:58:37.424 INFO:tasks.workunit.client.0.smithi050.stdout: 1 19127 1.56 MB/sec warmup 78 sec latency 31.964 ms 2024-04-01T01:58:38.425 INFO:tasks.workunit.client.0.smithi050.stdout: 1 19339 1.54 MB/sec warmup 79 sec latency 46.574 ms 2024-04-01T01:58:39.424 INFO:tasks.workunit.client.0.smithi050.stdout: 1 19606 1.52 MB/sec warmup 80 sec latency 36.091 ms 2024-04-01T01:58:40.424 INFO:tasks.workunit.client.0.smithi050.stdout: 1 19841 1.51 MB/sec warmup 81 sec latency 32.937 ms 2024-04-01T01:58:41.424 INFO:tasks.workunit.client.0.smithi050.stdout: 1 20147 1.51 MB/sec warmup 82 sec latency 34.065 ms 2024-04-01T01:58:42.424 INFO:tasks.workunit.client.0.smithi050.stdout: 1 20345 1.50 MB/sec warmup 83 sec latency 32.868 ms 2024-04-01T01:58:43.424 INFO:tasks.workunit.client.0.smithi050.stdout: 1 20711 1.54 MB/sec warmup 84 sec latency 60.602 ms 2024-04-01T01:58:44.424 INFO:tasks.workunit.client.0.smithi050.stdout: 1 21064 1.54 MB/sec warmup 85 sec latency 37.483 ms 2024-04-01T01:58:45.425 INFO:tasks.workunit.client.0.smithi050.stdout: 1 21110 1.52 MB/sec warmup 86 sec latency 37.269 ms 2024-04-01T01:58:46.425 INFO:tasks.workunit.client.0.smithi050.stdout: 1 21398 1.54 MB/sec warmup 87 sec latency 32.719 ms 2024-04-01T01:58:47.425 INFO:tasks.workunit.client.0.smithi050.stdout: 1 21598 1.54 MB/sec warmup 88 sec latency 38.024 ms 2024-04-01T01:58:48.425 INFO:tasks.workunit.client.0.smithi050.stdout: 1 21744 1.52 MB/sec warmup 89 sec latency 32.190 ms 2024-04-01T01:58:49.425 INFO:tasks.workunit.client.0.smithi050.stdout: 1 21911 1.51 MB/sec warmup 90 sec latency 28.713 ms 2024-04-01T01:58:50.425 INFO:tasks.workunit.client.0.smithi050.stdout: 1 22148 1.50 MB/sec warmup 91 sec latency 36.972 ms 2024-04-01T01:58:51.425 INFO:tasks.workunit.client.0.smithi050.stdout: 1 22379 1.50 MB/sec warmup 92 sec latency 36.356 ms 2024-04-01T01:58:52.425 INFO:tasks.workunit.client.0.smithi050.stdout: 1 22608 1.48 MB/sec warmup 93 sec latency 37.946 ms 2024-04-01T01:58:52.721 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T01:58:52.724 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T01:58:53.425 INFO:tasks.workunit.client.0.smithi050.stdout: 1 22883 1.50 MB/sec warmup 94 sec latency 36.996 ms 2024-04-01T01:58:54.425 INFO:tasks.workunit.client.0.smithi050.stdout: 1 23152 1.49 MB/sec warmup 95 sec latency 32.107 ms 2024-04-01T01:58:55.425 INFO:tasks.workunit.client.0.smithi050.stdout: 1 23388 1.47 MB/sec warmup 96 sec latency 32.353 ms 2024-04-01T01:58:56.425 INFO:tasks.workunit.client.0.smithi050.stdout: 1 23666 1.47 MB/sec warmup 97 sec latency 30.959 ms 2024-04-01T01:58:57.425 INFO:tasks.workunit.client.0.smithi050.stdout: 1 23873 1.47 MB/sec warmup 98 sec latency 34.173 ms 2024-04-01T01:58:58.425 INFO:tasks.workunit.client.0.smithi050.stdout: 1 24221 1.49 MB/sec warmup 99 sec latency 54.260 ms 2024-04-01T01:58:59.426 INFO:tasks.workunit.client.0.smithi050.stdout: 1 24605 1.50 MB/sec warmup 100 sec latency 32.797 ms 2024-04-01T01:59:00.426 INFO:tasks.workunit.client.0.smithi050.stdout: 1 24656 1.49 MB/sec warmup 101 sec latency 32.402 ms 2024-04-01T01:59:01.426 INFO:tasks.workunit.client.0.smithi050.stdout: 1 24991 1.50 MB/sec warmup 102 sec latency 36.026 ms 2024-04-01T01:59:02.426 INFO:tasks.workunit.client.0.smithi050.stdout: 1 25185 1.50 MB/sec warmup 103 sec latency 28.139 ms 2024-04-01T01:59:03.426 INFO:tasks.workunit.client.0.smithi050.stdout: 1 25333 1.49 MB/sec warmup 104 sec latency 29.591 ms 2024-04-01T01:59:04.426 INFO:tasks.workunit.client.0.smithi050.stdout: 1 25494 1.47 MB/sec warmup 105 sec latency 36.833 ms 2024-04-01T01:59:05.426 INFO:tasks.workunit.client.0.smithi050.stdout: 1 25738 1.47 MB/sec warmup 106 sec latency 50.978 ms 2024-04-01T01:59:06.426 INFO:tasks.workunit.client.0.smithi050.stdout: 1 25946 1.47 MB/sec warmup 107 sec latency 36.665 ms 2024-04-01T01:59:07.426 INFO:tasks.workunit.client.0.smithi050.stdout: 1 26162 1.45 MB/sec warmup 108 sec latency 44.832 ms 2024-04-01T01:59:08.426 INFO:tasks.workunit.client.0.smithi050.stdout: 1 26449 1.47 MB/sec warmup 109 sec latency 39.813 ms 2024-04-01T01:59:09.426 INFO:tasks.workunit.client.0.smithi050.stdout: 1 26717 1.46 MB/sec warmup 110 sec latency 35.017 ms 2024-04-01T01:59:10.427 INFO:tasks.workunit.client.0.smithi050.stdout: 1 26971 1.45 MB/sec warmup 111 sec latency 33.367 ms 2024-04-01T01:59:11.427 INFO:tasks.workunit.client.0.smithi050.stdout: 1 27237 1.44 MB/sec warmup 112 sec latency 39.207 ms 2024-04-01T01:59:12.426 INFO:tasks.workunit.client.0.smithi050.stdout: 1 27434 1.44 MB/sec warmup 113 sec latency 36.732 ms 2024-04-01T01:59:13.427 INFO:tasks.workunit.client.0.smithi050.stdout: 1 27793 1.47 MB/sec warmup 114 sec latency 103.818 ms 2024-04-01T01:59:14.427 INFO:tasks.workunit.client.0.smithi050.stdout: 1 28157 1.47 MB/sec warmup 115 sec latency 35.061 ms 2024-04-01T01:59:15.427 INFO:tasks.workunit.client.0.smithi050.stdout: 1 28205 1.46 MB/sec warmup 116 sec latency 34.833 ms 2024-04-01T01:59:16.427 INFO:tasks.workunit.client.0.smithi050.stdout: 1 28524 1.48 MB/sec warmup 117 sec latency 32.020 ms 2024-04-01T01:59:17.427 INFO:tasks.workunit.client.0.smithi050.stdout: 1 28707 1.47 MB/sec warmup 118 sec latency 33.783 ms 2024-04-01T01:59:18.427 INFO:tasks.workunit.client.0.smithi050.stdout: 1 28853 1.46 MB/sec warmup 119 sec latency 30.710 ms 2024-04-01T01:59:20.427 INFO:tasks.workunit.client.0.smithi050.stdout: 1 29250 0.52 MB/sec execute 1 sec latency 47.988 ms 2024-04-01T01:59:21.427 INFO:tasks.workunit.client.0.smithi050.stdout: 1 29538 1.00 MB/sec execute 2 sec latency 33.679 ms 2024-04-01T01:59:22.427 INFO:tasks.workunit.client.0.smithi050.stdout: 1 29819 1.68 MB/sec execute 3 sec latency 34.860 ms 2024-04-01T01:59:22.803 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T01:59:22.810 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T01:59:23.427 INFO:tasks.workunit.client.0.smithi050.stdout: 1 30076 1.31 MB/sec execute 4 sec latency 29.010 ms 2024-04-01T01:59:24.427 INFO:tasks.workunit.client.0.smithi050.stdout: 1 30343 1.10 MB/sec execute 5 sec latency 31.091 ms 2024-04-01T01:59:25.427 INFO:tasks.workunit.client.0.smithi050.stdout: 1 30619 0.97 MB/sec execute 6 sec latency 38.726 ms 2024-04-01T01:59:26.427 INFO:tasks.workunit.client.0.smithi050.stdout: 1 30848 1.02 MB/sec execute 7 sec latency 33.718 ms 2024-04-01T01:59:27.427 INFO:tasks.workunit.client.0.smithi050.stdout: 1 31132 1.37 MB/sec execute 8 sec latency 37.331 ms 2024-04-01T01:59:28.428 INFO:tasks.workunit.client.0.smithi050.stdout: 1 31582 1.46 MB/sec execute 9 sec latency 33.093 ms 2024-04-01T01:59:29.428 INFO:tasks.workunit.client.0.smithi050.stdout: 1 31725 1.44 MB/sec execute 10 sec latency 38.458 ms 2024-04-01T01:59:30.428 INFO:tasks.workunit.client.0.smithi050.stdout: 1 31808 1.32 MB/sec execute 11 sec latency 39.050 ms 2024-04-01T01:59:31.428 INFO:tasks.workunit.client.0.smithi050.stdout: 1 32114 1.48 MB/sec execute 12 sec latency 34.747 ms 2024-04-01T01:59:32.428 INFO:tasks.workunit.client.0.smithi050.stdout: 1 32290 1.45 MB/sec execute 13 sec latency 29.949 ms 2024-04-01T01:59:33.428 INFO:tasks.workunit.client.0.smithi050.stdout: 1 32433 1.36 MB/sec execute 14 sec latency 27.177 ms 2024-04-01T01:59:34.428 INFO:tasks.workunit.client.0.smithi050.stdout: 1 32584 1.27 MB/sec execute 15 sec latency 36.916 ms 2024-04-01T01:59:35.428 INFO:tasks.workunit.client.0.smithi050.stdout: 1 32837 1.23 MB/sec execute 16 sec latency 35.109 ms 2024-04-01T01:59:36.428 INFO:tasks.workunit.client.0.smithi050.stdout: 1 33073 1.24 MB/sec execute 17 sec latency 38.339 ms 2024-04-01T01:59:37.428 INFO:tasks.workunit.client.0.smithi050.stdout: 1 33362 1.34 MB/sec execute 18 sec latency 35.889 ms 2024-04-01T01:59:38.428 INFO:tasks.workunit.client.0.smithi050.stdout: 1 33587 1.28 MB/sec execute 19 sec latency 32.184 ms 2024-04-01T01:59:39.428 INFO:tasks.workunit.client.0.smithi050.stdout: 1 33868 1.23 MB/sec execute 20 sec latency 35.196 ms 2024-04-01T01:59:40.428 INFO:tasks.workunit.client.0.smithi050.stdout: 1 34133 1.18 MB/sec execute 21 sec latency 35.901 ms 2024-04-01T01:59:41.428 INFO:tasks.workunit.client.0.smithi050.stdout: 1 34366 1.19 MB/sec execute 22 sec latency 38.296 ms 2024-04-01T01:59:42.429 INFO:tasks.workunit.client.0.smithi050.stdout: 1 34581 1.18 MB/sec execute 23 sec latency 31.133 ms 2024-04-01T01:59:43.429 INFO:tasks.workunit.client.0.smithi050.stdout: 1 34979 1.32 MB/sec execute 24 sec latency 32.348 ms 2024-04-01T01:59:44.429 INFO:tasks.workunit.client.0.smithi050.stdout: 1 35274 1.34 MB/sec execute 25 sec latency 34.340 ms 2024-04-01T01:59:45.429 INFO:tasks.workunit.client.0.smithi050.stdout: 1 35358 1.29 MB/sec execute 26 sec latency 33.477 ms 2024-04-01T01:59:46.429 INFO:tasks.workunit.client.0.smithi050.stdout: 1 35711 1.40 MB/sec execute 27 sec latency 34.718 ms 2024-04-01T01:59:47.429 INFO:tasks.workunit.client.0.smithi050.stdout: 1 35852 1.36 MB/sec execute 28 sec latency 35.640 ms 2024-04-01T01:59:48.429 INFO:tasks.workunit.client.0.smithi050.stdout: 1 35987 1.32 MB/sec execute 29 sec latency 33.751 ms 2024-04-01T01:59:49.429 INFO:tasks.workunit.client.0.smithi050.stdout: 1 36173 1.28 MB/sec execute 30 sec latency 33.953 ms 2024-04-01T01:59:50.429 INFO:tasks.workunit.client.0.smithi050.stdout: 1 36446 1.26 MB/sec execute 31 sec latency 33.956 ms 2024-04-01T01:59:51.429 INFO:tasks.workunit.client.0.smithi050.stdout: 1 36673 1.26 MB/sec execute 32 sec latency 36.612 ms 2024-04-01T01:59:52.429 INFO:tasks.workunit.client.0.smithi050.stdout: 1 36934 1.31 MB/sec execute 33 sec latency 40.072 ms 2024-04-01T01:59:52.861 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T01:59:52.864 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T01:59:53.429 INFO:tasks.workunit.client.0.smithi050.stdout: 1 37203 1.28 MB/sec execute 34 sec latency 34.278 ms 2024-04-01T01:59:54.429 INFO:tasks.workunit.client.0.smithi050.stdout: 1 37434 1.25 MB/sec execute 35 sec latency 37.159 ms 2024-04-01T01:59:55.429 INFO:tasks.workunit.client.0.smithi050.stdout: 1 37701 1.22 MB/sec execute 36 sec latency 33.148 ms 2024-04-01T01:59:56.429 INFO:tasks.workunit.client.0.smithi050.stdout: 1 37937 1.23 MB/sec execute 37 sec latency 35.945 ms 2024-04-01T01:59:57.430 INFO:tasks.workunit.client.0.smithi050.stdout: 1 38223 1.29 MB/sec execute 38 sec latency 29.704 ms 2024-04-01T01:59:58.429 INFO:tasks.workunit.client.0.smithi050.stdout: 1 38535 1.30 MB/sec execute 39 sec latency 39.551 ms 2024-04-01T01:59:59.430 INFO:tasks.workunit.client.0.smithi050.stdout: 1 38815 1.32 MB/sec execute 40 sec latency 32.366 ms 2024-04-01T02:00:00.430 INFO:tasks.workunit.client.0.smithi050.stdout: 1 39021 1.36 MB/sec execute 41 sec latency 31.654 ms 2024-04-01T02:00:01.430 INFO:tasks.workunit.client.0.smithi050.stdout: 1 39280 1.36 MB/sec execute 42 sec latency 42.207 ms 2024-04-01T02:00:02.430 INFO:tasks.workunit.client.0.smithi050.stdout: 1 39427 1.33 MB/sec execute 43 sec latency 31.233 ms 2024-04-01T02:00:03.430 INFO:tasks.workunit.client.0.smithi050.stdout: 1 39560 1.30 MB/sec execute 44 sec latency 30.465 ms 2024-04-01T02:00:04.430 INFO:tasks.workunit.client.0.smithi050.stdout: 1 39777 1.28 MB/sec execute 45 sec latency 41.348 ms 2024-04-01T02:00:05.430 INFO:tasks.workunit.client.0.smithi050.stdout: 1 40007 1.26 MB/sec execute 46 sec latency 36.384 ms 2024-04-01T02:00:06.430 INFO:tasks.workunit.client.0.smithi050.stdout: 1 40232 1.26 MB/sec execute 47 sec latency 38.695 ms 2024-04-01T02:00:07.430 INFO:tasks.workunit.client.0.smithi050.stdout: 1 40518 1.30 MB/sec execute 48 sec latency 40.339 ms 2024-04-01T02:00:08.430 INFO:tasks.workunit.client.0.smithi050.stdout: 1 40748 1.28 MB/sec execute 49 sec latency 33.467 ms 2024-04-01T02:00:09.430 INFO:tasks.workunit.client.0.smithi050.stdout: 1 40983 1.26 MB/sec execute 50 sec latency 34.072 ms 2024-04-01T02:00:10.430 INFO:tasks.workunit.client.0.smithi050.stdout: 1 41243 1.24 MB/sec execute 51 sec latency 36.979 ms 2024-04-01T02:00:11.430 INFO:tasks.workunit.client.0.smithi050.stdout: 1 41469 1.24 MB/sec execute 52 sec latency 38.582 ms 2024-04-01T02:00:12.431 INFO:tasks.workunit.client.0.smithi050.stdout: 1 41674 1.24 MB/sec execute 53 sec latency 31.967 ms 2024-04-01T02:00:13.431 INFO:tasks.workunit.client.0.smithi050.stdout: 1 42069 1.29 MB/sec execute 54 sec latency 37.877 ms 2024-04-01T02:00:14.431 INFO:tasks.workunit.client.0.smithi050.stdout: 1 42361 1.30 MB/sec execute 55 sec latency 37.480 ms 2024-04-01T02:00:15.431 INFO:tasks.workunit.client.0.smithi050.stdout: 1 42444 1.28 MB/sec execute 56 sec latency 36.290 ms 2024-04-01T02:00:16.431 INFO:tasks.workunit.client.0.smithi050.stdout: 1 42764 1.32 MB/sec execute 57 sec latency 38.401 ms 2024-04-01T02:00:17.431 INFO:tasks.workunit.client.0.smithi050.stdout: 1 42939 1.32 MB/sec execute 58 sec latency 30.284 ms 2024-04-01T02:00:18.431 INFO:tasks.workunit.client.0.smithi050.stdout: 1 43077 1.30 MB/sec execute 59 sec latency 55.981 ms 2024-04-01T02:00:19.431 INFO:tasks.workunit.client.0.smithi050.stdout: 1 43263 1.28 MB/sec execute 60 sec latency 65.317 ms 2024-04-01T02:00:20.431 INFO:tasks.workunit.client.0.smithi050.stdout: 1 43535 1.27 MB/sec execute 61 sec latency 32.877 ms 2024-04-01T02:00:21.431 INFO:tasks.workunit.client.0.smithi050.stdout: 1 43777 1.27 MB/sec execute 62 sec latency 33.041 ms 2024-04-01T02:00:22.431 INFO:tasks.workunit.client.0.smithi050.stdout: 1 44081 1.29 MB/sec execute 63 sec latency 37.070 ms 2024-04-01T02:00:22.993 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T02:00:22.996 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T02:00:23.431 INFO:tasks.workunit.client.0.smithi050.stdout: 1 44361 1.28 MB/sec execute 64 sec latency 30.474 ms 2024-04-01T02:00:24.432 INFO:tasks.workunit.client.0.smithi050.stdout: 1 44621 1.26 MB/sec execute 65 sec latency 32.954 ms 2024-04-01T02:00:25.432 INFO:tasks.workunit.client.0.smithi050.stdout: 1 44900 1.26 MB/sec execute 66 sec latency 34.077 ms 2024-04-01T02:00:26.432 INFO:tasks.workunit.client.0.smithi050.stdout: 1 45056 1.25 MB/sec execute 67 sec latency 36.761 ms 2024-04-01T02:00:27.434 INFO:tasks.workunit.client.0.smithi050.stdout: 1 45366 1.29 MB/sec execute 68 sec latency 36.575 ms 2024-04-01T02:00:28.432 INFO:tasks.workunit.client.0.smithi050.stdout: 1 45791 1.30 MB/sec execute 69 sec latency 37.678 ms 2024-04-01T02:00:29.432 INFO:tasks.workunit.client.0.smithi050.stdout: 1 45915 1.30 MB/sec execute 70 sec latency 33.972 ms 2024-04-01T02:00:30.432 INFO:tasks.workunit.client.0.smithi050.stdout: 1 46151 1.32 MB/sec execute 71 sec latency 30.379 ms 2024-04-01T02:00:31.432 INFO:tasks.workunit.client.0.smithi050.stdout: 1 46384 1.32 MB/sec execute 72 sec latency 34.851 ms 2024-04-01T02:00:32.432 INFO:tasks.workunit.client.0.smithi050.stdout: 1 46526 1.31 MB/sec execute 73 sec latency 33.605 ms 2024-04-01T02:00:33.432 INFO:tasks.workunit.client.0.smithi050.stdout: 1 46659 1.29 MB/sec execute 74 sec latency 35.643 ms 2024-04-01T02:00:34.432 INFO:tasks.workunit.client.0.smithi050.stdout: 1 46880 1.28 MB/sec execute 75 sec latency 40.438 ms 2024-04-01T02:00:35.432 INFO:tasks.workunit.client.0.smithi050.stdout: 1 47138 1.27 MB/sec execute 76 sec latency 30.062 ms 2024-04-01T02:00:36.432 INFO:tasks.workunit.client.0.smithi050.stdout: 1 47386 1.27 MB/sec execute 77 sec latency 34.561 ms 2024-04-01T02:00:37.432 INFO:tasks.workunit.client.0.smithi050.stdout: 1 47680 1.29 MB/sec execute 78 sec latency 39.206 ms 2024-04-01T02:00:38.432 INFO:tasks.workunit.client.0.smithi050.stdout: 1 47959 1.28 MB/sec execute 79 sec latency 30.761 ms 2024-04-01T02:00:39.432 INFO:tasks.workunit.client.0.smithi050.stdout: 1 48209 1.27 MB/sec execute 80 sec latency 37.197 ms 2024-04-01T02:00:40.432 INFO:tasks.workunit.client.0.smithi050.stdout: 1 48483 1.26 MB/sec execute 81 sec latency 32.686 ms 2024-04-01T02:00:41.432 INFO:tasks.workunit.client.0.smithi050.stdout: 1 48652 1.26 MB/sec execute 82 sec latency 37.636 ms 2024-04-01T02:00:42.432 INFO:tasks.workunit.client.0.smithi050.stdout: 1 49045 1.29 MB/sec execute 83 sec latency 35.804 ms 2024-04-01T02:00:43.432 INFO:tasks.workunit.client.0.smithi050.stdout: 1 49425 1.31 MB/sec execute 84 sec latency 36.747 ms 2024-04-01T02:00:44.432 INFO:tasks.workunit.client.0.smithi050.stdout: 1 49469 1.29 MB/sec execute 85 sec latency 37.446 ms 2024-04-01T02:00:45.432 INFO:tasks.workunit.client.0.smithi050.stdout: 1 49719 1.31 MB/sec execute 86 sec latency 35.619 ms 2024-04-01T02:00:46.433 INFO:tasks.workunit.client.0.smithi050.stdout: 1 49950 1.31 MB/sec execute 87 sec latency 34.979 ms 2024-04-01T02:00:47.433 INFO:tasks.workunit.client.0.smithi050.stdout: 1 50092 1.30 MB/sec execute 88 sec latency 32.310 ms 2024-04-01T02:00:48.433 INFO:tasks.workunit.client.0.smithi050.stdout: 1 50246 1.29 MB/sec execute 89 sec latency 30.978 ms 2024-04-01T02:00:49.433 INFO:tasks.workunit.client.0.smithi050.stdout: 1 50479 1.28 MB/sec execute 90 sec latency 44.882 ms 2024-04-01T02:00:50.433 INFO:tasks.workunit.client.0.smithi050.stdout: 1 50725 1.28 MB/sec execute 91 sec latency 38.289 ms 2024-04-01T02:00:51.433 INFO:tasks.workunit.client.0.smithi050.stdout: 1 50956 1.27 MB/sec execute 92 sec latency 36.159 ms 2024-04-01T02:00:52.433 INFO:tasks.workunit.client.0.smithi050.stdout: 1 51285 1.29 MB/sec execute 93 sec latency 32.788 ms 2024-04-01T02:00:53.035 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T02:00:53.038 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T02:00:53.433 INFO:tasks.workunit.client.0.smithi050.stdout: 1 51555 1.28 MB/sec execute 94 sec latency 35.801 ms 2024-04-01T02:00:54.433 INFO:tasks.workunit.client.0.smithi050.stdout: 1 51823 1.27 MB/sec execute 95 sec latency 32.090 ms 2024-04-01T02:00:55.433 INFO:tasks.workunit.client.0.smithi050.stdout: 1 52068 1.27 MB/sec execute 96 sec latency 30.992 ms 2024-04-01T02:00:56.433 INFO:tasks.workunit.client.0.smithi050.stdout: 1 52283 1.27 MB/sec execute 97 sec latency 35.561 ms 2024-04-01T02:00:57.433 INFO:tasks.workunit.client.0.smithi050.stdout: 1 52672 1.30 MB/sec execute 98 sec latency 31.507 ms 2024-04-01T02:00:58.433 INFO:tasks.workunit.client.0.smithi050.stdout: 1 52982 1.30 MB/sec execute 99 sec latency 37.614 ms 2024-04-01T02:00:59.433 INFO:tasks.workunit.client.0.smithi050.stdout: 1 53052 1.29 MB/sec execute 100 sec latency 35.390 ms 2024-04-01T02:01:00.433 INFO:tasks.workunit.client.0.smithi050.stdout: 1 53373 1.31 MB/sec execute 101 sec latency 30.955 ms 2024-04-01T02:01:01.433 INFO:tasks.workunit.client.0.smithi050.stdout: 1 53557 1.31 MB/sec execute 102 sec latency 30.729 ms 2024-04-01T02:01:02.433 INFO:tasks.workunit.client.0.smithi050.stdout: 1 53706 1.30 MB/sec execute 103 sec latency 30.606 ms 2024-04-01T02:01:03.433 INFO:tasks.workunit.client.0.smithi050.stdout: 1 53893 1.29 MB/sec execute 104 sec latency 43.260 ms 2024-04-01T02:01:04.433 INFO:tasks.workunit.client.0.smithi050.stdout: 1 54154 1.28 MB/sec execute 105 sec latency 30.908 ms 2024-04-01T02:01:05.433 INFO:tasks.workunit.client.0.smithi050.stdout: 1 54401 1.28 MB/sec execute 106 sec latency 32.493 ms 2024-04-01T02:01:06.434 INFO:tasks.workunit.client.0.smithi050.stdout: 1 54671 1.30 MB/sec execute 107 sec latency 39.528 ms 2024-04-01T02:01:07.434 INFO:tasks.workunit.client.0.smithi050.stdout: 1 54895 1.29 MB/sec execute 108 sec latency 36.736 ms 2024-04-01T02:01:08.434 INFO:tasks.workunit.client.0.smithi050.stdout: 1 55169 1.28 MB/sec execute 109 sec latency 31.639 ms 2024-04-01T02:01:09.434 INFO:tasks.workunit.client.0.smithi050.stdout: 1 55459 1.27 MB/sec execute 110 sec latency 40.786 ms 2024-04-01T02:01:10.434 INFO:tasks.workunit.client.0.smithi050.stdout: 1 55676 1.27 MB/sec execute 111 sec latency 34.615 ms 2024-04-01T02:01:11.434 INFO:tasks.workunit.client.0.smithi050.stdout: 1 55996 1.29 MB/sec execute 112 sec latency 32.900 ms 2024-04-01T02:01:12.434 INFO:tasks.workunit.client.0.smithi050.stdout: 1 56412 1.30 MB/sec execute 113 sec latency 36.737 ms 2024-04-01T02:01:13.434 INFO:tasks.workunit.client.0.smithi050.stdout: 1 56551 1.30 MB/sec execute 114 sec latency 32.162 ms 2024-04-01T02:01:14.434 INFO:tasks.workunit.client.0.smithi050.stdout: 1 56764 1.32 MB/sec execute 115 sec latency 35.940 ms 2024-04-01T02:01:15.434 INFO:tasks.workunit.client.0.smithi050.stdout: 1 57013 1.32 MB/sec execute 116 sec latency 35.941 ms 2024-04-01T02:01:16.434 INFO:tasks.workunit.client.0.smithi050.stdout: 1 57147 1.31 MB/sec execute 117 sec latency 35.099 ms 2024-04-01T02:01:17.434 INFO:tasks.workunit.client.0.smithi050.stdout: 1 57282 1.30 MB/sec execute 118 sec latency 29.936 ms 2024-04-01T02:01:18.434 INFO:tasks.workunit.client.0.smithi050.stdout: 1 57475 1.29 MB/sec execute 119 sec latency 47.076 ms 2024-04-01T02:01:19.434 INFO:tasks.workunit.client.0.smithi050.stdout: 1 57722 1.28 MB/sec execute 120 sec latency 36.019 ms 2024-04-01T02:01:20.434 INFO:tasks.workunit.client.0.smithi050.stdout: 1 57956 1.28 MB/sec execute 121 sec latency 35.184 ms 2024-04-01T02:01:21.434 INFO:tasks.workunit.client.0.smithi050.stdout: 1 58235 1.30 MB/sec execute 122 sec latency 37.200 ms 2024-04-01T02:01:22.434 INFO:tasks.workunit.client.0.smithi050.stdout: 1 58454 1.29 MB/sec execute 123 sec latency 35.723 ms 2024-04-01T02:01:23.256 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T02:01:23.259 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T02:01:23.434 INFO:tasks.workunit.client.0.smithi050.stdout: 1 58751 1.28 MB/sec execute 124 sec latency 31.804 ms 2024-04-01T02:01:24.435 INFO:tasks.workunit.client.0.smithi050.stdout: 1 59084 1.28 MB/sec execute 125 sec latency 30.405 ms 2024-04-01T02:01:25.435 INFO:tasks.workunit.client.0.smithi050.stdout: 1 59251 1.27 MB/sec execute 126 sec latency 38.420 ms 2024-04-01T02:01:26.435 INFO:tasks.workunit.client.0.smithi050.stdout: 1 59556 1.29 MB/sec execute 127 sec latency 35.827 ms 2024-04-01T02:01:27.435 INFO:tasks.workunit.client.0.smithi050.stdout: 1 59985 1.30 MB/sec execute 128 sec latency 33.437 ms 2024-04-01T02:01:28.435 INFO:tasks.workunit.client.0.smithi050.stdout: 1 60093 1.30 MB/sec execute 129 sec latency 105.171 ms 2024-04-01T02:01:29.435 INFO:tasks.workunit.client.0.smithi050.stdout: 1 60330 1.31 MB/sec execute 130 sec latency 31.268 ms 2024-04-01T02:01:30.435 INFO:tasks.workunit.client.0.smithi050.stdout: 1 60564 1.31 MB/sec execute 131 sec latency 32.187 ms 2024-04-01T02:01:31.435 INFO:tasks.workunit.client.0.smithi050.stdout: 1 60704 1.30 MB/sec execute 132 sec latency 36.191 ms 2024-04-01T02:01:32.435 INFO:tasks.workunit.client.0.smithi050.stdout: 1 60834 1.29 MB/sec execute 133 sec latency 30.254 ms 2024-04-01T02:01:33.435 INFO:tasks.workunit.client.0.smithi050.stdout: 1 61050 1.29 MB/sec execute 134 sec latency 46.665 ms 2024-04-01T02:01:34.435 INFO:tasks.workunit.client.0.smithi050.stdout: 1 61273 1.28 MB/sec execute 135 sec latency 33.236 ms 2024-04-01T02:01:35.435 INFO:tasks.workunit.client.0.smithi050.stdout: 1 61515 1.28 MB/sec execute 136 sec latency 30.851 ms 2024-04-01T02:01:36.438 INFO:tasks.workunit.client.0.smithi050.stdout: 1 61821 1.29 MB/sec execute 137 sec latency 42.605 ms 2024-04-01T02:01:37.435 INFO:tasks.workunit.client.0.smithi050.stdout: 1 62041 1.28 MB/sec execute 138 sec latency 37.693 ms 2024-04-01T02:01:38.435 INFO:tasks.workunit.client.0.smithi050.stdout: 1 62311 1.28 MB/sec execute 139 sec latency 36.617 ms 2024-04-01T02:01:39.435 INFO:tasks.workunit.client.0.smithi050.stdout: 1 62551 1.27 MB/sec execute 140 sec latency 36.106 ms 2024-04-01T02:01:40.435 INFO:tasks.workunit.client.0.smithi050.stdout: 1 62759 1.27 MB/sec execute 141 sec latency 41.380 ms 2024-04-01T02:01:41.435 INFO:tasks.workunit.client.0.smithi050.stdout: 1 62950 1.27 MB/sec execute 142 sec latency 35.516 ms 2024-04-01T02:01:42.435 INFO:tasks.workunit.client.0.smithi050.stdout: 1 63357 1.29 MB/sec execute 143 sec latency 37.091 ms 2024-04-01T02:01:43.435 INFO:tasks.workunit.client.0.smithi050.stdout: 1 63635 1.29 MB/sec execute 144 sec latency 33.757 ms 2024-04-01T02:01:44.435 INFO:tasks.workunit.client.0.smithi050.stdout: 1 63846 1.31 MB/sec execute 145 sec latency 31.002 ms 2024-04-01T02:01:45.436 INFO:tasks.workunit.client.0.smithi050.stdout: 1 64106 1.31 MB/sec execute 146 sec latency 34.920 ms 2024-04-01T02:01:46.436 INFO:tasks.workunit.client.0.smithi050.stdout: 1 64252 1.30 MB/sec execute 147 sec latency 35.504 ms 2024-04-01T02:01:47.435 INFO:tasks.workunit.client.0.smithi050.stdout: 1 64382 1.29 MB/sec execute 148 sec latency 34.684 ms 2024-04-01T02:01:48.436 INFO:tasks.workunit.client.0.smithi050.stdout: 1 64591 1.28 MB/sec execute 149 sec latency 47.804 ms 2024-04-01T02:01:49.436 INFO:tasks.workunit.client.0.smithi050.stdout: 1 64816 1.28 MB/sec execute 150 sec latency 34.745 ms 2024-04-01T02:01:50.436 INFO:tasks.workunit.client.0.smithi050.stdout: 1 65045 1.28 MB/sec execute 151 sec latency 45.159 ms 2024-04-01T02:01:51.436 INFO:tasks.workunit.client.0.smithi050.stdout: 1 65324 1.29 MB/sec execute 152 sec latency 46.737 ms 2024-04-01T02:01:52.436 INFO:tasks.workunit.client.0.smithi050.stdout: 1 65562 1.28 MB/sec execute 153 sec latency 35.756 ms 2024-04-01T02:01:53.436 INFO:tasks.workunit.client.0.smithi050.stdout: 1 65836 1.28 MB/sec execute 154 sec latency 31.225 ms 2024-04-01T02:01:53.556 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T02:01:53.559 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T02:01:54.436 INFO:tasks.workunit.client.0.smithi050.stdout: 1 66098 1.27 MB/sec execute 155 sec latency 34.998 ms 2024-04-01T02:01:55.436 INFO:tasks.workunit.client.0.smithi050.stdout: 1 66311 1.27 MB/sec execute 156 sec latency 33.774 ms 2024-04-01T02:01:56.436 INFO:tasks.workunit.client.0.smithi050.stdout: 1 66615 1.29 MB/sec execute 157 sec latency 37.248 ms 2024-04-01T02:01:57.436 INFO:tasks.workunit.client.0.smithi050.stdout: 1 67039 1.29 MB/sec execute 158 sec latency 34.953 ms 2024-04-01T02:01:58.436 INFO:tasks.workunit.client.0.smithi050.stdout: 1 67182 1.29 MB/sec execute 159 sec latency 32.165 ms 2024-04-01T02:01:59.437 INFO:tasks.workunit.client.0.smithi050.stdout: 1 67397 1.30 MB/sec execute 160 sec latency 30.285 ms 2024-04-01T02:02:00.436 INFO:tasks.workunit.client.0.smithi050.stdout: 1 67651 1.30 MB/sec execute 161 sec latency 33.393 ms 2024-04-01T02:02:01.436 INFO:tasks.workunit.client.0.smithi050.stdout: 1 67793 1.30 MB/sec execute 162 sec latency 33.084 ms 2024-04-01T02:02:02.436 INFO:tasks.workunit.client.0.smithi050.stdout: 1 67919 1.29 MB/sec execute 163 sec latency 33.434 ms 2024-04-01T02:02:03.437 INFO:tasks.workunit.client.0.smithi050.stdout: 1 68115 1.28 MB/sec execute 164 sec latency 40.739 ms 2024-04-01T02:02:04.436 INFO:tasks.workunit.client.0.smithi050.stdout: 1 68360 1.28 MB/sec execute 165 sec latency 34.471 ms 2024-04-01T02:02:05.437 INFO:tasks.workunit.client.0.smithi050.stdout: 1 68596 1.28 MB/sec execute 166 sec latency 32.148 ms 2024-04-01T02:02:06.437 INFO:tasks.workunit.client.0.smithi050.stdout: 1 68875 1.29 MB/sec execute 167 sec latency 36.564 ms 2024-04-01T02:02:07.437 INFO:tasks.workunit.client.0.smithi050.stdout: 1 69088 1.28 MB/sec execute 168 sec latency 37.310 ms 2024-04-01T02:02:08.437 INFO:tasks.workunit.client.0.smithi050.stdout: 1 69339 1.28 MB/sec execute 169 sec latency 31.063 ms 2024-04-01T02:02:09.437 INFO:tasks.workunit.client.0.smithi050.stdout: 1 69604 1.27 MB/sec execute 170 sec latency 31.932 ms 2024-04-01T02:02:10.437 INFO:tasks.workunit.client.0.smithi050.stdout: 1 69831 1.27 MB/sec execute 171 sec latency 35.385 ms 2024-04-01T02:02:11.437 INFO:tasks.workunit.client.0.smithi050.stdout: 1 70036 1.27 MB/sec execute 172 sec latency 36.925 ms 2024-04-01T02:02:12.437 INFO:tasks.workunit.client.0.smithi050.stdout: 1 70436 1.29 MB/sec execute 173 sec latency 30.219 ms 2024-04-01T02:02:13.437 INFO:tasks.workunit.client.0.smithi050.stdout: 1 70725 1.29 MB/sec execute 174 sec latency 33.248 ms 2024-04-01T02:02:14.437 INFO:tasks.workunit.client.0.smithi050.stdout: 1 70810 1.28 MB/sec execute 175 sec latency 36.703 ms 2024-04-01T02:02:15.437 INFO:tasks.workunit.client.0.smithi050.stdout: 1 71155 1.30 MB/sec execute 176 sec latency 52.115 ms 2024-04-01T02:02:16.437 INFO:tasks.workunit.client.0.smithi050.stdout: 1 71301 1.30 MB/sec execute 177 sec latency 34.880 ms 2024-04-01T02:02:17.437 INFO:tasks.workunit.client.0.smithi050.stdout: 1 71433 1.29 MB/sec execute 178 sec latency 35.874 ms 2024-04-01T02:02:18.437 INFO:tasks.workunit.client.0.smithi050.stdout: 1 71587 1.28 MB/sec execute 179 sec latency 55.478 ms 2024-04-01T02:02:19.437 INFO:tasks.workunit.client.0.smithi050.stdout: 1 71840 1.28 MB/sec execute 180 sec latency 33.116 ms 2024-04-01T02:02:20.437 INFO:tasks.workunit.client.0.smithi050.stdout: 1 72071 1.28 MB/sec execute 181 sec latency 36.927 ms 2024-04-01T02:02:21.437 INFO:tasks.workunit.client.0.smithi050.stdout: 1 72351 1.29 MB/sec execute 182 sec latency 35.914 ms 2024-04-01T02:02:22.437 INFO:tasks.workunit.client.0.smithi050.stdout: 1 72579 1.28 MB/sec execute 183 sec latency 31.481 ms 2024-04-01T02:02:23.437 INFO:tasks.workunit.client.0.smithi050.stdout: 1 72832 1.28 MB/sec execute 184 sec latency 35.542 ms 2024-04-01T02:02:23.594 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T02:02:23.597 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T02:02:24.437 INFO:tasks.workunit.client.0.smithi050.stdout: 1 73141 1.27 MB/sec execute 185 sec latency 35.220 ms 2024-04-01T02:02:25.438 INFO:tasks.workunit.client.0.smithi050.stdout: 1 73386 1.27 MB/sec execute 186 sec latency 36.526 ms 2024-04-01T02:02:26.437 INFO:tasks.workunit.client.0.smithi050.stdout: 1 73598 1.27 MB/sec execute 187 sec latency 33.552 ms 2024-04-01T02:02:27.438 INFO:tasks.workunit.client.0.smithi050.stdout: 1 73993 1.29 MB/sec execute 188 sec latency 31.042 ms 2024-04-01T02:02:28.438 INFO:tasks.workunit.client.0.smithi050.stdout: 1 74300 1.29 MB/sec execute 189 sec latency 36.611 ms 2024-04-01T02:02:29.438 INFO:tasks.workunit.client.0.smithi050.stdout: 1 74390 1.28 MB/sec execute 190 sec latency 35.144 ms 2024-04-01T02:02:30.438 INFO:tasks.workunit.client.0.smithi050.stdout: 1 74708 1.29 MB/sec execute 191 sec latency 35.855 ms 2024-04-01T02:02:31.438 INFO:tasks.workunit.client.0.smithi050.stdout: 1 74867 1.29 MB/sec execute 192 sec latency 29.891 ms 2024-04-01T02:02:32.438 INFO:tasks.workunit.client.0.smithi050.stdout: 1 75010 1.29 MB/sec execute 193 sec latency 30.006 ms 2024-04-01T02:02:33.438 INFO:tasks.workunit.client.0.smithi050.stdout: 1 75170 1.28 MB/sec execute 194 sec latency 52.323 ms 2024-04-01T02:02:34.438 INFO:tasks.workunit.client.0.smithi050.stdout: 1 75427 1.28 MB/sec execute 195 sec latency 32.981 ms 2024-04-01T02:02:35.438 INFO:tasks.workunit.client.0.smithi050.stdout: 1 75654 1.28 MB/sec execute 196 sec latency 31.357 ms 2024-04-01T02:02:36.438 INFO:tasks.workunit.client.0.smithi050.stdout: 1 75935 1.29 MB/sec execute 197 sec latency 35.580 ms 2024-04-01T02:02:37.438 INFO:tasks.workunit.client.0.smithi050.stdout: 1 76159 1.28 MB/sec execute 198 sec latency 32.538 ms 2024-04-01T02:02:38.438 INFO:tasks.workunit.client.0.smithi050.stdout: 1 76417 1.28 MB/sec execute 199 sec latency 31.120 ms 2024-04-01T02:02:39.438 INFO:tasks.workunit.client.0.smithi050.stdout: 1 76692 1.27 MB/sec execute 200 sec latency 32.364 ms 2024-04-01T02:02:40.438 INFO:tasks.workunit.client.0.smithi050.stdout: 1 76933 1.27 MB/sec execute 201 sec latency 39.752 ms 2024-04-01T02:02:41.438 INFO:tasks.workunit.client.0.smithi050.stdout: 1 77145 1.27 MB/sec execute 202 sec latency 36.546 ms 2024-04-01T02:02:42.438 INFO:tasks.workunit.client.0.smithi050.stdout: 1 77535 1.29 MB/sec execute 203 sec latency 33.021 ms 2024-04-01T02:02:43.438 INFO:tasks.workunit.client.0.smithi050.stdout: 1 77840 1.29 MB/sec execute 204 sec latency 31.392 ms 2024-04-01T02:02:44.439 INFO:tasks.workunit.client.0.smithi050.stdout: 1 77906 1.28 MB/sec execute 205 sec latency 35.711 ms 2024-04-01T02:02:45.438 INFO:tasks.workunit.client.0.smithi050.stdout: 1 78226 1.29 MB/sec execute 206 sec latency 58.230 ms 2024-04-01T02:02:46.439 INFO:tasks.workunit.client.0.smithi050.stdout: 1 78406 1.29 MB/sec execute 207 sec latency 29.257 ms 2024-04-01T02:02:47.438 INFO:tasks.workunit.client.0.smithi050.stdout: 1 78556 1.29 MB/sec execute 208 sec latency 30.160 ms 2024-04-01T02:02:48.439 INFO:tasks.workunit.client.0.smithi050.stdout: 1 78713 1.28 MB/sec execute 209 sec latency 40.063 ms 2024-04-01T02:02:49.439 INFO:tasks.workunit.client.0.smithi050.stdout: 1 78973 1.28 MB/sec execute 210 sec latency 39.763 ms 2024-04-01T02:02:50.439 INFO:tasks.workunit.client.0.smithi050.stdout: 1 79222 1.28 MB/sec execute 211 sec latency 31.510 ms 2024-04-01T02:02:51.439 INFO:tasks.workunit.client.0.smithi050.stdout: 1 79490 1.29 MB/sec execute 212 sec latency 35.933 ms 2024-04-01T02:02:52.439 INFO:tasks.workunit.client.0.smithi050.stdout: 1 79717 1.28 MB/sec execute 213 sec latency 35.654 ms 2024-04-01T02:02:53.439 INFO:tasks.workunit.client.0.smithi050.stdout: 1 79991 1.28 MB/sec execute 214 sec latency 34.139 ms 2024-04-01T02:02:53.675 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T02:02:53.679 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T02:02:54.439 INFO:tasks.workunit.client.0.smithi050.stdout: 1 80291 1.27 MB/sec execute 215 sec latency 30.878 ms 2024-04-01T02:02:55.439 INFO:tasks.workunit.client.0.smithi050.stdout: 1 80519 1.27 MB/sec execute 216 sec latency 39.503 ms 2024-04-01T02:02:56.439 INFO:tasks.workunit.client.0.smithi050.stdout: 1 80708 1.27 MB/sec execute 217 sec latency 38.572 ms 2024-04-01T02:02:57.439 INFO:tasks.workunit.client.0.smithi050.stdout: 1 81114 1.29 MB/sec execute 218 sec latency 33.778 ms 2024-04-01T02:02:58.439 INFO:tasks.workunit.client.0.smithi050.stdout: 1 81397 1.29 MB/sec execute 219 sec latency 32.499 ms 2024-04-01T02:02:59.439 INFO:tasks.workunit.client.0.smithi050.stdout: 1 81613 1.30 MB/sec execute 220 sec latency 35.661 ms 2024-04-01T02:03:00.439 INFO:tasks.workunit.client.0.smithi050.stdout: 1 81865 1.30 MB/sec execute 221 sec latency 30.137 ms 2024-04-01T02:03:01.439 INFO:tasks.workunit.client.0.smithi050.stdout: 1 82011 1.29 MB/sec execute 222 sec latency 33.297 ms 2024-04-01T02:03:02.439 INFO:tasks.workunit.client.0.smithi050.stdout: 1 82145 1.29 MB/sec execute 223 sec latency 36.412 ms 2024-04-01T02:03:03.440 INFO:tasks.workunit.client.0.smithi050.stdout: 1 82339 1.28 MB/sec execute 224 sec latency 50.375 ms 2024-04-01T02:03:04.439 INFO:tasks.workunit.client.0.smithi050.stdout: 1 82579 1.28 MB/sec execute 225 sec latency 37.239 ms 2024-04-01T02:03:05.439 INFO:tasks.workunit.client.0.smithi050.stdout: 1 82814 1.28 MB/sec execute 226 sec latency 33.624 ms 2024-04-01T02:03:06.439 INFO:tasks.workunit.client.0.smithi050.stdout: 1 83105 1.29 MB/sec execute 227 sec latency 53.476 ms 2024-04-01T02:03:07.440 INFO:tasks.workunit.client.0.smithi050.stdout: 1 83339 1.28 MB/sec execute 228 sec latency 31.540 ms 2024-04-01T02:03:08.440 INFO:tasks.workunit.client.0.smithi050.stdout: 1 83617 1.28 MB/sec execute 229 sec latency 32.803 ms 2024-04-01T02:03:09.440 INFO:tasks.workunit.client.0.smithi050.stdout: 1 83886 1.27 MB/sec execute 230 sec latency 37.643 ms 2024-04-01T02:03:10.440 INFO:tasks.workunit.client.0.smithi050.stdout: 1 84089 1.27 MB/sec execute 231 sec latency 34.749 ms 2024-04-01T02:03:11.440 INFO:tasks.workunit.client.0.smithi050.stdout: 1 84394 1.28 MB/sec execute 232 sec latency 36.955 ms 2024-04-01T02:03:12.440 INFO:tasks.workunit.client.0.smithi050.stdout: 1 84823 1.29 MB/sec execute 233 sec latency 36.967 ms 2024-04-01T02:03:13.440 INFO:tasks.workunit.client.0.smithi050.stdout: 1 84951 1.29 MB/sec execute 234 sec latency 32.547 ms 2024-04-01T02:03:14.440 INFO:tasks.workunit.client.0.smithi050.stdout: 1 85185 1.29 MB/sec execute 235 sec latency 29.168 ms 2024-04-01T02:03:15.440 INFO:tasks.workunit.client.0.smithi050.stdout: 1 85418 1.30 MB/sec execute 236 sec latency 35.532 ms 2024-04-01T02:03:16.440 INFO:tasks.workunit.client.0.smithi050.stdout: 1 85558 1.29 MB/sec execute 237 sec latency 34.582 ms 2024-04-01T02:03:17.440 INFO:tasks.workunit.client.0.smithi050.stdout: 1 85700 1.29 MB/sec execute 238 sec latency 29.066 ms 2024-04-01T02:03:18.440 INFO:tasks.workunit.client.0.smithi050.stdout: 1 85926 1.28 MB/sec execute 239 sec latency 37.146 ms 2024-04-01T02:03:19.440 INFO:tasks.workunit.client.0.smithi050.stdout: 1 86156 1.28 MB/sec execute 240 sec latency 36.025 ms 2024-04-01T02:03:20.440 INFO:tasks.workunit.client.0.smithi050.stdout: 1 86394 1.28 MB/sec execute 241 sec latency 35.780 ms 2024-04-01T02:03:21.440 INFO:tasks.workunit.client.0.smithi050.stdout: 1 86672 1.29 MB/sec execute 242 sec latency 41.151 ms 2024-04-01T02:03:22.440 INFO:tasks.workunit.client.0.smithi050.stdout: 1 86940 1.28 MB/sec execute 243 sec latency 33.144 ms 2024-04-01T02:03:23.440 INFO:tasks.workunit.client.0.smithi050.stdout: 1 87190 1.28 MB/sec execute 244 sec latency 33.043 ms 2024-04-01T02:03:23.798 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T02:03:23.801 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T02:03:24.440 INFO:tasks.workunit.client.0.smithi050.stdout: 1 87499 1.28 MB/sec execute 245 sec latency 32.796 ms 2024-04-01T02:03:25.440 INFO:tasks.workunit.client.0.smithi050.stdout: 1 87674 1.28 MB/sec execute 246 sec latency 38.162 ms 2024-04-01T02:03:26.441 INFO:tasks.workunit.client.0.smithi050.stdout: 1 88055 1.28 MB/sec execute 247 sec latency 44.726 ms 2024-04-01T02:03:27.441 INFO:tasks.workunit.client.0.smithi050.stdout: 1 88455 1.29 MB/sec execute 248 sec latency 36.200 ms 2024-04-01T02:03:28.441 INFO:tasks.workunit.client.0.smithi050.stdout: 1 88505 1.29 MB/sec execute 249 sec latency 33.386 ms 2024-04-01T02:03:29.441 INFO:tasks.workunit.client.0.smithi050.stdout: 1 88794 1.29 MB/sec execute 250 sec latency 36.373 ms 2024-04-01T02:03:30.441 INFO:tasks.workunit.client.0.smithi050.stdout: 1 88995 1.29 MB/sec execute 251 sec latency 31.361 ms 2024-04-01T02:03:31.441 INFO:tasks.workunit.client.0.smithi050.stdout: 1 89142 1.29 MB/sec execute 252 sec latency 31.935 ms 2024-04-01T02:03:32.441 INFO:tasks.workunit.client.0.smithi050.stdout: 1 89307 1.28 MB/sec execute 253 sec latency 36.006 ms 2024-04-01T02:03:33.441 INFO:tasks.workunit.client.0.smithi050.stdout: 1 89550 1.28 MB/sec execute 254 sec latency 33.821 ms 2024-04-01T02:03:34.441 INFO:tasks.workunit.client.0.smithi050.stdout: 1 89783 1.28 MB/sec execute 255 sec latency 35.971 ms 2024-04-01T02:03:35.441 INFO:tasks.workunit.client.0.smithi050.stdout: 1 90014 1.28 MB/sec execute 256 sec latency 34.001 ms 2024-04-01T02:03:36.441 INFO:tasks.workunit.client.0.smithi050.stdout: 1 90285 1.28 MB/sec execute 257 sec latency 43.275 ms 2024-04-01T02:03:37.441 INFO:tasks.workunit.client.0.smithi050.stdout: 1 90549 1.28 MB/sec execute 258 sec latency 33.555 ms 2024-04-01T02:03:38.441 INFO:tasks.workunit.client.0.smithi050.stdout: 1 90784 1.28 MB/sec execute 259 sec latency 36.762 ms 2024-04-01T02:03:39.441 INFO:tasks.workunit.client.0.smithi050.stdout: 1 91062 1.28 MB/sec execute 260 sec latency 31.390 ms 2024-04-01T02:03:40.441 INFO:tasks.workunit.client.0.smithi050.stdout: 1 91275 1.28 MB/sec execute 261 sec latency 32.101 ms 2024-04-01T02:03:41.441 INFO:tasks.workunit.client.0.smithi050.stdout: 1 91626 1.29 MB/sec execute 262 sec latency 35.973 ms 2024-04-01T02:03:42.441 INFO:tasks.workunit.client.0.smithi050.stdout: 1 92005 1.29 MB/sec execute 263 sec latency 36.225 ms 2024-04-01T02:03:43.441 INFO:tasks.workunit.client.0.smithi050.stdout: 1 92053 1.29 MB/sec execute 264 sec latency 32.985 ms 2024-04-01T02:03:44.442 INFO:tasks.workunit.client.0.smithi050.stdout: 1 92347 1.29 MB/sec execute 265 sec latency 31.546 ms 2024-04-01T02:03:45.442 INFO:tasks.workunit.client.0.smithi050.stdout: 1 92543 1.29 MB/sec execute 266 sec latency 37.673 ms 2024-04-01T02:03:46.442 INFO:tasks.workunit.client.0.smithi050.stdout: 1 92689 1.29 MB/sec execute 267 sec latency 35.809 ms 2024-04-01T02:03:47.442 INFO:tasks.workunit.client.0.smithi050.stdout: 1 92858 1.28 MB/sec execute 268 sec latency 35.869 ms 2024-04-01T02:03:48.442 INFO:tasks.workunit.client.0.smithi050.stdout: 1 93096 1.28 MB/sec execute 269 sec latency 30.985 ms 2024-04-01T02:03:49.442 INFO:tasks.workunit.client.0.smithi050.stdout: 1 93329 1.28 MB/sec execute 270 sec latency 35.859 ms 2024-04-01T02:03:50.442 INFO:tasks.workunit.client.0.smithi050.stdout: 1 93560 1.28 MB/sec execute 271 sec latency 30.610 ms 2024-04-01T02:03:51.442 INFO:tasks.workunit.client.0.smithi050.stdout: 1 93860 1.28 MB/sec execute 272 sec latency 32.485 ms 2024-04-01T02:03:52.442 INFO:tasks.workunit.client.0.smithi050.stdout: 1 94114 1.28 MB/sec execute 273 sec latency 33.496 ms 2024-04-01T02:03:53.442 INFO:tasks.workunit.client.0.smithi050.stdout: 1 94354 1.28 MB/sec execute 274 sec latency 36.389 ms 2024-04-01T02:03:53.838 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T02:03:53.841 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T02:03:54.442 INFO:tasks.workunit.client.0.smithi050.stdout: 1 94625 1.28 MB/sec execute 275 sec latency 40.206 ms 2024-04-01T02:03:55.442 INFO:tasks.workunit.client.0.smithi050.stdout: 1 94830 1.28 MB/sec execute 276 sec latency 31.295 ms 2024-04-01T02:03:56.442 INFO:tasks.workunit.client.0.smithi050.stdout: 1 95233 1.29 MB/sec execute 277 sec latency 33.581 ms 2024-04-01T02:03:57.442 INFO:tasks.workunit.client.0.smithi050.stdout: 1 95560 1.29 MB/sec execute 278 sec latency 37.895 ms 2024-04-01T02:03:58.442 INFO:tasks.workunit.client.0.smithi050.stdout: 1 95643 1.29 MB/sec execute 279 sec latency 33.939 ms 2024-04-01T02:03:59.442 INFO:tasks.workunit.client.0.smithi050.stdout: 1 95955 1.29 MB/sec execute 280 sec latency 31.339 ms 2024-04-01T02:04:00.442 INFO:tasks.workunit.client.0.smithi050.stdout: 1 96142 1.29 MB/sec execute 281 sec latency 29.481 ms 2024-04-01T02:04:01.442 INFO:tasks.workunit.client.0.smithi050.stdout: 1 96286 1.29 MB/sec execute 282 sec latency 29.816 ms 2024-04-01T02:04:02.442 INFO:tasks.workunit.client.0.smithi050.stdout: 1 96469 1.28 MB/sec execute 283 sec latency 47.857 ms 2024-04-01T02:04:03.442 INFO:tasks.workunit.client.0.smithi050.stdout: 1 96707 1.28 MB/sec execute 284 sec latency 33.674 ms 2024-04-01T02:04:04.442 INFO:tasks.workunit.client.0.smithi050.stdout: 1 96958 1.28 MB/sec execute 285 sec latency 33.584 ms 2024-04-01T02:04:05.442 INFO:tasks.workunit.client.0.smithi050.stdout: 1 97240 1.29 MB/sec execute 286 sec latency 56.491 ms 2024-04-01T02:04:06.443 INFO:tasks.workunit.client.0.smithi050.stdout: 1 97463 1.28 MB/sec execute 287 sec latency 34.338 ms 2024-04-01T02:04:07.443 INFO:tasks.workunit.client.0.smithi050.stdout: 1 97725 1.28 MB/sec execute 288 sec latency 32.166 ms 2024-04-01T02:04:08.443 INFO:tasks.workunit.client.0.smithi050.stdout: 1 97993 1.28 MB/sec execute 289 sec latency 34.698 ms 2024-04-01T02:04:09.443 INFO:tasks.workunit.client.0.smithi050.stdout: 1 98217 1.28 MB/sec execute 290 sec latency 34.120 ms 2024-04-01T02:04:10.446 INFO:tasks.workunit.client.0.smithi050.stdout: 1 98424 1.28 MB/sec execute 291 sec latency 32.751 ms 2024-04-01T02:04:11.443 INFO:tasks.workunit.client.0.smithi050.stdout: 1 98827 1.29 MB/sec execute 292 sec latency 32.786 ms 2024-04-01T02:04:12.443 INFO:tasks.workunit.client.0.smithi050.stdout: 1 99123 1.29 MB/sec execute 293 sec latency 35.168 ms 2024-04-01T02:04:13.443 INFO:tasks.workunit.client.0.smithi050.stdout: 1 99208 1.29 MB/sec execute 294 sec latency 34.425 ms 2024-04-01T02:04:14.443 INFO:tasks.workunit.client.0.smithi050.stdout: 1 99526 1.29 MB/sec execute 295 sec latency 46.911 ms 2024-04-01T02:04:15.443 INFO:tasks.workunit.client.0.smithi050.stdout: 1 99689 1.29 MB/sec execute 296 sec latency 35.593 ms 2024-04-01T02:04:16.443 INFO:tasks.workunit.client.0.smithi050.stdout: 1 99837 1.29 MB/sec execute 297 sec latency 30.713 ms 2024-04-01T02:04:17.443 INFO:tasks.workunit.client.0.smithi050.stdout: 1 100027 1.28 MB/sec execute 298 sec latency 31.240 ms 2024-04-01T02:04:18.443 INFO:tasks.workunit.client.0.smithi050.stdout: 1 100298 1.28 MB/sec execute 299 sec latency 32.351 ms 2024-04-01T02:04:19.443 INFO:tasks.workunit.client.0.smithi050.stdout: 1 100526 1.28 MB/sec execute 300 sec latency 38.877 ms 2024-04-01T02:04:20.443 INFO:tasks.workunit.client.0.smithi050.stdout: 1 100823 1.29 MB/sec execute 301 sec latency 32.642 ms 2024-04-01T02:04:21.443 INFO:tasks.workunit.client.0.smithi050.stdout: 1 101068 1.28 MB/sec execute 302 sec latency 30.457 ms 2024-04-01T02:04:22.443 INFO:tasks.workunit.client.0.smithi050.stdout: 1 101340 1.28 MB/sec execute 303 sec latency 35.285 ms 2024-04-01T02:04:23.443 INFO:tasks.workunit.client.0.smithi050.stdout: 1 101581 1.28 MB/sec execute 304 sec latency 37.892 ms 2024-04-01T02:04:23.936 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T02:04:23.939 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T02:04:24.443 INFO:tasks.workunit.client.0.smithi050.stdout: 1 101809 1.28 MB/sec execute 305 sec latency 35.472 ms 2024-04-01T02:04:25.443 INFO:tasks.workunit.client.0.smithi050.stdout: 1 102229 1.29 MB/sec execute 306 sec latency 29.614 ms 2024-04-01T02:04:26.443 INFO:tasks.workunit.client.0.smithi050.stdout: 1 102644 1.29 MB/sec execute 307 sec latency 29.840 ms 2024-04-01T02:04:27.444 INFO:tasks.workunit.client.0.smithi050.stdout: 1 102691 1.29 MB/sec execute 308 sec latency 32.475 ms 2024-04-01T02:04:28.444 INFO:tasks.workunit.client.0.smithi050.stdout: 1 102991 1.29 MB/sec execute 309 sec latency 35.594 ms 2024-04-01T02:04:29.444 INFO:tasks.workunit.client.0.smithi050.stdout: 1 103192 1.29 MB/sec execute 310 sec latency 37.767 ms 2024-04-01T02:04:30.444 INFO:tasks.workunit.client.0.smithi050.stdout: 1 103337 1.29 MB/sec execute 311 sec latency 31.089 ms 2024-04-01T02:04:31.444 INFO:tasks.workunit.client.0.smithi050.stdout: 1 103494 1.29 MB/sec execute 312 sec latency 38.120 ms 2024-04-01T02:04:32.444 INFO:tasks.workunit.client.0.smithi050.stdout: 1 103724 1.28 MB/sec execute 313 sec latency 37.726 ms 2024-04-01T02:04:33.444 INFO:tasks.workunit.client.0.smithi050.stdout: 1 103955 1.29 MB/sec execute 314 sec latency 34.265 ms 2024-04-01T02:04:34.444 INFO:tasks.workunit.client.0.smithi050.stdout: 1 104170 1.28 MB/sec execute 315 sec latency 40.660 ms 2024-04-01T02:04:35.444 INFO:tasks.workunit.client.0.smithi050.stdout: 1 104466 1.29 MB/sec execute 316 sec latency 36.550 ms 2024-04-01T02:04:36.444 INFO:tasks.workunit.client.0.smithi050.stdout: 1 104722 1.28 MB/sec execute 317 sec latency 39.207 ms 2024-04-01T02:04:37.444 INFO:tasks.workunit.client.0.smithi050.stdout: 1 104970 1.28 MB/sec execute 318 sec latency 30.819 ms 2024-04-01T02:04:38.444 INFO:tasks.workunit.client.0.smithi050.stdout: 1 105236 1.28 MB/sec execute 319 sec latency 36.888 ms 2024-04-01T02:04:39.444 INFO:tasks.workunit.client.0.smithi050.stdout: 1 105409 1.28 MB/sec execute 320 sec latency 33.275 ms 2024-04-01T02:04:40.444 INFO:tasks.workunit.client.0.smithi050.stdout: 1 105794 1.29 MB/sec execute 321 sec latency 39.340 ms 2024-04-01T02:04:41.445 INFO:tasks.workunit.client.0.smithi050.stdout: 1 106186 1.29 MB/sec execute 322 sec latency 32.538 ms 2024-04-01T02:04:42.445 INFO:tasks.workunit.client.0.smithi050.stdout: 1 106235 1.29 MB/sec execute 323 sec latency 34.726 ms 2024-04-01T02:04:43.445 INFO:tasks.workunit.client.0.smithi050.stdout: 1 106525 1.29 MB/sec execute 324 sec latency 30.827 ms 2024-04-01T02:04:44.445 INFO:tasks.workunit.client.0.smithi050.stdout: 1 106723 1.29 MB/sec execute 325 sec latency 29.870 ms 2024-04-01T02:04:45.445 INFO:tasks.workunit.client.0.smithi050.stdout: 1 106872 1.29 MB/sec execute 326 sec latency 29.392 ms 2024-04-01T02:04:46.445 INFO:tasks.workunit.client.0.smithi050.stdout: 1 107038 1.29 MB/sec execute 327 sec latency 30.127 ms 2024-04-01T02:04:47.445 INFO:tasks.workunit.client.0.smithi050.stdout: 1 107274 1.28 MB/sec execute 328 sec latency 40.048 ms 2024-04-01T02:04:48.445 INFO:tasks.workunit.client.0.smithi050.stdout: 1 107507 1.28 MB/sec execute 329 sec latency 39.209 ms 2024-04-01T02:04:49.445 INFO:tasks.workunit.client.0.smithi050.stdout: 1 107735 1.28 MB/sec execute 330 sec latency 38.054 ms 2024-04-01T02:04:50.445 INFO:tasks.workunit.client.0.smithi050.stdout: 1 108009 1.29 MB/sec execute 331 sec latency 35.785 ms 2024-04-01T02:04:51.445 INFO:tasks.workunit.client.0.smithi050.stdout: 1 108276 1.28 MB/sec execute 332 sec latency 31.732 ms 2024-04-01T02:04:52.445 INFO:tasks.workunit.client.0.smithi050.stdout: 1 108513 1.28 MB/sec execute 333 sec latency 34.427 ms 2024-04-01T02:04:53.445 INFO:tasks.workunit.client.0.smithi050.stdout: 1 108792 1.28 MB/sec execute 334 sec latency 32.558 ms 2024-04-01T02:04:54.027 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T02:04:54.030 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T02:04:54.445 INFO:tasks.workunit.client.0.smithi050.stdout: 1 109010 1.28 MB/sec execute 335 sec latency 33.018 ms 2024-04-01T02:04:55.445 INFO:tasks.workunit.client.0.smithi050.stdout: 1 109416 1.29 MB/sec execute 336 sec latency 31.717 ms 2024-04-01T02:04:56.445 INFO:tasks.workunit.client.0.smithi050.stdout: 1 109742 1.29 MB/sec execute 337 sec latency 33.198 ms 2024-04-01T02:04:57.446 INFO:tasks.workunit.client.0.smithi050.stdout: 1 109786 1.29 MB/sec execute 338 sec latency 34.024 ms 2024-04-01T02:04:58.446 INFO:tasks.workunit.client.0.smithi050.stdout: 1 110115 1.29 MB/sec execute 339 sec latency 35.930 ms 2024-04-01T02:04:59.446 INFO:tasks.workunit.client.0.smithi050.stdout: 1 110309 1.29 MB/sec execute 340 sec latency 27.899 ms 2024-04-01T02:05:00.446 INFO:tasks.workunit.client.0.smithi050.stdout: 1 110454 1.29 MB/sec execute 341 sec latency 30.267 ms 2024-04-01T02:05:01.446 INFO:tasks.workunit.client.0.smithi050.stdout: 1 110620 1.29 MB/sec execute 342 sec latency 32.264 ms 2024-04-01T02:05:02.446 INFO:tasks.workunit.client.0.smithi050.stdout: 1 110868 1.28 MB/sec execute 343 sec latency 41.377 ms 2024-04-01T02:05:03.446 INFO:tasks.workunit.client.0.smithi050.stdout: 1 111097 1.28 MB/sec execute 344 sec latency 34.929 ms 2024-04-01T02:05:04.446 INFO:tasks.workunit.client.0.smithi050.stdout: 1 111392 1.29 MB/sec execute 345 sec latency 46.133 ms 2024-04-01T02:05:05.446 INFO:tasks.workunit.client.0.smithi050.stdout: 1 111612 1.29 MB/sec execute 346 sec latency 36.311 ms 2024-04-01T02:05:06.446 INFO:tasks.workunit.client.0.smithi050.stdout: 1 111868 1.28 MB/sec execute 347 sec latency 36.221 ms 2024-04-01T02:05:07.446 INFO:tasks.workunit.client.0.smithi050.stdout: 1 112101 1.28 MB/sec execute 348 sec latency 36.943 ms 2024-04-01T02:05:08.446 INFO:tasks.workunit.client.0.smithi050.stdout: 1 112368 1.28 MB/sec execute 349 sec latency 33.893 ms 2024-04-01T02:05:09.446 INFO:tasks.workunit.client.0.smithi050.stdout: 1 112581 1.28 MB/sec execute 350 sec latency 35.051 ms 2024-04-01T02:05:10.446 INFO:tasks.workunit.client.0.smithi050.stdout: 1 112985 1.29 MB/sec execute 351 sec latency 29.884 ms 2024-04-01T02:05:11.446 INFO:tasks.workunit.client.0.smithi050.stdout: 1 113292 1.29 MB/sec execute 352 sec latency 39.273 ms 2024-04-01T02:05:12.446 INFO:tasks.workunit.client.0.smithi050.stdout: 1 113361 1.29 MB/sec execute 353 sec latency 30.400 ms 2024-04-01T02:05:13.446 INFO:tasks.workunit.client.0.smithi050.stdout: 1 113670 1.29 MB/sec execute 354 sec latency 36.911 ms 2024-04-01T02:05:14.446 INFO:tasks.workunit.client.0.smithi050.stdout: 1 113854 1.29 MB/sec execute 355 sec latency 29.714 ms 2024-04-01T02:05:15.447 INFO:tasks.workunit.client.0.smithi050.stdout: 1 113998 1.29 MB/sec execute 356 sec latency 34.243 ms 2024-04-01T02:05:16.447 INFO:tasks.workunit.client.0.smithi050.stdout: 1 114156 1.29 MB/sec execute 357 sec latency 38.822 ms 2024-04-01T02:05:17.447 INFO:tasks.workunit.client.0.smithi050.stdout: 1 114408 1.28 MB/sec execute 358 sec latency 49.438 ms 2024-04-01T02:05:18.447 INFO:tasks.workunit.client.0.smithi050.stdout: 1 114634 1.28 MB/sec execute 359 sec latency 32.324 ms 2024-04-01T02:05:19.447 INFO:tasks.workunit.client.0.smithi050.stdout: 1 114846 1.28 MB/sec execute 360 sec latency 43.857 ms 2024-04-01T02:05:20.447 INFO:tasks.workunit.client.0.smithi050.stdout: 1 115123 1.29 MB/sec execute 361 sec latency 44.775 ms 2024-04-01T02:05:21.447 INFO:tasks.workunit.client.0.smithi050.stdout: 1 115378 1.28 MB/sec execute 362 sec latency 35.232 ms 2024-04-01T02:05:22.447 INFO:tasks.workunit.client.0.smithi050.stdout: 1 115626 1.28 MB/sec execute 363 sec latency 32.007 ms 2024-04-01T02:05:23.447 INFO:tasks.workunit.client.0.smithi050.stdout: 1 115890 1.28 MB/sec execute 364 sec latency 36.924 ms 2024-04-01T02:05:24.109 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T02:05:24.112 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T02:05:24.447 INFO:tasks.workunit.client.0.smithi050.stdout: 1 116103 1.28 MB/sec execute 365 sec latency 34.306 ms 2024-04-01T02:05:25.447 INFO:tasks.workunit.client.0.smithi050.stdout: 1 116474 1.29 MB/sec execute 366 sec latency 31.227 ms 2024-04-01T02:05:26.447 INFO:tasks.workunit.client.0.smithi050.stdout: 1 116830 1.29 MB/sec execute 367 sec latency 36.438 ms 2024-04-01T02:05:27.447 INFO:tasks.workunit.client.0.smithi050.stdout: 1 116875 1.29 MB/sec execute 368 sec latency 33.805 ms 2024-04-01T02:05:28.447 INFO:tasks.workunit.client.0.smithi050.stdout: 1 117174 1.29 MB/sec execute 369 sec latency 35.525 ms 2024-04-01T02:05:29.447 INFO:tasks.workunit.client.0.smithi050.stdout: 1 117374 1.29 MB/sec execute 370 sec latency 31.976 ms 2024-04-01T02:05:30.447 INFO:tasks.workunit.client.0.smithi050.stdout: 1 117516 1.29 MB/sec execute 371 sec latency 31.418 ms 2024-04-01T02:05:31.447 INFO:tasks.workunit.client.0.smithi050.stdout: 1 117673 1.29 MB/sec execute 372 sec latency 35.563 ms 2024-04-01T02:05:32.447 INFO:tasks.workunit.client.0.smithi050.stdout: 1 117914 1.28 MB/sec execute 373 sec latency 34.886 ms 2024-04-01T02:05:33.448 INFO:tasks.workunit.client.0.smithi050.stdout: 1 118145 1.28 MB/sec execute 374 sec latency 37.672 ms 2024-04-01T02:05:34.448 INFO:tasks.workunit.client.0.smithi050.stdout: 1 118376 1.28 MB/sec execute 375 sec latency 31.124 ms 2024-04-01T02:05:35.448 INFO:tasks.workunit.client.0.smithi050.stdout: 1 118650 1.29 MB/sec execute 376 sec latency 40.629 ms 2024-04-01T02:05:36.448 INFO:tasks.workunit.client.0.smithi050.stdout: 1 118907 1.28 MB/sec execute 377 sec latency 38.838 ms 2024-04-01T02:05:37.448 INFO:tasks.workunit.client.0.smithi050.stdout: 1 119154 1.28 MB/sec execute 378 sec latency 30.048 ms 2024-04-01T02:05:38.448 INFO:tasks.workunit.client.0.smithi050.stdout: 1 119427 1.28 MB/sec execute 379 sec latency 35.704 ms 2024-04-01T02:05:39.448 INFO:tasks.workunit.client.0.smithi050.stdout: 1 119596 1.28 MB/sec execute 380 sec latency 33.798 ms 2024-04-01T02:05:40.448 INFO:tasks.workunit.client.0.smithi050.stdout: 1 119969 1.28 MB/sec execute 381 sec latency 37.006 ms 2024-04-01T02:05:41.448 INFO:tasks.workunit.client.0.smithi050.stdout: 1 120369 1.29 MB/sec execute 382 sec latency 33.379 ms 2024-04-01T02:05:42.448 INFO:tasks.workunit.client.0.smithi050.stdout: 1 120415 1.29 MB/sec execute 383 sec latency 36.523 ms 2024-04-01T02:05:43.448 INFO:tasks.workunit.client.0.smithi050.stdout: 1 120670 1.29 MB/sec execute 384 sec latency 35.509 ms 2024-04-01T02:05:44.448 INFO:tasks.workunit.client.0.smithi050.stdout: 1 120901 1.29 MB/sec execute 385 sec latency 30.283 ms 2024-04-01T02:05:45.448 INFO:tasks.workunit.client.0.smithi050.stdout: 1 121047 1.29 MB/sec execute 386 sec latency 29.238 ms 2024-04-01T02:05:46.448 INFO:tasks.workunit.client.0.smithi050.stdout: 1 121205 1.28 MB/sec execute 387 sec latency 31.845 ms 2024-04-01T02:05:47.448 INFO:tasks.workunit.client.0.smithi050.stdout: 1 121436 1.28 MB/sec execute 388 sec latency 42.009 ms 2024-04-01T02:05:48.448 INFO:tasks.workunit.client.0.smithi050.stdout: 1 121670 1.28 MB/sec execute 389 sec latency 38.078 ms 2024-04-01T02:05:49.448 INFO:tasks.workunit.client.0.smithi050.stdout: 1 121889 1.28 MB/sec execute 390 sec latency 31.894 ms 2024-04-01T02:05:50.449 INFO:tasks.workunit.client.0.smithi050.stdout: 1 122170 1.28 MB/sec execute 391 sec latency 38.095 ms 2024-04-01T02:05:51.449 INFO:tasks.workunit.client.0.smithi050.stdout: 1 122445 1.28 MB/sec execute 392 sec latency 31.814 ms 2024-04-01T02:05:52.449 INFO:tasks.workunit.client.0.smithi050.stdout: 1 122693 1.28 MB/sec execute 393 sec latency 33.605 ms 2024-04-01T02:05:53.449 INFO:tasks.workunit.client.0.smithi050.stdout: 1 122969 1.28 MB/sec execute 394 sec latency 35.205 ms 2024-04-01T02:05:54.156 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T02:05:54.159 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T02:05:54.449 INFO:tasks.workunit.client.0.smithi050.stdout: 1 123192 1.28 MB/sec execute 395 sec latency 30.883 ms 2024-04-01T02:05:55.449 INFO:tasks.workunit.client.0.smithi050.stdout: 1 123599 1.29 MB/sec execute 396 sec latency 30.926 ms 2024-04-01T02:05:56.449 INFO:tasks.workunit.client.0.smithi050.stdout: 1 123923 1.29 MB/sec execute 397 sec latency 33.391 ms 2024-04-01T02:05:57.449 INFO:tasks.workunit.client.0.smithi050.stdout: 1 123995 1.29 MB/sec execute 398 sec latency 32.797 ms 2024-04-01T02:05:58.449 INFO:tasks.workunit.client.0.smithi050.stdout: 1 124301 1.29 MB/sec execute 399 sec latency 52.712 ms 2024-04-01T02:05:59.449 INFO:tasks.workunit.client.0.smithi050.stdout: 1 124488 1.29 MB/sec execute 400 sec latency 29.450 ms 2024-04-01T02:06:00.449 INFO:tasks.workunit.client.0.smithi050.stdout: 1 124628 1.29 MB/sec execute 401 sec latency 36.967 ms 2024-04-01T02:06:01.449 INFO:tasks.workunit.client.0.smithi050.stdout: 1 124799 1.28 MB/sec execute 402 sec latency 31.073 ms 2024-04-01T02:06:02.449 INFO:tasks.workunit.client.0.smithi050.stdout: 1 125047 1.28 MB/sec execute 403 sec latency 45.306 ms 2024-04-01T02:06:03.449 INFO:tasks.workunit.client.0.smithi050.stdout: 1 125271 1.28 MB/sec execute 404 sec latency 35.559 ms 2024-04-01T02:06:04.449 INFO:tasks.workunit.client.0.smithi050.stdout: 1 125565 1.29 MB/sec execute 405 sec latency 34.431 ms 2024-04-01T02:06:05.449 INFO:tasks.workunit.client.0.smithi050.stdout: 1 125780 1.28 MB/sec execute 406 sec latency 44.131 ms 2024-04-01T02:06:06.449 INFO:tasks.workunit.client.0.smithi050.stdout: 1 126033 1.28 MB/sec execute 407 sec latency 35.278 ms 2024-04-01T02:06:07.449 INFO:tasks.workunit.client.0.smithi050.stdout: 1 126278 1.28 MB/sec execute 408 sec latency 34.892 ms 2024-04-01T02:06:08.450 INFO:tasks.workunit.client.0.smithi050.stdout: 1 126549 1.28 MB/sec execute 409 sec latency 31.295 ms 2024-04-01T02:06:09.450 INFO:tasks.workunit.client.0.smithi050.stdout: 1 126746 1.28 MB/sec execute 410 sec latency 38.244 ms 2024-04-01T02:06:10.450 INFO:tasks.workunit.client.0.smithi050.stdout: 1 127125 1.29 MB/sec execute 411 sec latency 33.253 ms 2024-04-01T02:06:11.450 INFO:tasks.workunit.client.0.smithi050.stdout: 1 127473 1.29 MB/sec execute 412 sec latency 35.596 ms 2024-04-01T02:06:12.450 INFO:tasks.workunit.client.0.smithi050.stdout: 1 127517 1.29 MB/sec execute 413 sec latency 36.395 ms 2024-04-01T02:06:13.450 INFO:tasks.workunit.client.0.smithi050.stdout: 1 127818 1.29 MB/sec execute 414 sec latency 34.137 ms 2024-04-01T02:06:14.450 INFO:tasks.workunit.client.0.smithi050.stdout: 1 128022 1.29 MB/sec execute 415 sec latency 31.841 ms 2024-04-01T02:06:15.450 INFO:tasks.workunit.client.0.smithi050.stdout: 1 128162 1.29 MB/sec execute 416 sec latency 36.302 ms 2024-04-01T02:06:16.450 INFO:tasks.workunit.client.0.smithi050.stdout: 1 128328 1.28 MB/sec execute 417 sec latency 31.630 ms 2024-04-01T02:06:17.450 INFO:tasks.workunit.client.0.smithi050.stdout: 1 128552 1.28 MB/sec execute 418 sec latency 53.994 ms 2024-04-01T02:06:18.450 INFO:tasks.workunit.client.0.smithi050.stdout: 1 128784 1.28 MB/sec execute 419 sec latency 32.595 ms 2024-04-01T02:06:19.450 INFO:tasks.workunit.client.0.smithi050.stdout: 1 129012 1.28 MB/sec execute 420 sec latency 37.700 ms 2024-04-01T02:06:20.453 INFO:tasks.workunit.client.0.smithi050.stdout: 1 129291 1.28 MB/sec execute 421 sec latency 39.030 ms 2024-04-01T02:06:21.450 INFO:tasks.workunit.client.0.smithi050.stdout: 1 129569 1.28 MB/sec execute 422 sec latency 33.011 ms 2024-04-01T02:06:22.450 INFO:tasks.workunit.client.0.smithi050.stdout: 1 129811 1.28 MB/sec execute 423 sec latency 34.892 ms 2024-04-01T02:06:23.450 INFO:tasks.workunit.client.0.smithi050.stdout: 1 130087 1.28 MB/sec execute 424 sec latency 33.917 ms 2024-04-01T02:06:24.238 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T02:06:24.241 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T02:06:24.451 INFO:tasks.workunit.client.0.smithi050.stdout: 1 130304 1.28 MB/sec execute 425 sec latency 31.095 ms 2024-04-01T02:06:25.450 INFO:tasks.workunit.client.0.smithi050.stdout: 1 130702 1.29 MB/sec execute 426 sec latency 40.388 ms 2024-04-01T02:06:26.451 INFO:tasks.workunit.client.0.smithi050.stdout: 1 131024 1.29 MB/sec execute 427 sec latency 31.745 ms 2024-04-01T02:06:27.451 INFO:tasks.workunit.client.0.smithi050.stdout: 1 131105 1.28 MB/sec execute 428 sec latency 33.524 ms 2024-04-01T02:06:28.451 INFO:tasks.workunit.client.0.smithi050.stdout: 1 131419 1.29 MB/sec execute 429 sec latency 34.756 ms 2024-04-01T02:06:29.451 INFO:tasks.workunit.client.0.smithi050.stdout: 1 131595 1.29 MB/sec execute 430 sec latency 33.242 ms 2024-04-01T02:06:30.451 INFO:tasks.workunit.client.0.smithi050.stdout: 1 131744 1.29 MB/sec execute 431 sec latency 33.537 ms 2024-04-01T02:06:31.451 INFO:tasks.workunit.client.0.smithi050.stdout: 1 131903 1.28 MB/sec execute 432 sec latency 46.572 ms 2024-04-01T02:06:32.451 INFO:tasks.workunit.client.0.smithi050.stdout: 1 132149 1.28 MB/sec execute 433 sec latency 37.382 ms 2024-04-01T02:06:33.451 INFO:tasks.workunit.client.0.smithi050.stdout: 1 132373 1.28 MB/sec execute 434 sec latency 39.621 ms 2024-04-01T02:06:34.451 INFO:tasks.workunit.client.0.smithi050.stdout: 1 132660 1.29 MB/sec execute 435 sec latency 37.862 ms 2024-04-01T02:06:35.451 INFO:tasks.workunit.client.0.smithi050.stdout: 1 132871 1.28 MB/sec execute 436 sec latency 37.900 ms 2024-04-01T02:06:36.451 INFO:tasks.workunit.client.0.smithi050.stdout: 1 133125 1.28 MB/sec execute 437 sec latency 37.422 ms 2024-04-01T02:06:37.451 INFO:tasks.workunit.client.0.smithi050.stdout: 1 133374 1.28 MB/sec execute 438 sec latency 32.778 ms 2024-04-01T02:06:38.451 INFO:tasks.workunit.client.0.smithi050.stdout: 1 133640 1.28 MB/sec execute 439 sec latency 40.053 ms 2024-04-01T02:06:39.451 INFO:tasks.workunit.client.0.smithi050.stdout: 1 133836 1.28 MB/sec execute 440 sec latency 48.216 ms 2024-04-01T02:06:40.451 INFO:tasks.workunit.client.0.smithi050.stdout: 1 134200 1.29 MB/sec execute 441 sec latency 39.678 ms 2024-04-01T02:06:41.452 INFO:tasks.workunit.client.0.smithi050.stdout: 1 134558 1.29 MB/sec execute 442 sec latency 35.886 ms 2024-04-01T02:06:42.452 INFO:tasks.workunit.client.0.smithi050.stdout: 1 134605 1.28 MB/sec execute 443 sec latency 32.620 ms 2024-04-01T02:06:43.452 INFO:tasks.workunit.client.0.smithi050.stdout: 1 134889 1.29 MB/sec execute 444 sec latency 52.823 ms 2024-04-01T02:06:44.452 INFO:tasks.workunit.client.0.smithi050.stdout: 1 135089 1.29 MB/sec execute 445 sec latency 33.665 ms 2024-04-01T02:06:45.452 INFO:tasks.workunit.client.0.smithi050.stdout: 1 135233 1.29 MB/sec execute 446 sec latency 35.764 ms 2024-04-01T02:06:46.452 INFO:tasks.workunit.client.0.smithi050.stdout: 1 135389 1.28 MB/sec execute 447 sec latency 33.354 ms 2024-04-01T02:06:47.452 INFO:tasks.workunit.client.0.smithi050.stdout: 1 135601 1.28 MB/sec execute 448 sec latency 65.433 ms 2024-04-01T02:06:48.452 INFO:tasks.workunit.client.0.smithi050.stdout: 1 135824 1.28 MB/sec execute 449 sec latency 31.602 ms 2024-04-01T02:06:49.452 INFO:tasks.workunit.client.0.smithi050.stdout: 1 136031 1.28 MB/sec execute 450 sec latency 38.418 ms 2024-04-01T02:06:50.452 INFO:tasks.workunit.client.0.smithi050.stdout: 1 136317 1.28 MB/sec execute 451 sec latency 41.958 ms 2024-04-01T02:06:51.452 INFO:tasks.workunit.client.0.smithi050.stdout: 1 136535 1.28 MB/sec execute 452 sec latency 36.692 ms 2024-04-01T02:06:52.452 INFO:tasks.workunit.client.0.smithi050.stdout: 1 136825 1.28 MB/sec execute 453 sec latency 35.486 ms 2024-04-01T02:06:53.452 INFO:tasks.workunit.client.0.smithi050.stdout: 1 137115 1.28 MB/sec execute 454 sec latency 33.511 ms 2024-04-01T02:06:54.287 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T02:06:54.289 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T02:06:54.452 INFO:tasks.workunit.client.0.smithi050.stdout: 1 137292 1.28 MB/sec execute 455 sec latency 32.278 ms 2024-04-01T02:06:55.452 INFO:tasks.workunit.client.0.smithi050.stdout: 1 137597 1.28 MB/sec execute 456 sec latency 36.872 ms 2024-04-01T02:06:56.452 INFO:tasks.workunit.client.0.smithi050.stdout: 1 138026 1.28 MB/sec execute 457 sec latency 35.822 ms 2024-04-01T02:06:57.452 INFO:tasks.workunit.client.0.smithi050.stdout: 1 138138 1.28 MB/sec execute 458 sec latency 32.527 ms 2024-04-01T02:06:58.453 INFO:tasks.workunit.client.0.smithi050.stdout: 1 138364 1.29 MB/sec execute 459 sec latency 38.064 ms 2024-04-01T02:06:59.453 INFO:tasks.workunit.client.0.smithi050.stdout: 1 138619 1.29 MB/sec execute 460 sec latency 29.203 ms 2024-04-01T02:07:00.453 INFO:tasks.workunit.client.0.smithi050.stdout: 1 138776 1.29 MB/sec execute 461 sec latency 29.431 ms 2024-04-01T02:07:01.453 INFO:tasks.workunit.client.0.smithi050.stdout: 1 138952 1.28 MB/sec execute 462 sec latency 31.653 ms 2024-04-01T02:07:02.453 INFO:tasks.workunit.client.0.smithi050.stdout: 1 139191 1.28 MB/sec execute 463 sec latency 39.459 ms 2024-04-01T02:07:03.453 INFO:tasks.workunit.client.0.smithi050.stdout: 1 139423 1.28 MB/sec execute 464 sec latency 33.114 ms 2024-04-01T02:07:04.453 INFO:tasks.workunit.client.0.smithi050.stdout: 1 139652 1.28 MB/sec execute 465 sec latency 46.385 ms 2024-04-01T02:07:05.453 INFO:tasks.workunit.client.0.smithi050.stdout: 1 139926 1.28 MB/sec execute 466 sec latency 34.356 ms 2024-04-01T02:07:06.453 INFO:tasks.workunit.client.0.smithi050.stdout: 1 140190 1.28 MB/sec execute 467 sec latency 35.121 ms 2024-04-01T02:07:07.453 INFO:tasks.workunit.client.0.smithi050.stdout: 1 140423 1.28 MB/sec execute 468 sec latency 35.334 ms 2024-04-01T02:07:08.453 INFO:tasks.workunit.client.0.smithi050.stdout: 1 140702 1.28 MB/sec execute 469 sec latency 37.256 ms 2024-04-01T02:07:09.453 INFO:tasks.workunit.client.0.smithi050.stdout: 1 140873 1.28 MB/sec execute 470 sec latency 36.589 ms 2024-04-01T02:07:10.453 INFO:tasks.workunit.client.0.smithi050.stdout: 1 141262 1.28 MB/sec execute 471 sec latency 39.287 ms 2024-04-01T02:07:11.453 INFO:tasks.workunit.client.0.smithi050.stdout: 1 141647 1.29 MB/sec execute 472 sec latency 31.007 ms 2024-04-01T02:07:12.453 INFO:tasks.workunit.client.0.smithi050.stdout: 1 141695 1.28 MB/sec execute 473 sec latency 35.955 ms 2024-04-01T02:07:13.454 INFO:tasks.workunit.client.0.smithi050.stdout: 1 141945 1.29 MB/sec execute 474 sec latency 52.978 ms 2024-04-01T02:07:14.453 INFO:tasks.workunit.client.0.smithi050.stdout: 1 142176 1.29 MB/sec execute 475 sec latency 35.173 ms 2024-04-01T02:07:15.453 INFO:tasks.workunit.client.0.smithi050.stdout: 1 142322 1.29 MB/sec execute 476 sec latency 32.059 ms 2024-04-01T02:07:16.454 INFO:tasks.workunit.client.0.smithi050.stdout: 1 142481 1.28 MB/sec execute 477 sec latency 29.501 ms 2024-04-01T02:07:17.454 INFO:tasks.workunit.client.0.smithi050.stdout: 1 142734 1.28 MB/sec execute 478 sec latency 36.926 ms 2024-04-01T02:07:18.454 INFO:tasks.workunit.client.0.smithi050.stdout: 1 142968 1.28 MB/sec execute 479 sec latency 33.736 ms 2024-04-01T02:07:19.454 INFO:tasks.workunit.client.0.smithi050.stdout: 1 143198 1.28 MB/sec execute 480 sec latency 36.478 ms 2024-04-01T02:07:20.454 INFO:tasks.workunit.client.0.smithi050.stdout: 1 143473 1.28 MB/sec execute 481 sec latency 33.083 ms 2024-04-01T02:07:21.454 INFO:tasks.workunit.client.0.smithi050.stdout: 1 143743 1.28 MB/sec execute 482 sec latency 31.645 ms 2024-04-01T02:07:22.454 INFO:tasks.workunit.client.0.smithi050.stdout: 1 143993 1.28 MB/sec execute 483 sec latency 33.887 ms 2024-04-01T02:07:23.454 INFO:tasks.workunit.client.0.smithi050.stdout: 1 144260 1.28 MB/sec execute 484 sec latency 33.019 ms 2024-04-01T02:07:24.367 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T02:07:24.370 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T02:07:24.454 INFO:tasks.workunit.client.0.smithi050.stdout: 1 144466 1.28 MB/sec execute 485 sec latency 38.247 ms 2024-04-01T02:07:25.454 INFO:tasks.workunit.client.0.smithi050.stdout: 1 144876 1.28 MB/sec execute 486 sec latency 29.029 ms 2024-04-01T02:07:26.454 INFO:tasks.workunit.client.0.smithi050.stdout: 1 145200 1.29 MB/sec execute 487 sec latency 36.326 ms 2024-04-01T02:07:27.454 INFO:tasks.workunit.client.0.smithi050.stdout: 1 145249 1.28 MB/sec execute 488 sec latency 31.024 ms 2024-04-01T02:07:28.454 INFO:tasks.workunit.client.0.smithi050.stdout: 1 145572 1.29 MB/sec execute 489 sec latency 52.926 ms 2024-04-01T02:07:29.454 INFO:tasks.workunit.client.0.smithi050.stdout: 1 145758 1.29 MB/sec execute 490 sec latency 32.475 ms 2024-04-01T02:07:30.454 INFO:tasks.workunit.client.0.smithi050.stdout: 1 145900 1.29 MB/sec execute 491 sec latency 31.138 ms 2024-04-01T02:07:31.455 INFO:tasks.workunit.client.0.smithi050.stdout: 1 146067 1.28 MB/sec execute 492 sec latency 30.471 ms 2024-04-01T02:07:32.454 INFO:tasks.workunit.client.0.smithi050.stdout: 1 146323 1.28 MB/sec execute 493 sec latency 36.964 ms 2024-04-01T02:07:33.454 INFO:tasks.workunit.client.0.smithi050.stdout: 1 146550 1.28 MB/sec execute 494 sec latency 31.411 ms 2024-04-01T02:07:34.454 INFO:tasks.workunit.client.0.smithi050.stdout: 1 146843 1.28 MB/sec execute 495 sec latency 39.294 ms 2024-04-01T02:07:35.454 INFO:tasks.workunit.client.0.smithi050.stdout: 1 147054 1.28 MB/sec execute 496 sec latency 37.224 ms 2024-04-01T02:07:36.454 INFO:tasks.workunit.client.0.smithi050.stdout: 1 147321 1.28 MB/sec execute 497 sec latency 36.596 ms 2024-04-01T02:07:37.455 INFO:tasks.workunit.client.0.smithi050.stdout: 1 147557 1.28 MB/sec execute 498 sec latency 32.416 ms 2024-04-01T02:07:38.455 INFO:tasks.workunit.client.0.smithi050.stdout: 1 147824 1.28 MB/sec execute 499 sec latency 36.781 ms 2024-04-01T02:07:39.455 INFO:tasks.workunit.client.0.smithi050.stdout: 1 148040 1.28 MB/sec execute 500 sec latency 32.756 ms 2024-04-01T02:07:40.455 INFO:tasks.workunit.client.0.smithi050.stdout: 1 148423 1.28 MB/sec execute 501 sec latency 37.464 ms 2024-04-01T02:07:41.455 INFO:tasks.workunit.client.0.smithi050.stdout: 1 148747 1.29 MB/sec execute 502 sec latency 34.737 ms 2024-04-01T02:07:42.455 INFO:tasks.workunit.client.0.smithi050.stdout: 1 148791 1.28 MB/sec execute 503 sec latency 39.146 ms 2024-04-01T02:07:43.455 INFO:tasks.workunit.client.0.smithi050.stdout: 1 149092 1.29 MB/sec execute 504 sec latency 32.702 ms 2024-04-01T02:07:44.455 INFO:tasks.workunit.client.0.smithi050.stdout: 1 149285 1.29 MB/sec execute 505 sec latency 35.483 ms 2024-04-01T02:07:45.455 INFO:tasks.workunit.client.0.smithi050.stdout: 1 149428 1.28 MB/sec execute 506 sec latency 31.233 ms 2024-04-01T02:07:46.455 INFO:tasks.workunit.client.0.smithi050.stdout: 1 149590 1.28 MB/sec execute 507 sec latency 35.348 ms 2024-04-01T02:07:47.455 INFO:tasks.workunit.client.0.smithi050.stdout: 1 149822 1.28 MB/sec execute 508 sec latency 49.920 ms 2024-04-01T02:07:48.455 INFO:tasks.workunit.client.0.smithi050.stdout: 1 150050 1.28 MB/sec execute 509 sec latency 35.137 ms 2024-04-01T02:07:49.455 INFO:tasks.workunit.client.0.smithi050.stdout: 1 150262 1.28 MB/sec execute 510 sec latency 35.320 ms 2024-04-01T02:07:50.455 INFO:tasks.workunit.client.0.smithi050.stdout: 1 150537 1.28 MB/sec execute 511 sec latency 35.535 ms 2024-04-01T02:07:51.455 INFO:tasks.workunit.client.0.smithi050.stdout: 1 150823 1.28 MB/sec execute 512 sec latency 31.673 ms 2024-04-01T02:07:52.455 INFO:tasks.workunit.client.0.smithi050.stdout: 1 151062 1.28 MB/sec execute 513 sec latency 35.465 ms 2024-04-01T02:07:53.455 INFO:tasks.workunit.client.0.smithi050.stdout: 1 151338 1.28 MB/sec execute 514 sec latency 36.615 ms 2024-04-01T02:07:54.455 INFO:tasks.workunit.client.0.smithi050.stdout: 1 151549 1.28 MB/sec execute 515 sec latency 33.760 ms 2024-04-01T02:07:54.482 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T02:07:54.486 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T02:07:55.456 INFO:tasks.workunit.client.0.smithi050.stdout: 1 151930 1.28 MB/sec execute 516 sec latency 31.827 ms 2024-04-01T02:07:56.456 INFO:tasks.workunit.client.0.smithi050.stdout: 1 152286 1.29 MB/sec execute 517 sec latency 37.464 ms 2024-04-01T02:07:57.456 INFO:tasks.workunit.client.0.smithi050.stdout: 1 152339 1.28 MB/sec execute 518 sec latency 33.669 ms 2024-04-01T02:07:58.456 INFO:tasks.workunit.client.0.smithi050.stdout: 1 152657 1.29 MB/sec execute 519 sec latency 36.880 ms 2024-04-01T02:07:59.456 INFO:tasks.workunit.client.0.smithi050.stdout: 1 152843 1.29 MB/sec execute 520 sec latency 31.132 ms 2024-04-01T02:08:00.456 INFO:tasks.workunit.client.0.smithi050.stdout: 1 152981 1.28 MB/sec execute 521 sec latency 32.879 ms 2024-04-01T02:08:01.456 INFO:tasks.workunit.client.0.smithi050.stdout: 1 153146 1.28 MB/sec execute 522 sec latency 32.769 ms 2024-04-01T02:08:02.457 INFO:tasks.workunit.client.0.smithi050.stdout: 1 153378 1.28 MB/sec execute 523 sec latency 38.315 ms 2024-04-01T02:08:03.457 INFO:tasks.workunit.client.0.smithi050.stdout: 1 153609 1.28 MB/sec execute 524 sec latency 36.743 ms 2024-04-01T02:08:04.457 INFO:tasks.workunit.client.0.smithi050.stdout: 1 153835 1.28 MB/sec execute 525 sec latency 36.795 ms 2024-04-01T02:08:05.457 INFO:tasks.workunit.client.0.smithi050.stdout: 1 154111 1.28 MB/sec execute 526 sec latency 45.683 ms 2024-04-01T02:08:06.457 INFO:tasks.workunit.client.0.smithi050.stdout: 1 154378 1.28 MB/sec execute 527 sec latency 33.799 ms 2024-04-01T02:08:07.457 INFO:tasks.workunit.client.0.smithi050.stdout: 1 154614 1.28 MB/sec execute 528 sec latency 36.175 ms 2024-04-01T02:08:08.457 INFO:tasks.workunit.client.0.smithi050.stdout: 1 154891 1.28 MB/sec execute 529 sec latency 31.980 ms 2024-04-01T02:08:09.457 INFO:tasks.workunit.client.0.smithi050.stdout: 1 155055 1.28 MB/sec execute 530 sec latency 37.525 ms 2024-04-01T02:08:10.457 INFO:tasks.workunit.client.0.smithi050.stdout: 1 155447 1.28 MB/sec execute 531 sec latency 38.349 ms 2024-04-01T02:08:11.457 INFO:tasks.workunit.client.0.smithi050.stdout: 1 155829 1.29 MB/sec execute 532 sec latency 32.829 ms 2024-04-01T02:08:12.457 INFO:tasks.workunit.client.0.smithi050.stdout: 1 155878 1.28 MB/sec execute 533 sec latency 30.673 ms 2024-04-01T02:08:13.457 INFO:tasks.workunit.client.0.smithi050.stdout: 1 156178 1.29 MB/sec execute 534 sec latency 31.435 ms 2024-04-01T02:08:14.457 INFO:tasks.workunit.client.0.smithi050.stdout: 1 156377 1.29 MB/sec execute 535 sec latency 36.269 ms 2024-04-01T02:08:15.458 INFO:tasks.workunit.client.0.smithi050.stdout: 1 156505 1.28 MB/sec execute 536 sec latency 34.833 ms 2024-04-01T02:08:16.458 INFO:tasks.workunit.client.0.smithi050.stdout: 1 156658 1.28 MB/sec execute 537 sec latency 29.960 ms 2024-04-01T02:08:17.458 INFO:tasks.workunit.client.0.smithi050.stdout: 1 156893 1.28 MB/sec execute 538 sec latency 47.025 ms 2024-04-01T02:08:18.458 INFO:tasks.workunit.client.0.smithi050.stdout: 1 157129 1.28 MB/sec execute 539 sec latency 37.571 ms 2024-04-01T02:08:19.458 INFO:tasks.workunit.client.0.smithi050.stdout: 1 157345 1.28 MB/sec execute 540 sec latency 31.910 ms 2024-04-01T02:08:20.458 INFO:tasks.workunit.client.0.smithi050.stdout: 1 157612 1.28 MB/sec execute 541 sec latency 39.770 ms 2024-04-01T02:08:21.458 INFO:tasks.workunit.client.0.smithi050.stdout: 1 157876 1.28 MB/sec execute 542 sec latency 30.707 ms 2024-04-01T02:08:22.458 INFO:tasks.workunit.client.0.smithi050.stdout: 1 158132 1.28 MB/sec execute 543 sec latency 34.398 ms 2024-04-01T02:08:23.458 INFO:tasks.workunit.client.0.smithi050.stdout: 1 158402 1.28 MB/sec execute 544 sec latency 35.905 ms 2024-04-01T02:08:24.458 INFO:tasks.workunit.client.0.smithi050.stdout: 1 158565 1.28 MB/sec execute 545 sec latency 37.456 ms 2024-04-01T02:08:24.528 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T02:08:24.531 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T02:08:25.458 INFO:tasks.workunit.client.0.smithi050.stdout: 1 158965 1.28 MB/sec execute 546 sec latency 37.833 ms 2024-04-01T02:08:26.458 INFO:tasks.workunit.client.0.smithi050.stdout: 1 159361 1.28 MB/sec execute 547 sec latency 37.460 ms 2024-04-01T02:08:27.458 INFO:tasks.workunit.client.0.smithi050.stdout: 1 159412 1.28 MB/sec execute 548 sec latency 37.343 ms 2024-04-01T02:08:28.458 INFO:tasks.workunit.client.0.smithi050.stdout: 1 159637 1.29 MB/sec execute 549 sec latency 38.013 ms 2024-04-01T02:08:29.458 INFO:tasks.workunit.client.0.smithi050.stdout: 1 159878 1.29 MB/sec execute 550 sec latency 41.819 ms 2024-04-01T02:08:30.458 INFO:tasks.workunit.client.0.smithi050.stdout: 1 160020 1.28 MB/sec execute 551 sec latency 30.740 ms 2024-04-01T02:08:31.458 INFO:tasks.workunit.client.0.smithi050.stdout: 1 160166 1.28 MB/sec execute 552 sec latency 34.793 ms 2024-04-01T02:08:32.459 INFO:tasks.workunit.client.0.smithi050.stdout: 1 160350 1.28 MB/sec execute 553 sec latency 46.121 ms 2024-04-01T02:08:33.458 INFO:tasks.workunit.client.0.smithi050.stdout: 1 160583 1.28 MB/sec execute 554 sec latency 32.041 ms 2024-04-01T02:08:34.459 INFO:tasks.workunit.client.0.smithi050.stdout: 1 160815 1.28 MB/sec execute 555 sec latency 41.658 ms 2024-04-01T02:08:35.459 INFO:tasks.workunit.client.0.smithi050.stdout: 1 161094 1.28 MB/sec execute 556 sec latency 47.838 ms 2024-04-01T02:08:36.460 INFO:tasks.workunit.client.0.smithi050.stdout: 1 161289 1.28 MB/sec execute 557 sec latency 37.520 ms 2024-04-01T02:08:37.459 INFO:tasks.workunit.client.0.smithi050.stdout: 1 161543 1.28 MB/sec execute 558 sec latency 38.539 ms 2024-04-01T02:08:38.459 INFO:tasks.workunit.client.0.smithi050.stdout: 1 161792 1.28 MB/sec execute 559 sec latency 37.304 ms 2024-04-01T02:08:39.459 INFO:tasks.workunit.client.0.smithi050.stdout: 1 162032 1.28 MB/sec execute 560 sec latency 35.101 ms 2024-04-01T02:08:40.459 INFO:tasks.workunit.client.0.smithi050.stdout: 1 162242 1.28 MB/sec execute 561 sec latency 32.089 ms 2024-04-01T02:08:41.459 INFO:tasks.workunit.client.0.smithi050.stdout: 1 162628 1.28 MB/sec execute 562 sec latency 34.544 ms 2024-04-01T02:08:42.459 INFO:tasks.workunit.client.0.smithi050.stdout: 1 162936 1.28 MB/sec execute 563 sec latency 32.904 ms 2024-04-01T02:08:43.459 INFO:tasks.workunit.client.0.smithi050.stdout: 1 163010 1.28 MB/sec execute 564 sec latency 40.121 ms 2024-04-01T02:08:44.459 INFO:tasks.workunit.client.0.smithi050.stdout: 1 163323 1.28 MB/sec execute 565 sec latency 31.636 ms 2024-04-01T02:08:45.459 INFO:tasks.workunit.client.0.smithi050.stdout: 1 163512 1.28 MB/sec execute 566 sec latency 28.438 ms 2024-04-01T02:08:46.459 INFO:tasks.workunit.client.0.smithi050.stdout: 1 163665 1.28 MB/sec execute 567 sec latency 33.698 ms 2024-04-01T02:08:47.460 INFO:tasks.workunit.client.0.smithi050.stdout: 1 163849 1.28 MB/sec execute 568 sec latency 52.382 ms 2024-04-01T02:08:48.459 INFO:tasks.workunit.client.0.smithi050.stdout: 1 164091 1.28 MB/sec execute 569 sec latency 36.924 ms 2024-04-01T02:08:49.459 INFO:tasks.workunit.client.0.smithi050.stdout: 1 164326 1.28 MB/sec execute 570 sec latency 30.272 ms 2024-04-01T02:08:50.460 INFO:tasks.workunit.client.0.smithi050.stdout: 1 164618 1.28 MB/sec execute 571 sec latency 40.330 ms 2024-04-01T02:08:51.460 INFO:tasks.workunit.client.0.smithi050.stdout: 1 164842 1.28 MB/sec execute 572 sec latency 33.054 ms 2024-04-01T02:08:52.460 INFO:tasks.workunit.client.0.smithi050.stdout: 1 165092 1.28 MB/sec execute 573 sec latency 37.552 ms 2024-04-01T02:08:53.460 INFO:tasks.workunit.client.0.smithi050.stdout: 1 165361 1.28 MB/sec execute 574 sec latency 38.210 ms 2024-04-01T02:08:54.460 INFO:tasks.workunit.client.0.smithi050.stdout: 1 165579 1.28 MB/sec execute 575 sec latency 38.596 ms 2024-04-01T02:08:54.638 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T02:08:54.641 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T02:08:55.460 INFO:tasks.workunit.client.0.smithi050.stdout: 1 165803 1.28 MB/sec execute 576 sec latency 46.339 ms 2024-04-01T02:08:56.460 INFO:tasks.workunit.client.0.smithi050.stdout: 1 166350 1.28 MB/sec execute 577 sec latency 30.335 ms 2024-04-01T02:08:57.460 INFO:tasks.workunit.client.0.smithi050.stdout: 1 166496 1.28 MB/sec execute 578 sec latency 31.844 ms 2024-04-01T02:08:58.460 INFO:tasks.workunit.client.0.smithi050.stdout: 1 166707 1.29 MB/sec execute 579 sec latency 37.362 ms 2024-04-01T02:08:59.460 INFO:tasks.workunit.client.0.smithi050.stdout: 1 166962 1.29 MB/sec execute 580 sec latency 30.137 ms 2024-04-01T02:09:00.460 INFO:tasks.workunit.client.0.smithi050.stdout: 1 167109 1.28 MB/sec execute 581 sec latency 34.094 ms 2024-04-01T02:09:01.462 INFO:tasks.workunit.client.0.smithi050.stdout: 1 167253 1.28 MB/sec execute 582 sec latency 30.506 ms 2024-04-01T02:09:02.461 INFO:tasks.workunit.client.0.smithi050.stdout: 1 167470 1.28 MB/sec execute 583 sec latency 42.924 ms 2024-04-01T02:09:03.461 INFO:tasks.workunit.client.0.smithi050.stdout: 1 167711 1.28 MB/sec execute 584 sec latency 38.480 ms 2024-04-01T02:09:04.460 INFO:tasks.workunit.client.0.smithi050.stdout: 1 167953 1.28 MB/sec execute 585 sec latency 33.152 ms 2024-04-01T02:09:05.460 INFO:tasks.workunit.client.0.smithi050.stdout: 1 168229 1.28 MB/sec execute 586 sec latency 43.397 ms 2024-04-01T02:09:06.460 INFO:tasks.workunit.client.0.smithi050.stdout: 1 168511 1.28 MB/sec execute 587 sec latency 32.385 ms 2024-04-01T02:09:07.461 INFO:tasks.workunit.client.0.smithi050.stdout: 1 168771 1.28 MB/sec execute 588 sec latency 30.954 ms 2024-04-01T02:09:08.460 INFO:tasks.workunit.client.0.smithi050.stdout: 1 169040 1.28 MB/sec execute 589 sec latency 35.020 ms 2024-04-01T02:09:09.461 INFO:tasks.workunit.client.0.smithi050.stdout: 1 169224 1.28 MB/sec execute 590 sec latency 33.268 ms 2024-04-01T02:09:10.461 INFO:tasks.workunit.client.0.smithi050.stdout: 1 169601 1.28 MB/sec execute 591 sec latency 35.646 ms 2024-04-01T02:09:11.461 INFO:tasks.workunit.client.0.smithi050.stdout: 1 169997 1.28 MB/sec execute 592 sec latency 35.768 ms 2024-04-01T02:09:12.461 INFO:tasks.workunit.client.0.smithi050.stdout: 1 170058 1.28 MB/sec execute 593 sec latency 35.640 ms 2024-04-01T02:09:13.461 INFO:tasks.workunit.client.0.smithi050.stdout: 1 170337 1.29 MB/sec execute 594 sec latency 36.126 ms 2024-04-01T02:09:14.461 INFO:tasks.workunit.client.0.smithi050.stdout: 1 170541 1.28 MB/sec execute 595 sec latency 51.188 ms 2024-04-01T02:09:15.461 INFO:tasks.workunit.client.0.smithi050.stdout: 1 170684 1.28 MB/sec execute 596 sec latency 36.296 ms 2024-04-01T02:09:16.461 INFO:tasks.workunit.client.0.smithi050.stdout: 1 170831 1.28 MB/sec execute 597 sec latency 33.356 ms 2024-04-01T02:09:17.461 INFO:tasks.workunit.client.0.smithi050.stdout: 1 171073 1.28 MB/sec execute 598 sec latency 32.294 ms 2024-04-01T02:09:18.461 INFO:tasks.workunit.client.0.smithi050.stdout: 1 171315 1.28 MB/sec execute 599 sec latency 34.458 ms 2024-04-01T02:09:19.462 INFO:tasks.workunit.client.0.smithi050.stdout: 1 cleanup 600 sec 2024-04-01T02:09:20.152 INFO:tasks.workunit.client.0.smithi050.stdout: 0 cleanup 601 sec 2024-04-01T02:09:20.153 INFO:tasks.workunit.client.0.smithi050.stdout: 2024-04-01T02:09:20.153 INFO:tasks.workunit.client.0.smithi050.stdout: Operation Count AvgLat MaxLat 2024-04-01T02:09:20.153 INFO:tasks.workunit.client.0.smithi050.stdout: ---------------------------------------- 2024-04-01T02:09:20.153 INFO:tasks.workunit.client.0.smithi050.stdout: NTCreateX 24639 7.219 55.975 2024-04-01T02:09:20.153 INFO:tasks.workunit.client.0.smithi050.stdout: Close 18112 0.150 46.326 2024-04-01T02:09:20.153 INFO:tasks.workunit.client.0.smithi050.stdout: Rename 1050 18.630 43.842 2024-04-01T02:09:20.153 INFO:tasks.workunit.client.0.smithi050.stdout: Unlink 4981 7.482 27.369 2024-04-01T02:09:20.153 INFO:tasks.workunit.client.0.smithi050.stdout: Qpathinfo 22343 4.085 46.100 2024-04-01T02:09:20.153 INFO:tasks.workunit.client.0.smithi050.stdout: Qfileinfo 3896 0.229 4.026 2024-04-01T02:09:20.153 INFO:tasks.workunit.client.0.smithi050.stdout: Qfsinfo 4110 0.867 5.527 2024-04-01T02:09:20.153 INFO:tasks.workunit.client.0.smithi050.stdout: Sfileinfo 2034 1.973 10.459 2024-04-01T02:09:20.153 INFO:tasks.workunit.client.0.smithi050.stdout: Find 8642 28.235 105.163 2024-04-01T02:09:20.153 INFO:tasks.workunit.client.0.smithi050.stdout: WriteX 12205 0.509 4.665 2024-04-01T02:09:20.154 INFO:tasks.workunit.client.0.smithi050.stdout: ReadX 38625 0.010 0.342 2024-04-01T02:09:20.154 INFO:tasks.workunit.client.0.smithi050.stdout: LockX 80 1.427 2.226 2024-04-01T02:09:20.154 INFO:tasks.workunit.client.0.smithi050.stdout: UnlockX 80 1.378 2.217 2024-04-01T02:09:20.154 INFO:tasks.workunit.client.0.smithi050.stdout: Flush 1744 6.286 14.766 2024-04-01T02:09:20.154 INFO:tasks.workunit.client.0.smithi050.stdout: 2024-04-01T02:09:20.154 INFO:tasks.workunit.client.0.smithi050.stdout:Throughput 1.28011 MB/sec 1 clients 1 procs max_latency=105.171 ms 2024-04-01T02:09:20.154 INFO:tasks.workunit.client.0.smithi050.stderr:+ dbench 10 2024-04-01T02:09:20.154 INFO:tasks.workunit.client.0.smithi050.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2024-04-01T02:09:20.155 INFO:tasks.workunit.client.0.smithi050.stdout: 2024-04-01T02:09:20.155 INFO:tasks.workunit.client.0.smithi050.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2024-04-01T02:09:20.155 INFO:tasks.workunit.client.0.smithi050.stdout:8 of 10 processes prepared for launch 0 sec 2024-04-01T02:09:20.255 INFO:tasks.workunit.client.0.smithi050.stdout:10 of 10 processes prepared for launch 0 sec 2024-04-01T02:09:20.255 INFO:tasks.workunit.client.0.smithi050.stdout:releasing clients 2024-04-01T02:09:21.255 INFO:tasks.workunit.client.0.smithi050.stdout: 10 268 100.80 MB/sec warmup 1 sec latency 33.713 ms 2024-04-01T02:09:22.255 INFO:tasks.workunit.client.0.smithi050.stdout: 10 535 92.53 MB/sec warmup 2 sec latency 62.588 ms 2024-04-01T02:09:23.255 INFO:tasks.workunit.client.0.smithi050.stdout: 10 755 71.17 MB/sec warmup 3 sec latency 90.888 ms 2024-04-01T02:09:24.255 INFO:tasks.workunit.client.0.smithi050.stdout: 10 901 54.26 MB/sec warmup 4 sec latency 117.794 ms 2024-04-01T02:09:24.941 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T02:09:24.943 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T02:09:25.255 INFO:tasks.workunit.client.0.smithi050.stdout: 10 1058 45.81 MB/sec warmup 5 sec latency 104.172 ms 2024-04-01T02:09:26.255 INFO:tasks.workunit.client.0.smithi050.stdout: 10 1189 38.39 MB/sec warmup 6 sec latency 97.013 ms 2024-04-01T02:09:27.255 INFO:tasks.workunit.client.0.smithi050.stdout: 10 1349 35.52 MB/sec warmup 7 sec latency 165.449 ms 2024-04-01T02:09:28.255 INFO:tasks.workunit.client.0.smithi050.stdout: 10 1489 32.57 MB/sec warmup 8 sec latency 155.739 ms 2024-04-01T02:09:29.255 INFO:tasks.workunit.client.0.smithi050.stdout: 10 1637 29.09 MB/sec warmup 9 sec latency 97.033 ms 2024-04-01T02:09:30.255 INFO:tasks.workunit.client.0.smithi050.stdout: 10 1806 26.32 MB/sec warmup 10 sec latency 136.564 ms 2024-04-01T02:09:31.256 INFO:tasks.workunit.client.0.smithi050.stdout: 10 1961 24.08 MB/sec warmup 11 sec latency 127.551 ms 2024-04-01T02:09:32.255 INFO:tasks.workunit.client.0.smithi050.stdout: 10 2118 22.23 MB/sec warmup 12 sec latency 99.590 ms 2024-04-01T02:09:33.255 INFO:tasks.workunit.client.0.smithi050.stdout: 10 2310 21.38 MB/sec warmup 13 sec latency 98.177 ms 2024-04-01T02:09:34.256 INFO:tasks.workunit.client.0.smithi050.stdout: 10 2396 19.99 MB/sec warmup 14 sec latency 113.422 ms 2024-04-01T02:09:35.255 INFO:tasks.workunit.client.0.smithi050.stdout: 10 2540 19.24 MB/sec warmup 15 sec latency 119.337 ms 2024-04-01T02:09:36.256 INFO:tasks.workunit.client.0.smithi050.stdout: 10 2797 20.03 MB/sec warmup 16 sec latency 83.180 ms 2024-04-01T02:09:37.255 INFO:tasks.workunit.client.0.smithi050.stdout: 10 3049 19.83 MB/sec warmup 17 sec latency 92.268 ms 2024-04-01T02:09:38.256 INFO:tasks.workunit.client.0.smithi050.stdout: 10 3283 19.64 MB/sec warmup 18 sec latency 138.278 ms 2024-04-01T02:09:39.256 INFO:tasks.workunit.client.0.smithi050.stdout: 10 3309 18.61 MB/sec warmup 19 sec latency 114.825 ms 2024-04-01T02:09:40.256 INFO:tasks.workunit.client.0.smithi050.stdout: 10 3332 17.69 MB/sec warmup 20 sec latency 84.675 ms 2024-04-01T02:09:41.256 INFO:tasks.workunit.client.0.smithi050.stdout: 10 3481 17.73 MB/sec warmup 21 sec latency 119.791 ms 2024-04-01T02:09:42.256 INFO:tasks.workunit.client.0.smithi050.stdout: 10 3681 17.60 MB/sec warmup 22 sec latency 117.264 ms 2024-04-01T02:09:43.256 INFO:tasks.workunit.client.0.smithi050.stdout: 10 3812 17.29 MB/sec warmup 23 sec latency 109.589 ms 2024-04-01T02:09:44.256 INFO:tasks.workunit.client.0.smithi050.stdout: 10 3898 16.64 MB/sec warmup 24 sec latency 113.040 ms 2024-04-01T02:09:45.256 INFO:tasks.workunit.client.0.smithi050.stdout: 10 3984 16.03 MB/sec warmup 25 sec latency 107.170 ms 2024-04-01T02:09:46.256 INFO:tasks.workunit.client.0.smithi050.stdout: 10 4072 15.42 MB/sec warmup 26 sec latency 121.388 ms 2024-04-01T02:09:47.256 INFO:tasks.workunit.client.0.smithi050.stdout: 10 4166 14.85 MB/sec warmup 27 sec latency 220.109 ms 2024-04-01T02:09:48.256 INFO:tasks.workunit.client.0.smithi050.stdout: 10 4290 14.42 MB/sec warmup 28 sec latency 166.802 ms 2024-04-01T02:09:49.256 INFO:tasks.workunit.client.0.smithi050.stdout: 10 4425 14.03 MB/sec warmup 29 sec latency 116.724 ms 2024-04-01T02:09:50.256 INFO:tasks.workunit.client.0.smithi050.stdout: 10 4535 13.69 MB/sec warmup 30 sec latency 231.628 ms 2024-04-01T02:09:51.256 INFO:tasks.workunit.client.0.smithi050.stdout: 10 4684 13.58 MB/sec warmup 31 sec latency 105.090 ms 2024-04-01T02:09:52.256 INFO:tasks.workunit.client.0.smithi050.stdout: 10 4815 13.28 MB/sec warmup 32 sec latency 111.230 ms 2024-04-01T02:09:53.256 INFO:tasks.workunit.client.0.smithi050.stdout: 10 5005 13.68 MB/sec warmup 33 sec latency 116.507 ms 2024-04-01T02:09:54.256 INFO:tasks.workunit.client.0.smithi050.stdout: 10 5147 13.31 MB/sec warmup 34 sec latency 101.341 ms 2024-04-01T02:09:55.097 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T02:09:55.099 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T02:09:55.256 INFO:tasks.workunit.client.0.smithi050.stdout: 10 5280 12.96 MB/sec warmup 35 sec latency 169.250 ms 2024-04-01T02:09:56.256 INFO:tasks.workunit.client.0.smithi050.stdout: 10 5446 12.64 MB/sec warmup 36 sec latency 106.918 ms 2024-04-01T02:09:57.256 INFO:tasks.workunit.client.0.smithi050.stdout: 10 5607 12.35 MB/sec warmup 37 sec latency 114.738 ms 2024-04-01T02:09:58.256 INFO:tasks.workunit.client.0.smithi050.stdout: 10 5771 12.15 MB/sec warmup 38 sec latency 102.759 ms 2024-04-01T02:09:59.256 INFO:tasks.workunit.client.0.smithi050.stdout: 10 5923 12.06 MB/sec warmup 39 sec latency 95.242 ms 2024-04-01T02:10:00.256 INFO:tasks.workunit.client.0.smithi050.stdout: 10 6036 11.87 MB/sec warmup 40 sec latency 111.387 ms 2024-04-01T02:10:01.256 INFO:tasks.workunit.client.0.smithi050.stdout: 10 6202 11.95 MB/sec warmup 41 sec latency 104.920 ms 2024-04-01T02:10:02.256 INFO:tasks.workunit.client.0.smithi050.stdout: 10 6408 12.28 MB/sec warmup 42 sec latency 100.612 ms 2024-04-01T02:10:03.256 INFO:tasks.workunit.client.0.smithi050.stdout: 10 6658 12.38 MB/sec warmup 43 sec latency 107.036 ms 2024-04-01T02:10:04.256 INFO:tasks.workunit.client.0.smithi050.stdout: 10 6841 12.38 MB/sec warmup 44 sec latency 160.874 ms 2024-04-01T02:10:05.256 INFO:tasks.workunit.client.0.smithi050.stdout: 10 6866 12.11 MB/sec warmup 45 sec latency 143.714 ms 2024-04-01T02:10:06.256 INFO:tasks.workunit.client.0.smithi050.stdout: 10 6909 11.91 MB/sec warmup 46 sec latency 157.335 ms 2024-04-01T02:10:07.256 INFO:tasks.workunit.client.0.smithi050.stdout: 10 7028 11.88 MB/sec warmup 47 sec latency 129.117 ms 2024-04-01T02:10:08.256 INFO:tasks.workunit.client.0.smithi050.stdout: 10 7211 12.08 MB/sec warmup 48 sec latency 110.627 ms 2024-04-01T02:10:09.256 INFO:tasks.workunit.client.0.smithi050.stdout: 10 7356 12.02 MB/sec warmup 49 sec latency 124.958 ms 2024-04-01T02:10:10.256 INFO:tasks.workunit.client.0.smithi050.stdout: 10 7434 11.80 MB/sec warmup 50 sec latency 130.896 ms 2024-04-01T02:10:11.256 INFO:tasks.workunit.client.0.smithi050.stdout: 10 7515 11.61 MB/sec warmup 51 sec latency 130.053 ms 2024-04-01T02:10:12.256 INFO:tasks.workunit.client.0.smithi050.stdout: 10 7600 11.38 MB/sec warmup 52 sec latency 171.921 ms 2024-04-01T02:10:13.256 INFO:tasks.workunit.client.0.smithi050.stdout: 10 7702 11.19 MB/sec warmup 53 sec latency 180.223 ms 2024-04-01T02:10:14.256 INFO:tasks.workunit.client.0.smithi050.stdout: 10 7824 11.01 MB/sec warmup 54 sec latency 195.154 ms 2024-04-01T02:10:15.256 INFO:tasks.workunit.client.0.smithi050.stdout: 10 7961 10.87 MB/sec warmup 55 sec latency 128.022 ms 2024-04-01T02:10:16.256 INFO:tasks.workunit.client.0.smithi050.stdout: 10 8098 10.80 MB/sec warmup 56 sec latency 121.092 ms 2024-04-01T02:10:17.256 INFO:tasks.workunit.client.0.smithi050.stdout: 10 8235 10.74 MB/sec warmup 57 sec latency 100.701 ms 2024-04-01T02:10:18.256 INFO:tasks.workunit.client.0.smithi050.stdout: 10 8397 10.77 MB/sec warmup 58 sec latency 147.935 ms 2024-04-01T02:10:19.256 INFO:tasks.workunit.client.0.smithi050.stdout: 10 8567 10.90 MB/sec warmup 59 sec latency 107.252 ms 2024-04-01T02:10:20.256 INFO:tasks.workunit.client.0.smithi050.stdout: 10 8722 10.73 MB/sec warmup 60 sec latency 97.221 ms 2024-04-01T02:10:21.256 INFO:tasks.workunit.client.0.smithi050.stdout: 10 8877 10.58 MB/sec warmup 61 sec latency 101.604 ms 2024-04-01T02:10:22.256 INFO:tasks.workunit.client.0.smithi050.stdout: 10 9054 10.44 MB/sec warmup 62 sec latency 105.326 ms 2024-04-01T02:10:23.257 INFO:tasks.workunit.client.0.smithi050.stdout: 10 9237 10.32 MB/sec warmup 63 sec latency 90.271 ms 2024-04-01T02:10:24.256 INFO:tasks.workunit.client.0.smithi050.stdout: 10 9374 10.23 MB/sec warmup 64 sec latency 113.846 ms 2024-04-01T02:10:25.161 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T02:10:25.164 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T02:10:25.188 INFO:tasks.ceph.mds.b.smithi097.stderr:2024-04-01T02:10:25.189+0000 7fcfc7277640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 31638) UID: 0 2024-04-01T02:10:25.189 INFO:tasks.ceph.mds.f.smithi097.stderr:2024-04-01T02:10:25.189+0000 7f80626b5640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 31638) UID: 0 2024-04-01T02:10:25.189 INFO:tasks.ceph.mds.d.smithi097.stderr:2024-04-01T02:10:25.189+0000 7f45d6d13640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 31638) UID: 0 2024-04-01T02:10:25.256 INFO:tasks.workunit.client.0.smithi050.stdout: 10 9522 10.23 MB/sec warmup 65 sec latency 106.955 ms 2024-04-01T02:10:26.256 INFO:tasks.workunit.client.0.smithi050.stdout: 10 9641 10.17 MB/sec warmup 66 sec latency 97.541 ms 2024-04-01T02:10:27.256 INFO:tasks.workunit.client.0.smithi050.stdout: 10 9849 10.31 MB/sec warmup 67 sec latency 88.478 ms 2024-04-01T02:10:28.256 INFO:tasks.workunit.client.0.smithi050.stdout: 10 10142 10.57 MB/sec warmup 68 sec latency 101.803 ms 2024-04-01T02:10:29.256 INFO:tasks.workunit.client.0.smithi050.stdout: 10 10263 10.53 MB/sec warmup 69 sec latency 148.960 ms 2024-04-01T02:10:30.257 INFO:tasks.workunit.client.0.smithi050.stdout: 10 10396 10.51 MB/sec warmup 70 sec latency 209.482 ms 2024-04-01T02:10:31.257 INFO:tasks.workunit.client.0.smithi050.stdout: 10 10425 10.37 MB/sec warmup 71 sec latency 82.243 ms 2024-04-01T02:10:32.257 INFO:tasks.workunit.client.0.smithi050.stdout: 10 10523 10.40 MB/sec warmup 72 sec latency 110.689 ms 2024-04-01T02:10:33.257 INFO:tasks.workunit.client.0.smithi050.stdout: 10 10657 10.40 MB/sec warmup 73 sec latency 105.866 ms 2024-04-01T02:10:34.257 INFO:tasks.workunit.client.0.smithi050.stdout: 10 10805 10.45 MB/sec warmup 74 sec latency 159.586 ms 2024-04-01T02:10:35.257 INFO:tasks.workunit.client.0.smithi050.stdout: 10 10930 10.42 MB/sec warmup 75 sec latency 134.406 ms 2024-04-01T02:10:36.257 INFO:tasks.workunit.client.0.smithi050.stdout: 10 11010 10.28 MB/sec warmup 76 sec latency 138.720 ms 2024-04-01T02:10:37.257 INFO:tasks.workunit.client.0.smithi050.stdout: 10 11097 10.17 MB/sec warmup 77 sec latency 122.404 ms 2024-04-01T02:10:38.257 INFO:tasks.workunit.client.0.smithi050.stdout: 10 11188 10.04 MB/sec warmup 78 sec latency 153.814 ms 2024-04-01T02:10:39.257 INFO:tasks.workunit.client.0.smithi050.stdout: 10 11319 9.94 MB/sec warmup 79 sec latency 137.713 ms 2024-04-01T02:10:40.257 INFO:tasks.workunit.client.0.smithi050.stdout: 10 11414 9.84 MB/sec warmup 80 sec latency 167.093 ms 2024-04-01T02:10:41.257 INFO:tasks.workunit.client.0.smithi050.stdout: 10 11563 9.77 MB/sec warmup 81 sec latency 168.575 ms 2024-04-01T02:10:42.257 INFO:tasks.workunit.client.0.smithi050.stdout: 10 11695 9.71 MB/sec warmup 82 sec latency 109.031 ms 2024-04-01T02:10:43.257 INFO:tasks.workunit.client.0.smithi050.stdout: 10 11842 9.72 MB/sec warmup 83 sec latency 111.291 ms 2024-04-01T02:10:44.257 INFO:tasks.workunit.client.0.smithi050.stdout: 10 12000 9.72 MB/sec warmup 84 sec latency 99.864 ms 2024-04-01T02:10:45.257 INFO:tasks.workunit.client.0.smithi050.stdout: 10 12157 9.82 MB/sec warmup 85 sec latency 126.498 ms 2024-04-01T02:10:46.257 INFO:tasks.workunit.client.0.smithi050.stdout: 10 12295 9.71 MB/sec warmup 86 sec latency 210.925 ms 2024-04-01T02:10:47.257 INFO:tasks.workunit.client.0.smithi050.stdout: 10 12439 9.62 MB/sec warmup 87 sec latency 99.749 ms 2024-04-01T02:10:48.257 INFO:tasks.workunit.client.0.smithi050.stdout: 10 12617 9.53 MB/sec warmup 88 sec latency 106.419 ms 2024-04-01T02:10:49.257 INFO:tasks.workunit.client.0.smithi050.stdout: 10 12792 9.46 MB/sec warmup 89 sec latency 97.049 ms 2024-04-01T02:10:50.257 INFO:tasks.workunit.client.0.smithi050.stdout: 10 12939 9.42 MB/sec warmup 90 sec latency 97.598 ms 2024-04-01T02:10:51.257 INFO:tasks.workunit.client.0.smithi050.stdout: 10 13069 9.41 MB/sec warmup 91 sec latency 122.818 ms 2024-04-01T02:10:52.257 INFO:tasks.workunit.client.0.smithi050.stdout: 10 13200 9.38 MB/sec warmup 92 sec latency 93.148 ms 2024-04-01T02:10:53.257 INFO:tasks.workunit.client.0.smithi050.stdout: 10 13401 9.48 MB/sec warmup 93 sec latency 98.346 ms 2024-04-01T02:10:54.257 INFO:tasks.workunit.client.0.smithi050.stdout: 10 13650 9.65 MB/sec warmup 94 sec latency 100.370 ms 2024-04-01T02:10:55.257 INFO:tasks.workunit.client.0.smithi050.stdout: 10 13824 9.67 MB/sec warmup 95 sec latency 133.773 ms 2024-04-01T02:10:56.257 INFO:tasks.workunit.client.0.smithi050.stdout: 10 13949 9.66 MB/sec warmup 96 sec latency 162.533 ms 2024-04-01T02:10:57.258 INFO:tasks.workunit.client.0.smithi050.stdout: 10 13986 9.59 MB/sec warmup 97 sec latency 90.309 ms 2024-04-01T02:10:58.257 INFO:tasks.workunit.client.0.smithi050.stdout: 10 14067 9.59 MB/sec warmup 98 sec latency 106.618 ms 2024-04-01T02:10:59.257 INFO:tasks.workunit.client.0.smithi050.stdout: 10 14169 9.55 MB/sec warmup 99 sec latency 108.920 ms 2024-04-01T02:11:00.257 INFO:tasks.workunit.client.0.smithi050.stdout: 10 14338 9.64 MB/sec warmup 100 sec latency 121.955 ms 2024-04-01T02:11:01.258 INFO:tasks.workunit.client.0.smithi050.stdout: 10 14462 9.61 MB/sec warmup 101 sec latency 147.353 ms 2024-04-01T02:11:02.258 INFO:tasks.workunit.client.0.smithi050.stdout: 10 14559 9.53 MB/sec warmup 102 sec latency 112.724 ms 2024-04-01T02:11:03.258 INFO:tasks.workunit.client.0.smithi050.stdout: 10 14650 9.46 MB/sec warmup 103 sec latency 130.589 ms 2024-04-01T02:11:04.258 INFO:tasks.workunit.client.0.smithi050.stdout: 10 14736 9.37 MB/sec warmup 104 sec latency 173.810 ms 2024-04-01T02:11:05.258 INFO:tasks.workunit.client.0.smithi050.stdout: 10 14850 9.30 MB/sec warmup 105 sec latency 157.190 ms 2024-04-01T02:11:06.259 INFO:tasks.workunit.client.0.smithi050.stdout: 10 14975 9.24 MB/sec warmup 106 sec latency 137.051 ms 2024-04-01T02:11:07.258 INFO:tasks.workunit.client.0.smithi050.stdout: 10 15124 9.20 MB/sec warmup 107 sec latency 117.254 ms 2024-04-01T02:11:08.258 INFO:tasks.workunit.client.0.smithi050.stdout: 10 15257 9.15 MB/sec warmup 108 sec latency 114.350 ms 2024-04-01T02:11:09.258 INFO:tasks.workunit.client.0.smithi050.stdout: 10 15404 9.16 MB/sec warmup 109 sec latency 99.442 ms 2024-04-01T02:11:10.258 INFO:tasks.workunit.client.0.smithi050.stdout: 10 15551 9.16 MB/sec warmup 110 sec latency 122.493 ms 2024-04-01T02:11:11.258 INFO:tasks.workunit.client.0.smithi050.stdout: 10 15732 9.24 MB/sec warmup 111 sec latency 115.298 ms 2024-04-01T02:11:12.258 INFO:tasks.workunit.client.0.smithi050.stdout: 10 15890 9.17 MB/sec warmup 112 sec latency 117.815 ms 2024-04-01T02:11:13.258 INFO:tasks.workunit.client.0.smithi050.stdout: 10 16032 9.10 MB/sec warmup 113 sec latency 99.135 ms 2024-04-01T02:11:14.258 INFO:tasks.workunit.client.0.smithi050.stdout: 10 16196 9.04 MB/sec warmup 114 sec latency 93.074 ms 2024-04-01T02:11:15.258 INFO:tasks.workunit.client.0.smithi050.stdout: 10 16364 9.00 MB/sec warmup 115 sec latency 92.833 ms 2024-04-01T02:11:16.258 INFO:tasks.workunit.client.0.smithi050.stdout: 10 16517 8.97 MB/sec warmup 116 sec latency 118.951 ms 2024-04-01T02:11:17.258 INFO:tasks.workunit.client.0.smithi050.stdout: 10 16652 8.98 MB/sec warmup 117 sec latency 105.133 ms 2024-04-01T02:11:18.258 INFO:tasks.workunit.client.0.smithi050.stdout: 10 16793 9.01 MB/sec warmup 118 sec latency 108.165 ms 2024-04-01T02:11:19.258 INFO:tasks.workunit.client.0.smithi050.stdout: 10 16972 9.03 MB/sec warmup 119 sec latency 118.546 ms 2024-04-01T02:11:21.259 INFO:tasks.workunit.client.0.smithi050.stdout: 10 17385 6.73 MB/sec execute 1 sec latency 144.487 ms 2024-04-01T02:11:22.259 INFO:tasks.workunit.client.0.smithi050.stdout: 10 17498 7.60 MB/sec execute 2 sec latency 92.499 ms 2024-04-01T02:11:23.259 INFO:tasks.workunit.client.0.smithi050.stdout: 10 17543 6.16 MB/sec execute 3 sec latency 92.588 ms 2024-04-01T02:11:24.259 INFO:tasks.workunit.client.0.smithi050.stdout: 10 17645 7.28 MB/sec execute 4 sec latency 127.842 ms 2024-04-01T02:11:25.259 INFO:tasks.workunit.client.0.smithi050.stdout: 10 17807 9.42 MB/sec execute 5 sec latency 130.270 ms 2024-04-01T02:11:26.259 INFO:tasks.workunit.client.0.smithi050.stdout: 10 17932 8.83 MB/sec execute 6 sec latency 151.093 ms 2024-04-01T02:11:27.259 INFO:tasks.workunit.client.0.smithi050.stdout: 10 18048 8.64 MB/sec execute 7 sec latency 141.935 ms 2024-04-01T02:11:28.259 INFO:tasks.workunit.client.0.smithi050.stdout: 10 18139 7.67 MB/sec execute 8 sec latency 127.995 ms 2024-04-01T02:11:29.259 INFO:tasks.workunit.client.0.smithi050.stdout: 10 18220 6.95 MB/sec execute 9 sec latency 139.398 ms 2024-04-01T02:11:30.259 INFO:tasks.workunit.client.0.smithi050.stdout: 10 18305 6.31 MB/sec execute 10 sec latency 140.764 ms 2024-04-01T02:11:31.259 INFO:tasks.workunit.client.0.smithi050.stdout: 10 18406 5.86 MB/sec execute 11 sec latency 191.106 ms 2024-04-01T02:11:32.259 INFO:tasks.workunit.client.0.smithi050.stdout: 10 18543 5.66 MB/sec execute 12 sec latency 161.371 ms 2024-04-01T02:11:33.259 INFO:tasks.workunit.client.0.smithi050.stdout: 10 18676 5.59 MB/sec execute 13 sec latency 113.293 ms 2024-04-01T02:11:34.259 INFO:tasks.workunit.client.0.smithi050.stdout: 10 18813 5.64 MB/sec execute 14 sec latency 101.689 ms 2024-04-01T02:11:35.259 INFO:tasks.workunit.client.0.smithi050.stdout: 10 18974 6.12 MB/sec execute 15 sec latency 104.279 ms 2024-04-01T02:11:36.259 INFO:tasks.workunit.client.0.smithi050.stdout: 10 19124 6.00 MB/sec execute 16 sec latency 120.669 ms 2024-04-01T02:11:37.259 INFO:tasks.workunit.client.0.smithi050.stdout: 10 19305 6.70 MB/sec execute 17 sec latency 97.055 ms 2024-04-01T02:11:38.259 INFO:tasks.workunit.client.0.smithi050.stdout: 10 19467 6.41 MB/sec execute 18 sec latency 96.389 ms 2024-04-01T02:11:39.260 INFO:tasks.workunit.client.0.smithi050.stdout: 10 19654 6.17 MB/sec execute 19 sec latency 91.715 ms 2024-04-01T02:11:40.259 INFO:tasks.workunit.client.0.smithi050.stdout: 10 19806 5.99 MB/sec execute 20 sec latency 84.306 ms 2024-04-01T02:11:41.260 INFO:tasks.workunit.client.0.smithi050.stdout: 10 19967 5.93 MB/sec execute 21 sec latency 92.527 ms 2024-04-01T02:11:42.260 INFO:tasks.workunit.client.0.smithi050.stdout: 10 20145 5.94 MB/sec execute 22 sec latency 99.052 ms 2024-04-01T02:11:43.260 INFO:tasks.workunit.client.0.smithi050.stdout: 10 20264 6.08 MB/sec execute 23 sec latency 101.233 ms 2024-04-01T02:11:44.260 INFO:tasks.workunit.client.0.smithi050.stdout: 10 20412 6.47 MB/sec execute 24 sec latency 137.546 ms 2024-04-01T02:11:45.260 INFO:tasks.workunit.client.0.smithi050.stdout: 10 20588 6.66 MB/sec execute 25 sec latency 118.385 ms 2024-04-01T02:11:46.260 INFO:tasks.workunit.client.0.smithi050.stdout: 10 20838 7.35 MB/sec execute 26 sec latency 117.070 ms 2024-04-01T02:11:47.260 INFO:tasks.workunit.client.0.smithi050.stdout: 10 20977 7.39 MB/sec execute 27 sec latency 126.893 ms 2024-04-01T02:11:48.260 INFO:tasks.workunit.client.0.smithi050.stdout: 10 21081 7.39 MB/sec execute 28 sec latency 189.189 ms 2024-04-01T02:11:49.260 INFO:tasks.workunit.client.0.smithi050.stdout: 10 21127 7.25 MB/sec execute 29 sec latency 109.519 ms 2024-04-01T02:11:50.260 INFO:tasks.workunit.client.0.smithi050.stdout: 10 21230 7.36 MB/sec execute 30 sec latency 114.361 ms 2024-04-01T02:11:51.260 INFO:tasks.workunit.client.0.smithi050.stdout: 10 21375 7.55 MB/sec execute 31 sec latency 114.026 ms 2024-04-01T02:11:52.260 INFO:tasks.workunit.client.0.smithi050.stdout: 10 21540 7.69 MB/sec execute 32 sec latency 87.427 ms 2024-04-01T02:11:53.260 INFO:tasks.workunit.client.0.smithi050.stdout: 10 21656 7.64 MB/sec execute 33 sec latency 118.916 ms 2024-04-01T02:11:54.260 INFO:tasks.workunit.client.0.smithi050.stdout: 10 21753 7.47 MB/sec execute 34 sec latency 90.548 ms 2024-04-01T02:11:55.260 INFO:tasks.workunit.client.0.smithi050.stdout: 10 21850 7.27 MB/sec execute 35 sec latency 160.244 ms 2024-04-01T02:11:56.260 INFO:tasks.workunit.client.0.smithi050.stdout: 10 21950 7.10 MB/sec execute 36 sec latency 108.796 ms 2024-04-01T02:11:57.260 INFO:tasks.workunit.client.0.smithi050.stdout: 10 22058 6.95 MB/sec execute 37 sec latency 136.633 ms 2024-04-01T02:11:58.260 INFO:tasks.workunit.client.0.smithi050.stdout: 10 22190 6.87 MB/sec execute 38 sec latency 133.748 ms 2024-04-01T02:11:59.260 INFO:tasks.workunit.client.0.smithi050.stdout: 10 22340 6.84 MB/sec execute 39 sec latency 128.679 ms 2024-04-01T02:12:00.260 INFO:tasks.workunit.client.0.smithi050.stdout: 10 22486 6.93 MB/sec execute 40 sec latency 109.915 ms 2024-04-01T02:12:01.261 INFO:tasks.workunit.client.0.smithi050.stdout: 10 22640 7.00 MB/sec execute 41 sec latency 94.792 ms 2024-04-01T02:12:02.261 INFO:tasks.workunit.client.0.smithi050.stdout: 10 22826 7.27 MB/sec execute 42 sec latency 97.555 ms 2024-04-01T02:12:03.261 INFO:tasks.workunit.client.0.smithi050.stdout: 10 22984 7.13 MB/sec execute 43 sec latency 99.842 ms 2024-04-01T02:12:04.261 INFO:tasks.workunit.client.0.smithi050.stdout: 10 23132 7.00 MB/sec execute 44 sec latency 121.747 ms 2024-04-01T02:12:05.261 INFO:tasks.workunit.client.0.smithi050.stdout: 10 23300 6.90 MB/sec execute 45 sec latency 108.475 ms 2024-04-01T02:12:06.261 INFO:tasks.workunit.client.0.smithi050.stdout: 10 23466 6.81 MB/sec execute 46 sec latency 85.536 ms 2024-04-01T02:12:07.261 INFO:tasks.workunit.client.0.smithi050.stdout: 10 23629 6.80 MB/sec execute 47 sec latency 84.362 ms 2024-04-01T02:12:08.261 INFO:tasks.workunit.client.0.smithi050.stdout: 10 23775 6.88 MB/sec execute 48 sec latency 102.002 ms 2024-04-01T02:12:09.261 INFO:tasks.workunit.client.0.smithi050.stdout: 10 23924 6.93 MB/sec execute 49 sec latency 119.467 ms 2024-04-01T02:12:10.261 INFO:tasks.workunit.client.0.smithi050.stdout: 10 24138 7.21 MB/sec execute 50 sec latency 94.649 ms 2024-04-01T02:12:11.261 INFO:tasks.workunit.client.0.smithi050.stdout: 10 24353 7.46 MB/sec execute 51 sec latency 192.786 ms 2024-04-01T02:12:12.261 INFO:tasks.workunit.client.0.smithi050.stdout: 10 24540 7.54 MB/sec execute 52 sec latency 98.303 ms 2024-04-01T02:12:13.261 INFO:tasks.workunit.client.0.smithi050.stdout: 10 24636 7.52 MB/sec execute 53 sec latency 96.640 ms 2024-04-01T02:12:14.261 INFO:tasks.workunit.client.0.smithi050.stdout: 10 24681 7.44 MB/sec execute 54 sec latency 129.295 ms 2024-04-01T02:12:15.261 INFO:tasks.workunit.client.0.smithi050.stdout: 10 24770 7.49 MB/sec execute 55 sec latency 124.459 ms 2024-04-01T02:12:16.261 INFO:tasks.workunit.client.0.smithi050.stdout: 10 24889 7.51 MB/sec execute 56 sec latency 122.475 ms 2024-04-01T02:12:17.261 INFO:tasks.workunit.client.0.smithi050.stdout: 10 25042 7.64 MB/sec execute 57 sec latency 136.898 ms 2024-04-01T02:12:18.261 INFO:tasks.workunit.client.0.smithi050.stdout: 10 25172 7.65 MB/sec execute 58 sec latency 105.520 ms 2024-04-01T02:12:19.263 INFO:tasks.workunit.client.0.smithi050.stdout: 10 25257 7.53 MB/sec execute 59 sec latency 117.539 ms 2024-04-01T02:12:20.262 INFO:tasks.workunit.client.0.smithi050.stdout: 10 25338 7.43 MB/sec execute 60 sec latency 119.134 ms 2024-04-01T02:12:21.262 INFO:tasks.workunit.client.0.smithi050.stdout: 10 25422 7.31 MB/sec execute 61 sec latency 157.894 ms 2024-04-01T02:12:22.262 INFO:tasks.workunit.client.0.smithi050.stdout: 10 25525 7.22 MB/sec execute 62 sec latency 124.028 ms 2024-04-01T02:12:23.262 INFO:tasks.workunit.client.0.smithi050.stdout: 10 25651 7.15 MB/sec execute 63 sec latency 129.322 ms 2024-04-01T02:12:24.262 INFO:tasks.workunit.client.0.smithi050.stdout: 10 25787 7.10 MB/sec execute 64 sec latency 111.374 ms 2024-04-01T02:12:25.262 INFO:tasks.workunit.client.0.smithi050.stdout: 10 25935 7.12 MB/sec execute 65 sec latency 104.100 ms 2024-04-01T02:12:26.262 INFO:tasks.workunit.client.0.smithi050.stdout: 10 26082 7.15 MB/sec execute 66 sec latency 102.578 ms 2024-04-01T02:12:27.262 INFO:tasks.workunit.client.0.smithi050.stdout: 10 26224 7.14 MB/sec execute 67 sec latency 114.463 ms 2024-04-01T02:12:28.263 INFO:tasks.workunit.client.0.smithi050.stdout: 10 26402 7.31 MB/sec execute 68 sec latency 103.972 ms 2024-04-01T02:12:29.262 INFO:tasks.workunit.client.0.smithi050.stdout: 10 26566 7.22 MB/sec execute 69 sec latency 101.977 ms 2024-04-01T02:12:30.262 INFO:tasks.workunit.client.0.smithi050.stdout: 10 26714 7.14 MB/sec execute 70 sec latency 96.502 ms 2024-04-01T02:12:31.262 INFO:tasks.workunit.client.0.smithi050.stdout: 10 26873 7.07 MB/sec execute 71 sec latency 121.957 ms 2024-04-01T02:12:32.262 INFO:tasks.workunit.client.0.smithi050.stdout: 10 27038 7.04 MB/sec execute 72 sec latency 108.522 ms 2024-04-01T02:12:33.262 INFO:tasks.workunit.client.0.smithi050.stdout: 10 27180 7.00 MB/sec execute 73 sec latency 112.307 ms 2024-04-01T02:12:34.262 INFO:tasks.workunit.client.0.smithi050.stdout: 10 27336 7.05 MB/sec execute 74 sec latency 93.127 ms 2024-04-01T02:12:34.509 INFO:tasks.workunit.client.0.smithi050.stdout:[27220] write failed on handle 11458 (Bad file descriptor) 2024-04-01T02:12:34.509 INFO:tasks.workunit.client.0.smithi050.stdout:Child failed with status 1 2024-04-01T02:12:34.509 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-01T02:12:34.526 INFO:tasks.workunit:Stopping ['suites/dbench.sh'] on client.0... 2024-04-01T02:12:34.526 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-04-01T02:12:34.815 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph_384f31f3d3aee7f8ba3f60846b8844c049165583/qa/tasks/workunit.py", line 145, in task _spawn_on_all_clients(ctx, refspec, all_tasks, config.get('env'), File "/home/teuthworker/src/git.ceph.com_ceph_384f31f3d3aee7f8ba3f60846b8844c049165583/qa/tasks/workunit.py", line 295, in _spawn_on_all_clients p.spawn(_run_tests, ctx, refspec, role, [unit], env, File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph_384f31f3d3aee7f8ba3f60846b8844c049165583/qa/tasks/workunit.py", line 434, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test suites/dbench.sh) on smithi050 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=384f31f3d3aee7f8ba3f60846b8844c049165583 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/dbench.sh' 2024-04-01T02:12:35.062 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=f9034f4d019941c28997e75049ecefb9 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph_384f31f3d3aee7f8ba3f60846b8844c049165583/qa/tasks/workunit.py", line 145, in task _spawn_on_all_clients(ctx, refspec, all_tasks, config.get('env'), File "/home/teuthworker/src/git.ceph.com_ceph_384f31f3d3aee7f8ba3f60846b8844c049165583/qa/tasks/workunit.py", line 295, in _spawn_on_all_clients p.spawn(_run_tests, ctx, refspec, role, [unit], env, File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph_384f31f3d3aee7f8ba3f60846b8844c049165583/qa/tasks/workunit.py", line 434, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test suites/dbench.sh) on smithi050 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=384f31f3d3aee7f8ba3f60846b8844c049165583 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/dbench.sh' 2024-04-01T02:12:35.065 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-04-01T02:12:35.081 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-04-01T02:12:35.081 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-04-01T02:12:35.081 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-01T02:12:35.098 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-04-01T02:12:35.098 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-01T02:12:35.149 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-01T02:12:35.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.326+0000 7fabba417640 1 Processor -- start 2024-04-01T02:12:35.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.326+0000 7fabba417640 1 -- start start 2024-04-01T02:12:35.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.326+0000 7fabba417640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fabb40c2900 0x7fabb40c5f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:35.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.326+0000 7fabba417640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fabb40c30d0 con 0x7fabb4151de0 2024-04-01T02:12:35.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.326+0000 7fabba417640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fabb415b370 con 0x7fabb40c7850 2024-04-01T02:12:35.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.326+0000 7fabba417640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fabb415c0f0 con 0x7fabb40c2900 2024-04-01T02:12:35.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.326+0000 7fabb37fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fabb40c2900 0x7fabb40c5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:35.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.326+0000 7fabb3fff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fabb4151de0 0x7fabb4157be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:51650/0 (socket says 172.21.15.50:51650) 2024-04-01T02:12:35.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.326+0000 7fabb3fff640 1 -- 172.21.15.50:0/3053096086 learned_addr learned my addr 172.21.15.50:0/3053096086 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-04-01T02:12:35.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.326+0000 7fabb37fe640 1 -- 172.21.15.50:0/3053096086 >> v1:172.21.15.97:6789/0 conn(0x7fabb40c7850 legacy=0x7fabb4162560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:35.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.326+0000 7fabb37fe640 1 -- 172.21.15.50:0/3053096086 >> v1:172.21.15.50:6789/0 conn(0x7fabb4151de0 legacy=0x7fabb4157be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:35.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.326+0000 7fabb2ffd640 1 -- 172.21.15.50:0/3053096086 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2991611422 0 0) 0x7fabb40c30d0 con 0x7fabb4151de0 2024-04-01T02:12:35.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.326+0000 7fabb37fe640 1 -- 172.21.15.50:0/3053096086 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabb40c2df0 con 0x7fabb40c2900 2024-04-01T02:12:35.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.330+0000 7fabb37fe640 1 --2- 172.21.15.50:0/3053096086 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fabb40c2900 0x7fabb40c5f20 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7faba80097c0 tx=0x7faba801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e42ba1f448900d5 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:12:35.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.330+0000 7fabb2ffd640 1 -- 172.21.15.50:0/3053096086 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faba80b0070 con 0x7fabb40c2900 2024-04-01T02:12:35.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.330+0000 7fabb2ffd640 1 -- 172.21.15.50:0/3053096086 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faba80ab600 con 0x7fabb40c2900 2024-04-01T02:12:35.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.330+0000 7fabb2ffd640 1 -- 172.21.15.50:0/3053096086 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faba80ab9d0 con 0x7fabb40c2900 2024-04-01T02:12:35.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.330+0000 7fabba417640 1 -- 172.21.15.50:0/3053096086 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fabb40c2900 msgr2=0x7fabb40c5f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:35.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.330+0000 7fabba417640 1 --2- 172.21.15.50:0/3053096086 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fabb40c2900 0x7fabb40c5f20 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7faba80097c0 tx=0x7faba801c4a0 comp rx=0 tx=0).stop 2024-04-01T02:12:35.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.330+0000 7fabba417640 1 -- 172.21.15.50:0/3053096086 shutdown_connections 2024-04-01T02:12:35.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.330+0000 7fabba417640 1 --2- 172.21.15.50:0/3053096086 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fabb40c2900 0x7fabb40c5f20 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:35.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.330+0000 7fabba417640 1 -- 172.21.15.50:0/3053096086 >> 172.21.15.50:0/3053096086 conn(0x7fabb4067560 msgr2=0x7fabb406b220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T02:12:35.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.330+0000 7fabba417640 1 -- 172.21.15.50:0/3053096086 shutdown_connections 2024-04-01T02:12:35.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.330+0000 7fabba417640 1 -- 172.21.15.50:0/3053096086 wait complete. 2024-04-01T02:12:35.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.330+0000 7fabba417640 1 Processor -- start 2024-04-01T02:12:35.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.330+0000 7fabba417640 1 -- start start 2024-04-01T02:12:35.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.330+0000 7fabba417640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fabb40c2900 0x7fabb4147eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:35.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.330+0000 7fabba417640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fabb40c7850 0x7fabb415a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:35.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.330+0000 7fabba417640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fabb4151de0 0x7fabb413f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:35.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.330+0000 7fabba417640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fabb40c88a0 con 0x7fabb40c2900 2024-04-01T02:12:35.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.330+0000 7fabba417640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fabb41582f0 con 0x7fabb4151de0 2024-04-01T02:12:35.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.330+0000 7fabba417640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fabb40c8a20 con 0x7fabb40c7850 2024-04-01T02:12:35.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.330+0000 7fabb3fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fabb40c2900 0x7fabb4147eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:35.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.330+0000 7fabb3fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fabb40c2900 0x7fabb4147eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34454/0 (socket says 172.21.15.50:34454) 2024-04-01T02:12:35.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.330+0000 7fabb3fff640 1 -- 172.21.15.50:0/3194615810 learned_addr learned my addr 172.21.15.50:0/3194615810 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T02:12:35.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.330+0000 7fabb37fe640 1 --2- 172.21.15.50:0/3194615810 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fabb40c7850 0x7fabb415a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:35.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.330+0000 7fabb89b4640 1 --2- 172.21.15.50:0/3194615810 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fabb4151de0 0x7fabb413f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:35.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.334+0000 7fabb3fff640 1 -- 172.21.15.50:0/3194615810 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fabb40c7850 msgr2=0x7fabb415a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:35.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.334+0000 7fabb3fff640 1 --2- 172.21.15.50:0/3194615810 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fabb40c7850 0x7fabb415a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:35.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.334+0000 7fabb3fff640 1 -- 172.21.15.50:0/3194615810 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fabb4151de0 msgr2=0x7fabb413f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:35.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.334+0000 7fabb3fff640 1 --2- 172.21.15.50:0/3194615810 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fabb4151de0 0x7fabb413f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:35.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.334+0000 7fabb3fff640 1 -- 172.21.15.50:0/3194615810 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabb41591e0 con 0x7fabb40c2900 2024-04-01T02:12:35.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.334+0000 7fabb3fff640 1 --2- 172.21.15.50:0/3194615810 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fabb40c2900 0x7fabb4147eb0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7faba400c7b0 tx=0x7faba400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:12:35.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.334+0000 7fabb0ff9640 1 -- 172.21.15.50:0/3194615810 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faba4018070 con 0x7fabb40c2900 2024-04-01T02:12:35.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.334+0000 7fabb0ff9640 1 -- 172.21.15.50:0/3194615810 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faba400a640 con 0x7fabb40c2900 2024-04-01T02:12:35.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.334+0000 7fabba417640 1 -- 172.21.15.50:0/3194615810 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabb41508d0 con 0x7fabb40c2900 2024-04-01T02:12:35.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.334+0000 7fabb0ff9640 1 -- 172.21.15.50:0/3194615810 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faba400aa70 con 0x7fabb40c2900 2024-04-01T02:12:35.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.334+0000 7fabba417640 1 -- 172.21.15.50:0/3194615810 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabb4146e70 con 0x7fabb40c2900 2024-04-01T02:12:35.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.334+0000 7fabba417640 1 -- 172.21.15.50:0/3194615810 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabb4068230 con 0x7fabb40c2900 2024-04-01T02:12:35.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.334+0000 7fabb0ff9640 1 -- 172.21.15.50:0/3194615810 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 87103+0+0 (secure 0 0 0) 0x7faba401b070 con 0x7fabb40c2900 2024-04-01T02:12:35.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.334+0000 7fabb0ff9640 1 --2- 172.21.15.50:0/3194615810 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7faba0067420 0x7faba00698e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:35.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.334+0000 7fabb0ff9640 1 -- 172.21.15.50:0/3194615810 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5738+0+0 (secure 0 0 0) 0x7faba4084d20 con 0x7fabb40c2900 2024-04-01T02:12:35.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.334+0000 7fabb37fe640 1 --2- 172.21.15.50:0/3194615810 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7faba0067420 0x7faba00698e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:35.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.334+0000 7fabb37fe640 1 --2- 172.21.15.50:0/3194615810 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7faba0067420 0x7faba00698e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7faba80ad000 tx=0x7faba8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:12:35.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.338+0000 7fabb0ff9640 1 -- 172.21.15.50:0/3194615810 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+176632 (secure 0 0 0) 0x7fabb41591e0 con 0x7fabb40c2900 2024-04-01T02:12:35.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.494+0000 7fabba417640 1 -- 172.21.15.50:0/3194615810 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fabb4163790 con 0x7fabb40c2900 2024-04-01T02:12:35.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.498+0000 7fabb0ff9640 1 -- 172.21.15.50:0/3194615810 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16574 (secure 0 0 0) 0x7faba4055a00 con 0x7fabb40c2900 2024-04-01T02:12:35.493 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-01T02:12:35.494 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":23,"fsid":"f67878a9-bc75-426b-962d-fa7bc2517f7d","created":"2024-04-01T01:55:31.562371+0000","modified":"2024-04-01T01:56:37.409424+0000","last_up_change":"2024-04-01T01:55:42.134502+0000","last_in_change":"2024-04-01T01:55:33.849789+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-01T01:55:42.134418+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-01T01:55:47.009880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-01T01:55:47.551516+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"81e8ca4f-bde8-419a-875f-73a1f4a641ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":4170468134},{"type":"v1","addr":"172.21.15.50:6825","nonce":4170468134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":4170468134},{"type":"v1","addr":"172.21.15.50:6827","nonce":4170468134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":4170468134},{"type":"v1","addr":"172.21.15.50:6831","nonce":4170468134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":4170468134},{"type":"v1","addr":"172.21.15.50:6829","nonce":4170468134}]},"public_addr":"172.21.15.50:6825/4170468134","cluster_addr":"172.21.15.50:6827/4170468134","heartbeat_back_addr":"172.21.15.50:6831/4170468134","heartbeat_front_addr":"172.21.15.50:6829/4170468134","state":["exists","up"]},{"osd":1,"uuid":"bd060ca0-7559-4d30-987c-62e59818431d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1794491326},{"type":"v1","addr":"172.21.15.50:6809","nonce":1794491326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1794491326},{"type":"v1","addr":"172.21.15.50:6811","nonce":1794491326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1794491326},{"type":"v1","addr":"172.21.15.50:6815","nonce":1794491326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1794491326},{"type":"v1","addr":"172.21.15.50:6813","nonce":1794491326}]},"public_addr":"172.21.15.50:6809/1794491326","cluster_addr":"172.21.15.50:6811/1794491326","heartbeat_back_addr":"172.21.15.50:6815/1794491326","heartbeat_front_addr":"172.21.15.50:6813/1794491326","state":["exists","up"]},{"osd":2,"uuid":"eac5d816-a281-4acd-aa7d-b96a8e0aa962","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":710247177},{"type":"v1","addr":"172.21.15.50:6801","nonce":710247177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":710247177},{"type":"v1","addr":"172.21.15.50:6803","nonce":710247177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":710247177},{"type":"v1","addr":"172.21.15.50:6807","nonce":710247177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":710247177},{"type":"v1","addr":"172.21.15.50:6805","nonce":710247177}]},"public_addr":"172.21.15.50:6801/710247177","cluster_addr":"172.21.15.50:6803/710247177","heartbeat_back_addr":"172.21.15.50:6807/710247177","heartbeat_front_addr":"172.21.15.50:6805/710247177","state":["exists","up"]},{"osd":3,"uuid":"12b23968-04a7-40b8-98c4-02b16ae28265","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":871680805},{"type":"v1","addr":"172.21.15.50:6817","nonce":871680805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":871680805},{"type":"v1","addr":"172.21.15.50:6819","nonce":871680805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":871680805},{"type":"v1","addr":"172.21.15.50:6823","nonce":871680805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":871680805},{"type":"v1","addr":"172.21.15.50:6821","nonce":871680805}]},"public_addr":"172.21.15.50:6817/871680805","cluster_addr":"172.21.15.50:6819/871680805","heartbeat_back_addr":"172.21.15.50:6823/871680805","heartbeat_front_addr":"172.21.15.50:6821/871680805","state":["exists","up"]},{"osd":4,"uuid":"0e6b1639-23b0-47d9-8b08-40c8ab6df818","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":1095319381},{"type":"v1","addr":"172.21.15.97:6801","nonce":1095319381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":1095319381},{"type":"v1","addr":"172.21.15.97:6803","nonce":1095319381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":1095319381},{"type":"v1","addr":"172.21.15.97:6807","nonce":1095319381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":1095319381},{"type":"v1","addr":"172.21.15.97:6805","nonce":1095319381}]},"public_addr":"172.21.15.97:6801/1095319381","cluster_addr":"172.21.15.97:6803/1095319381","heartbeat_back_addr":"172.21.15.97:6807/1095319381","heartbeat_front_addr":"172.21.15.97:6805/1095319381","state":["exists","up"]},{"osd":5,"uuid":"f0f876ef-0823-46e9-8fe4-9b7a64a94cee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":899031308},{"type":"v1","addr":"172.21.15.97:6817","nonce":899031308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":899031308},{"type":"v1","addr":"172.21.15.97:6819","nonce":899031308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":899031308},{"type":"v1","addr":"172.21.15.97:6823","nonce":899031308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":899031308},{"type":"v1","addr":"172.21.15.97:6821","nonce":899031308}]},"public_addr":"172.21.15.97:6817/899031308","cluster_addr":"172.21.15.97:6819/899031308","heartbeat_back_addr":"172.21.15.97:6823/899031308","heartbeat_front_addr":"172.21.15.97:6821/899031308","state":["exists","up"]},{"osd":6,"uuid":"d29a625e-83bf-40ef-a57e-618220b96b9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2224814961},{"type":"v1","addr":"172.21.15.97:6825","nonce":2224814961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2224814961},{"type":"v1","addr":"172.21.15.97:6827","nonce":2224814961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2224814961},{"type":"v1","addr":"172.21.15.97:6831","nonce":2224814961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2224814961},{"type":"v1","addr":"172.21.15.97:6829","nonce":2224814961}]},"public_addr":"172.21.15.97:6825/2224814961","cluster_addr":"172.21.15.97:6827/2224814961","heartbeat_back_addr":"172.21.15.97:6831/2224814961","heartbeat_front_addr":"172.21.15.97:6829/2224814961","state":["exists","up"]},{"osd":7,"uuid":"7bcfd8f1-7dc0-4013-af17-16da5a8d931d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":284968823},{"type":"v1","addr":"172.21.15.97:6809","nonce":284968823}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":284968823},{"type":"v1","addr":"172.21.15.97:6811","nonce":284968823}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6814","nonce":284968823},{"type":"v1","addr":"172.21.15.97:6815","nonce":284968823}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":284968823},{"type":"v1","addr":"172.21.15.97:6813","nonce":284968823}]},"public_addr":"172.21.15.97:6809/284968823","cluster_addr":"172.21.15.97:6811/284968823","heartbeat_back_addr":"172.21.15.97:6815/284968823","heartbeat_front_addr":"172.21.15.97:6813/284968823","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T01:55:39.369550+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T01:55:39.367285+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T01:55:39.458393+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T01:55:39.456179+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T01:55:39.463649+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T01:55:38.728924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T01:55:39.522411+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T01:55:39.432081+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.36","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-01T02:12:35.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.498+0000 7fabba417640 1 -- 172.21.15.50:0/3194615810 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7faba0067420 msgr2=0x7faba00698e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:35.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.498+0000 7fabba417640 1 --2- 172.21.15.50:0/3194615810 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7faba0067420 0x7faba00698e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7faba80ad000 tx=0x7faba8008040 comp rx=0 tx=0).stop 2024-04-01T02:12:35.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.498+0000 7fabba417640 1 -- 172.21.15.50:0/3194615810 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fabb40c2900 msgr2=0x7fabb4147eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:35.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.498+0000 7fabba417640 1 --2- 172.21.15.50:0/3194615810 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fabb40c2900 0x7fabb4147eb0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7faba400c7b0 tx=0x7faba400cc70 comp rx=0 tx=0).stop 2024-04-01T02:12:35.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.498+0000 7fabba417640 1 -- 172.21.15.50:0/3194615810 shutdown_connections 2024-04-01T02:12:35.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.498+0000 7fabba417640 1 --2- 172.21.15.50:0/3194615810 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7faba0067420 0x7faba00698e0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:35.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.498+0000 7fabba417640 1 --2- 172.21.15.50:0/3194615810 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fabb4151de0 0x7fabb413f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:35.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.498+0000 7fabba417640 1 --2- 172.21.15.50:0/3194615810 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fabb40c7850 0x7fabb415a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:35.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.498+0000 7fabba417640 1 --2- 172.21.15.50:0/3194615810 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fabb40c2900 0x7fabb4147eb0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:35.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.498+0000 7fabba417640 1 -- 172.21.15.50:0/3194615810 >> 172.21.15.50:0/3194615810 conn(0x7fabb4067560 msgr2=0x7fabb406ec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T02:12:35.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.498+0000 7fabba417640 1 -- 172.21.15.50:0/3194615810 shutdown_connections 2024-04-01T02:12:35.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.498+0000 7fabba417640 1 -- 172.21.15.50:0/3194615810 wait complete. 2024-04-01T02:12:35.512 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-01T01:55:42.134418+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-01T01:55:47.009880+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-01T01:55:47.551516+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-01T02:12:35.513 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-01T02:12:35.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.638+0000 7fede709f640 1 Processor -- start 2024-04-01T02:12:35.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.638+0000 7fede709f640 1 -- start start 2024-04-01T02:12:35.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.638+0000 7fede709f640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fede0159f20 0x7fede0153d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:35.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.638+0000 7fede709f640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fede00cae60 con 0x7fede00cc820 2024-04-01T02:12:35.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.638+0000 7fede709f640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fede015a4d0 con 0x7fede00cc440 2024-04-01T02:12:35.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.638+0000 7fede709f640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fede00c4b10 con 0x7fede0159f20 2024-04-01T02:12:35.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.638+0000 7fede563c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fede0159f20 0x7fede0153d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:35.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.638+0000 7feddffff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fede00cc820 0x7fede006c880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:51656/0 (socket says 172.21.15.50:51656) 2024-04-01T02:12:35.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.638+0000 7feddffff640 1 -- 172.21.15.50:0/2861693986 learned_addr learned my addr 172.21.15.50:0/2861693986 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-04-01T02:12:35.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.638+0000 7fede563c640 1 -- 172.21.15.50:0/2861693986 >> v1:172.21.15.97:6789/0 conn(0x7fede00cc440 legacy=0x7fede00ca750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:35.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.638+0000 7fede563c640 1 -- 172.21.15.50:0/2861693986 >> v1:172.21.15.50:6789/0 conn(0x7fede00cc820 legacy=0x7fede006c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:35.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.638+0000 7feddf7fe640 1 -- 172.21.15.50:0/2861693986 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1488758763 0 0) 0x7fedc8001120 con 0x7fede00cc820 2024-04-01T02:12:35.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.638+0000 7fede563c640 1 -- 172.21.15.50:0/2861693986 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fede015a7b0 con 0x7fede0159f20 2024-04-01T02:12:35.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.642+0000 7fede563c640 1 --2- 172.21.15.50:0/2861693986 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fede0159f20 0x7fede0153d00 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fedd0009d90 tx=0x7fedd001f150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bf0832026a1f465 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:12:35.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.642+0000 7feddf7fe640 1 -- 172.21.15.50:0/2861693986 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedd00b4070 con 0x7fede0159f20 2024-04-01T02:12:35.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.642+0000 7feddf7fe640 1 -- 172.21.15.50:0/2861693986 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedd00af600 con 0x7fede0159f20 2024-04-01T02:12:35.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.642+0000 7feddf7fe640 1 -- 172.21.15.50:0/2861693986 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedd00af9d0 con 0x7fede0159f20 2024-04-01T02:12:35.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.642+0000 7fede709f640 1 -- 172.21.15.50:0/2861693986 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fede0159f20 msgr2=0x7fede0153d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:35.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.642+0000 7fede709f640 1 --2- 172.21.15.50:0/2861693986 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fede0159f20 0x7fede0153d00 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fedd0009d90 tx=0x7fedd001f150 comp rx=0 tx=0).stop 2024-04-01T02:12:35.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.642+0000 7fede709f640 1 -- 172.21.15.50:0/2861693986 shutdown_connections 2024-04-01T02:12:35.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.642+0000 7fede709f640 1 --2- 172.21.15.50:0/2861693986 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fede0159f20 0x7fede0153d00 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:35.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.642+0000 7fede709f640 1 -- 172.21.15.50:0/2861693986 >> 172.21.15.50:0/2861693986 conn(0x7fede0066f60 msgr2=0x7fede0067370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T02:12:35.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.642+0000 7fede709f640 1 -- 172.21.15.50:0/2861693986 shutdown_connections 2024-04-01T02:12:35.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.642+0000 7fede709f640 1 -- 172.21.15.50:0/2861693986 wait complete. 2024-04-01T02:12:35.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.642+0000 7fede709f640 1 Processor -- start 2024-04-01T02:12:35.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.642+0000 7fede709f640 1 -- start start 2024-04-01T02:12:35.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.642+0000 7fede709f640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fede00cc440 0x7fede01f0720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:35.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.642+0000 7fede709f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fede00cc820 0x7fede01f0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:35.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.642+0000 7fede709f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fede0159f20 0x7fede0152b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:35.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.642+0000 7fede709f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fede015ad70 con 0x7fede00cc820 2024-04-01T02:12:35.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.642+0000 7fede709f640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fede006c110 con 0x7fede0159f20 2024-04-01T02:12:35.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.642+0000 7fede709f640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fede006c360 con 0x7fede00cc440 2024-04-01T02:12:35.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.646+0000 7feddffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fede00cc820 0x7fede01f0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:35.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.646+0000 7feddffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fede00cc820 0x7fede01f0fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34468/0 (socket says 172.21.15.50:34468) 2024-04-01T02:12:35.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.646+0000 7feddffff640 1 -- 172.21.15.50:0/2154914730 learned_addr learned my addr 172.21.15.50:0/2154914730 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T02:12:35.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.646+0000 7fede4e3b640 1 --2- 172.21.15.50:0/2154914730 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fede00cc440 0x7fede01f0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:35.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.646+0000 7fede563c640 1 --2- 172.21.15.50:0/2154914730 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fede0159f20 0x7fede0152b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:35.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.646+0000 7feddffff640 1 -- 172.21.15.50:0/2154914730 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fede00cc440 msgr2=0x7fede01f0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:35.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.646+0000 7feddffff640 1 --2- 172.21.15.50:0/2154914730 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fede00cc440 0x7fede01f0720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:35.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.646+0000 7feddffff640 1 -- 172.21.15.50:0/2154914730 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fede0159f20 msgr2=0x7fede0152b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:35.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.646+0000 7feddffff640 1 --2- 172.21.15.50:0/2154914730 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fede0159f20 0x7fede0152b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:35.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.646+0000 7feddffff640 1 -- 172.21.15.50:0/2154914730 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fede01f3be0 con 0x7fede00cc820 2024-04-01T02:12:35.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.646+0000 7feddffff640 1 --2- 172.21.15.50:0/2154914730 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fede00cc820 0x7fede01f0fa0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fedc800c7b0 tx=0x7fedc800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:12:35.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.646+0000 7feddd7fa640 1 -- 172.21.15.50:0/2154914730 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedc8018070 con 0x7fede00cc820 2024-04-01T02:12:35.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.646+0000 7feddd7fa640 1 -- 172.21.15.50:0/2154914730 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedc80072d0 con 0x7fede00cc820 2024-04-01T02:12:35.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.646+0000 7fede709f640 1 -- 172.21.15.50:0/2154914730 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fede01efc40 con 0x7fede00cc820 2024-04-01T02:12:35.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.646+0000 7feddd7fa640 1 -- 172.21.15.50:0/2154914730 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedc80047f0 con 0x7fede00cc820 2024-04-01T02:12:35.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.646+0000 7fede709f640 1 -- 172.21.15.50:0/2154914730 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fede01f0200 con 0x7fede00cc820 2024-04-01T02:12:35.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.646+0000 7fede709f640 1 -- 172.21.15.50:0/2154914730 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fede0068230 con 0x7fede00cc820 2024-04-01T02:12:35.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.646+0000 7feddd7fa640 1 -- 172.21.15.50:0/2154914730 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 87103+0+0 (secure 0 0 0) 0x7fedc801b070 con 0x7fede00cc820 2024-04-01T02:12:35.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.646+0000 7feddd7fa640 1 --2- 172.21.15.50:0/2154914730 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fedc0067450 0x7fedc0069910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:35.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.646+0000 7feddd7fa640 1 -- 172.21.15.50:0/2154914730 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5738+0+0 (secure 0 0 0) 0x7fedc8084900 con 0x7fede00cc820 2024-04-01T02:12:35.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.646+0000 7fede4e3b640 1 --2- 172.21.15.50:0/2154914730 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fedc0067450 0x7fedc0069910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:35.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.646+0000 7fede4e3b640 1 --2- 172.21.15.50:0/2154914730 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fedc0067450 0x7fedc0069910 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fedd8000f70 tx=0x7fedd8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:12:35.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.650+0000 7feddd7fa640 1 -- 172.21.15.50:0/2154914730 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+176632 (secure 0 0 0) 0x7fede00cae60 con 0x7fede00cc820 2024-04-01T02:12:35.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.806+0000 7fede709f640 1 -- 172.21.15.50:0/2154914730 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fede00b3010 con 0x7fede00cc820 2024-04-01T02:12:35.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.806+0000 7feddd7fa640 1 -- 172.21.15.50:0/2154914730 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) ==== 93+0+10 (secure 0 0 0) 0x7fedc8055710 con 0x7fede00cc820 2024-04-01T02:12:35.802 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2024-04-01T02:12:35.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.806+0000 7fede709f640 1 -- 172.21.15.50:0/2154914730 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fedc0067450 msgr2=0x7fedc0069910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:35.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.806+0000 7fede709f640 1 --2- 172.21.15.50:0/2154914730 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fedc0067450 0x7fedc0069910 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fedd8000f70 tx=0x7fedd8009040 comp rx=0 tx=0).stop 2024-04-01T02:12:35.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.806+0000 7fede709f640 1 -- 172.21.15.50:0/2154914730 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fede00cc820 msgr2=0x7fede01f0fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:35.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.806+0000 7fede709f640 1 --2- 172.21.15.50:0/2154914730 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fede00cc820 0x7fede01f0fa0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fedc800c7b0 tx=0x7fedc800cc70 comp rx=0 tx=0).stop 2024-04-01T02:12:35.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.806+0000 7fede709f640 1 -- 172.21.15.50:0/2154914730 shutdown_connections 2024-04-01T02:12:35.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.806+0000 7fede709f640 1 --2- 172.21.15.50:0/2154914730 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fedc0067450 0x7fedc0069910 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:35.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.806+0000 7fede709f640 1 --2- 172.21.15.50:0/2154914730 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fede0159f20 0x7fede0152b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:35.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.806+0000 7fede709f640 1 --2- 172.21.15.50:0/2154914730 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fede00cc820 0x7fede01f0fa0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:35.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.806+0000 7fede709f640 1 --2- 172.21.15.50:0/2154914730 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fede00cc440 0x7fede01f0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:35.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.806+0000 7fede709f640 1 -- 172.21.15.50:0/2154914730 >> 172.21.15.50:0/2154914730 conn(0x7fede0066f60 msgr2=0x7fede0153ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T02:12:35.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.806+0000 7fede709f640 1 -- 172.21.15.50:0/2154914730 shutdown_connections 2024-04-01T02:12:35.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.806+0000 7fede709f640 1 -- 172.21.15.50:0/2154914730 wait complete. 2024-04-01T02:12:35.820 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-01T02:12:35.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.942+0000 7fb3eee52640 1 Processor -- start 2024-04-01T02:12:35.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.942+0000 7fb3eee52640 1 -- start start 2024-04-01T02:12:35.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.942+0000 7fb3eee52640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb3e80c8020 0x7fb3e80c84b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:35.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.942+0000 7fb3eee52640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3e80c8e40 con 0x7fb3e8151e90 2024-04-01T02:12:35.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.942+0000 7fb3eee52640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3e80cab90 con 0x7fb3e80c9ad0 2024-04-01T02:12:35.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.942+0000 7fb3eee52640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fb3e80cae50 con 0x7fb3e80c8020 2024-04-01T02:12:35.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.942+0000 7fb3ed3ef640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb3e80c8020 0x7fb3e80c84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:35.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.942+0000 7fb3ecbee640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fb3e8151e90 0x7fb3e80ca480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:51672/0 (socket says 172.21.15.50:51672) 2024-04-01T02:12:35.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.942+0000 7fb3ecbee640 1 -- 172.21.15.50:0/2185236651 learned_addr learned my addr 172.21.15.50:0/2185236651 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-04-01T02:12:35.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.942+0000 7fb3ed3ef640 1 -- 172.21.15.50:0/2185236651 >> v1:172.21.15.97:6789/0 conn(0x7fb3e80c9ad0 legacy=0x7fb3e8070320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:35.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.942+0000 7fb3ed3ef640 1 -- 172.21.15.50:0/2185236651 >> v1:172.21.15.50:6789/0 conn(0x7fb3e8151e90 legacy=0x7fb3e80ca480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:35.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.942+0000 7fb3e77fe640 1 -- 172.21.15.50:0/2185236651 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1931913419 0 0) 0x7fb3e80c8e40 con 0x7fb3e8151e90 2024-04-01T02:12:35.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.942+0000 7fb3ed3ef640 1 -- 172.21.15.50:0/2185236651 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3e80c2770 con 0x7fb3e80c8020 2024-04-01T02:12:35.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.946+0000 7fb3ed3ef640 1 --2- 172.21.15.50:0/2185236651 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3e80c8020 0x7fb3e80c84b0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fb3e0009d90 tx=0x7fb3e001c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48d15300a9fc90ef server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:12:35.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.946+0000 7fb3e77fe640 1 -- 172.21.15.50:0/2185236651 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3e00b2070 con 0x7fb3e80c8020 2024-04-01T02:12:35.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.946+0000 7fb3e77fe640 1 -- 172.21.15.50:0/2185236651 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3e00a5830 con 0x7fb3e80c8020 2024-04-01T02:12:35.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.946+0000 7fb3e77fe640 1 -- 172.21.15.50:0/2185236651 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3e00a5c00 con 0x7fb3e80c8020 2024-04-01T02:12:35.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.946+0000 7fb3eee52640 1 -- 172.21.15.50:0/2185236651 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3e80c8020 msgr2=0x7fb3e80c84b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:35.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.946+0000 7fb3eee52640 1 --2- 172.21.15.50:0/2185236651 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3e80c8020 0x7fb3e80c84b0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fb3e0009d90 tx=0x7fb3e001c970 comp rx=0 tx=0).stop 2024-04-01T02:12:35.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.946+0000 7fb3eee52640 1 -- 172.21.15.50:0/2185236651 shutdown_connections 2024-04-01T02:12:35.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.946+0000 7fb3eee52640 1 --2- 172.21.15.50:0/2185236651 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3e80c8020 0x7fb3e80c84b0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:35.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.946+0000 7fb3eee52640 1 -- 172.21.15.50:0/2185236651 >> 172.21.15.50:0/2185236651 conn(0x7fb3e806b420 msgr2=0x7fb3e806b830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T02:12:35.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.946+0000 7fb3eee52640 1 -- 172.21.15.50:0/2185236651 shutdown_connections 2024-04-01T02:12:35.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.946+0000 7fb3eee52640 1 -- 172.21.15.50:0/2185236651 wait complete. 2024-04-01T02:12:35.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.946+0000 7fb3eee52640 1 Processor -- start 2024-04-01T02:12:35.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.946+0000 7fb3eee52640 1 -- start start 2024-04-01T02:12:35.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.946+0000 7fb3eee52640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3e80c8020 0x7fb3e8149650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:35.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.950+0000 7fb3eee52640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb3e80c9ad0 0x7fb3e80c6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:35.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.950+0000 7fb3eee52640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb3e8151e90 0x7fb3e81f38f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:35.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.950+0000 7fb3eee52640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb3e8157cd0 con 0x7fb3e80c8020 2024-04-01T02:12:35.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.950+0000 7fb3eee52640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fb3e806fe90 con 0x7fb3e8151e90 2024-04-01T02:12:35.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.950+0000 7fb3eee52640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fb3e8070a30 con 0x7fb3e80c9ad0 2024-04-01T02:12:35.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.950+0000 7fb3ecbee640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3e80c8020 0x7fb3e8149650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:35.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.950+0000 7fb3ecbee640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3e80c8020 0x7fb3e8149650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34488/0 (socket says 172.21.15.50:34488) 2024-04-01T02:12:35.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.950+0000 7fb3ecbee640 1 -- 172.21.15.50:0/944016277 learned_addr learned my addr 172.21.15.50:0/944016277 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T02:12:35.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.950+0000 7fb3ed3ef640 1 --2- 172.21.15.50:0/944016277 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb3e8151e90 0x7fb3e81f38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:35.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.950+0000 7fb3e7fff640 1 --2- 172.21.15.50:0/944016277 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb3e80c9ad0 0x7fb3e80c6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:35.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.950+0000 7fb3ecbee640 1 -- 172.21.15.50:0/944016277 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb3e80c9ad0 msgr2=0x7fb3e80c6ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:35.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.950+0000 7fb3ecbee640 1 --2- 172.21.15.50:0/944016277 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb3e80c9ad0 0x7fb3e80c6ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:35.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.950+0000 7fb3ecbee640 1 -- 172.21.15.50:0/944016277 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb3e8151e90 msgr2=0x7fb3e81f38f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:35.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.950+0000 7fb3ecbee640 1 --2- 172.21.15.50:0/944016277 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb3e8151e90 0x7fb3e81f38f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:35.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.950+0000 7fb3ecbee640 1 -- 172.21.15.50:0/944016277 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3e81f0490 con 0x7fb3e80c8020 2024-04-01T02:12:35.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.950+0000 7fb3ed3ef640 1 --2- 172.21.15.50:0/944016277 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb3e8151e90 0x7fb3e81f38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T02:12:35.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.950+0000 7fb3ecbee640 1 --2- 172.21.15.50:0/944016277 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3e80c8020 0x7fb3e8149650 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fb3d800c440 tx=0x7fb3d800c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:12:35.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.950+0000 7fb3e57fa640 1 -- 172.21.15.50:0/944016277 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3d8018070 con 0x7fb3e80c8020 2024-04-01T02:12:35.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.950+0000 7fb3e57fa640 1 -- 172.21.15.50:0/944016277 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3d80074e0 con 0x7fb3e80c8020 2024-04-01T02:12:35.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.950+0000 7fb3eee52640 1 -- 172.21.15.50:0/944016277 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3e81f0730 con 0x7fb3e80c8020 2024-04-01T02:12:35.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.950+0000 7fb3e57fa640 1 -- 172.21.15.50:0/944016277 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3d8004a10 con 0x7fb3e80c8020 2024-04-01T02:12:35.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.950+0000 7fb3eee52640 1 -- 172.21.15.50:0/944016277 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3e81f0cf0 con 0x7fb3e80c8020 2024-04-01T02:12:35.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.950+0000 7fb3eee52640 1 -- 172.21.15.50:0/944016277 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3e8068940 con 0x7fb3e80c8020 2024-04-01T02:12:35.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.950+0000 7fb3e57fa640 1 -- 172.21.15.50:0/944016277 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 87103+0+0 (secure 0 0 0) 0x7fb3d801b070 con 0x7fb3e80c8020 2024-04-01T02:12:35.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.950+0000 7fb3e57fa640 1 --2- 172.21.15.50:0/944016277 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fb3d4067450 0x7fb3d4069910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:35.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.950+0000 7fb3e57fa640 1 -- 172.21.15.50:0/944016277 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5738+0+0 (secure 0 0 0) 0x7fb3d8084800 con 0x7fb3e80c8020 2024-04-01T02:12:35.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.950+0000 7fb3e7fff640 1 --2- 172.21.15.50:0/944016277 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fb3d4067450 0x7fb3d4069910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:35.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.950+0000 7fb3e7fff640 1 --2- 172.21.15.50:0/944016277 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fb3d4067450 0x7fb3d4069910 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb3e81edeb0 tx=0x7fb3dc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:12:35.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:35.954+0000 7fb3e57fa640 1 -- 172.21.15.50:0/944016277 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+176632 (secure 0 0 0) 0x7fb3d8055610 con 0x7fb3e80c8020 2024-04-01T02:12:36.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.110+0000 7fb3eee52640 1 -- 172.21.15.50:0/944016277 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fb3e8158130 con 0x7fb3e80c8020 2024-04-01T02:12:36.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.110+0000 7fb3e57fa640 1 -- 172.21.15.50:0/944016277 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) ==== 104+0+11 (secure 0 0 0) 0x7fb3d8054f10 con 0x7fb3e80c8020 2024-04-01T02:12:36.109 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2024-04-01T02:12:36.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.114+0000 7fb3eee52640 1 -- 172.21.15.50:0/944016277 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fb3d4067450 msgr2=0x7fb3d4069910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:36.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.114+0000 7fb3eee52640 1 --2- 172.21.15.50:0/944016277 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fb3d4067450 0x7fb3d4069910 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb3e81edeb0 tx=0x7fb3dc009040 comp rx=0 tx=0).stop 2024-04-01T02:12:36.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.114+0000 7fb3eee52640 1 -- 172.21.15.50:0/944016277 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3e80c8020 msgr2=0x7fb3e8149650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:36.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.114+0000 7fb3eee52640 1 --2- 172.21.15.50:0/944016277 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3e80c8020 0x7fb3e8149650 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fb3d800c440 tx=0x7fb3d800c900 comp rx=0 tx=0).stop 2024-04-01T02:12:36.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.114+0000 7fb3eee52640 1 -- 172.21.15.50:0/944016277 shutdown_connections 2024-04-01T02:12:36.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.114+0000 7fb3eee52640 1 --2- 172.21.15.50:0/944016277 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fb3d4067450 0x7fb3d4069910 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:36.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.114+0000 7fb3eee52640 1 --2- 172.21.15.50:0/944016277 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb3e8151e90 0x7fb3e81f38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:36.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.114+0000 7fb3eee52640 1 --2- 172.21.15.50:0/944016277 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb3e80c9ad0 0x7fb3e80c6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:36.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.114+0000 7fb3eee52640 1 --2- 172.21.15.50:0/944016277 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3e80c8020 0x7fb3e8149650 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:36.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.114+0000 7fb3eee52640 1 -- 172.21.15.50:0/944016277 >> 172.21.15.50:0/944016277 conn(0x7fb3e806b420 msgr2=0x7fb3e80cd5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T02:12:36.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.114+0000 7fb3eee52640 1 -- 172.21.15.50:0/944016277 shutdown_connections 2024-04-01T02:12:36.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.114+0000 7fb3eee52640 1 -- 172.21.15.50:0/944016277 wait complete. 2024-04-01T02:12:36.126 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-01T02:12:36.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.246+0000 7fd21e013640 1 Processor -- start 2024-04-01T02:12:36.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.246+0000 7fd21e013640 1 -- start start 2024-04-01T02:12:36.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.246+0000 7fd21e013640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fd218151f40 0x7fd21806fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:36.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.246+0000 7fd21e013640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd218152320 0x7fd2180c5b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:36.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.246+0000 7fd21e013640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd218157df0 con 0x7fd2180ccd30 2024-04-01T02:12:36.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.246+0000 7fd21e013640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fd21815b3e0 con 0x7fd218151f40 2024-04-01T02:12:36.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.246+0000 7fd21e013640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fd2181580b0 con 0x7fd218152320 2024-04-01T02:12:36.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.246+0000 7fd216ffd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd218152320 0x7fd2180c5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:36.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.246+0000 7fd217fff640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fd2180ccd30 0x7fd21815b870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.50:36880/0 (socket says 172.21.15.50:36880) 2024-04-01T02:12:36.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.246+0000 7fd217fff640 1 -- 172.21.15.50:0/3103315613 learned_addr learned my addr 172.21.15.50:0/3103315613 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-04-01T02:12:36.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.246+0000 7fd2177fe640 1 --2- 172.21.15.50:0/3103315613 >> v2:172.21.15.97:3300/0 conn(0x7fd218151f40 0x7fd21806fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:36.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.246+0000 7fd2167fc640 1 -- 172.21.15.50:0/3103315613 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 161443107 0 0) 0x7fd218157df0 con 0x7fd2180ccd30 2024-04-01T02:12:36.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.246+0000 7fd2167fc640 1 -- 172.21.15.50:0/3103315613 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd200003530 con 0x7fd2180ccd30 2024-04-01T02:12:36.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.246+0000 7fd216ffd640 1 -- 172.21.15.50:0/3103315613 >> v2:172.21.15.97:3300/0 conn(0x7fd218151f40 msgr2=0x7fd21806fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T02:12:36.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.246+0000 7fd216ffd640 1 --2- 172.21.15.50:0/3103315613 >> v2:172.21.15.97:3300/0 conn(0x7fd218151f40 0x7fd21806fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:36.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.246+0000 7fd216ffd640 1 -- 172.21.15.50:0/3103315613 >> v1:172.21.15.97:6789/0 conn(0x7fd2180ccd30 legacy=0x7fd21815b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:36.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.246+0000 7fd216ffd640 1 -- 172.21.15.50:0/3103315613 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd218158390 con 0x7fd218152320 2024-04-01T02:12:36.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.250+0000 7fd216ffd640 1 --2- 172.21.15.50:0/3103315613 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd218152320 0x7fd2180c5b20 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd2080097c0 tx=0x7fd20801ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cd0578ad90590d71 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:12:36.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.250+0000 7fd2167fc640 1 -- 172.21.15.50:0/3103315613 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2080b5070 con 0x7fd218152320 2024-04-01T02:12:36.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.250+0000 7fd2167fc640 1 -- 172.21.15.50:0/3103315613 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2080a8990 con 0x7fd218152320 2024-04-01T02:12:36.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.250+0000 7fd2167fc640 1 -- 172.21.15.50:0/3103315613 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2080a8d60 con 0x7fd218152320 2024-04-01T02:12:36.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.250+0000 7fd21e013640 1 -- 172.21.15.50:0/3103315613 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd218152320 msgr2=0x7fd2180c5b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:36.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.250+0000 7fd21e013640 1 --2- 172.21.15.50:0/3103315613 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd218152320 0x7fd2180c5b20 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd2080097c0 tx=0x7fd20801ec90 comp rx=0 tx=0).stop 2024-04-01T02:12:36.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.250+0000 7fd21e013640 1 -- 172.21.15.50:0/3103315613 shutdown_connections 2024-04-01T02:12:36.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.250+0000 7fd21e013640 1 --2- 172.21.15.50:0/3103315613 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd218152320 0x7fd2180c5b20 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:36.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.250+0000 7fd21e013640 1 --2- 172.21.15.50:0/3103315613 >> v2:172.21.15.97:3300/0 conn(0x7fd218151f40 0x7fd21806fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:36.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.250+0000 7fd21e013640 1 -- 172.21.15.50:0/3103315613 >> 172.21.15.50:0/3103315613 conn(0x7fd21806c330 msgr2=0x7fd21806c740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T02:12:36.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.250+0000 7fd21e013640 1 -- 172.21.15.50:0/3103315613 shutdown_connections 2024-04-01T02:12:36.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.250+0000 7fd21e013640 1 -- 172.21.15.50:0/3103315613 wait complete. 2024-04-01T02:12:36.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.250+0000 7fd21e013640 1 Processor -- start 2024-04-01T02:12:36.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.250+0000 7fd21e013640 1 -- start start 2024-04-01T02:12:36.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.250+0000 7fd21e013640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd2180ccd30 0x7fd2181f1850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:36.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.250+0000 7fd21e013640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd218151f40 0x7fd2181408c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:36.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.250+0000 7fd21e013640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd218152320 0x7fd218147240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:36.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.250+0000 7fd21e013640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd218158c30 con 0x7fd218151f40 2024-04-01T02:12:36.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.250+0000 7fd21e013640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fd218158950 con 0x7fd2180ccd30 2024-04-01T02:12:36.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.250+0000 7fd21e013640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fd2180702f0 con 0x7fd218152320 2024-04-01T02:12:36.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.250+0000 7fd2177fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd2180ccd30 0x7fd2181f1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:36.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.250+0000 7fd216ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd218151f40 0x7fd2181408c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:36.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.250+0000 7fd2177fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd2180ccd30 0x7fd2181f1850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.50:55290/0 (socket says 172.21.15.50:55290) 2024-04-01T02:12:36.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.250+0000 7fd2177fe640 1 -- 172.21.15.50:0/691669057 learned_addr learned my addr 172.21.15.50:0/691669057 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T02:12:36.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.250+0000 7fd217fff640 1 --2- 172.21.15.50:0/691669057 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd218152320 0x7fd218147240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:36.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.250+0000 7fd216ffd640 1 -- 172.21.15.50:0/691669057 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd218152320 msgr2=0x7fd218147240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:36.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.250+0000 7fd216ffd640 1 --2- 172.21.15.50:0/691669057 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd218152320 0x7fd218147240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:36.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.250+0000 7fd216ffd640 1 -- 172.21.15.50:0/691669057 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd2180ccd30 msgr2=0x7fd2181f1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:36.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.250+0000 7fd216ffd640 1 --2- 172.21.15.50:0/691669057 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd2180ccd30 0x7fd2181f1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:36.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.250+0000 7fd216ffd640 1 -- 172.21.15.50:0/691669057 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2181552e0 con 0x7fd218151f40 2024-04-01T02:12:36.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.250+0000 7fd2177fe640 1 --2- 172.21.15.50:0/691669057 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd2180ccd30 0x7fd2181f1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T02:12:36.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.254+0000 7fd216ffd640 1 --2- 172.21.15.50:0/691669057 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd218151f40 0x7fd2181408c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd2080af000 tx=0x7fd20801ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:12:36.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.254+0000 7fd1fffff640 1 -- 172.21.15.50:0/691669057 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2080bf070 con 0x7fd218151f40 2024-04-01T02:12:36.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.254+0000 7fd1fffff640 1 -- 172.21.15.50:0/691669057 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2080b0660 con 0x7fd218151f40 2024-04-01T02:12:36.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.254+0000 7fd1fffff640 1 -- 172.21.15.50:0/691669057 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2080b5040 con 0x7fd218151f40 2024-04-01T02:12:36.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.254+0000 7fd21e013640 1 -- 172.21.15.50:0/691669057 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd218142ca0 con 0x7fd218151f40 2024-04-01T02:12:36.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.254+0000 7fd21e013640 1 -- 172.21.15.50:0/691669057 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd218155580 con 0x7fd218151f40 2024-04-01T02:12:36.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.254+0000 7fd21e013640 1 -- 172.21.15.50:0/691669057 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd218068940 con 0x7fd218151f40 2024-04-01T02:12:36.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.254+0000 7fd1fffff640 1 -- 172.21.15.50:0/691669057 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 87103+0+0 (secure 0 0 0) 0x7fd2080b0a50 con 0x7fd218151f40 2024-04-01T02:12:36.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.254+0000 7fd1fffff640 1 --2- 172.21.15.50:0/691669057 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fd204067420 0x7fd2040698e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:36.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.254+0000 7fd1fffff640 1 -- 172.21.15.50:0/691669057 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5738+0+0 (secure 0 0 0) 0x7fd208121da0 con 0x7fd218151f40 2024-04-01T02:12:36.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.254+0000 7fd2177fe640 1 --2- 172.21.15.50:0/691669057 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fd204067420 0x7fd2040698e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:36.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.254+0000 7fd2177fe640 1 --2- 172.21.15.50:0/691669057 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fd204067420 0x7fd2040698e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd20c011310 tx=0x7fd20c009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:12:36.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.258+0000 7fd1fffff640 1 -- 172.21.15.50:0/691669057 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+176632 (secure 0 0 0) 0x7fd2080187f0 con 0x7fd218151f40 2024-04-01T02:12:36.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.410+0000 7fd21e013640 1 -- 172.21.15.50:0/691669057 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fd2180c00f0 con 0x7fd218151f40 2024-04-01T02:12:36.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.410+0000 7fd1fffff640 1 -- 172.21.15.50:0/691669057 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) ==== 100+0+11 (secure 0 0 0) 0x7fd2080f24e0 con 0x7fd218151f40 2024-04-01T02:12:36.408 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2024-04-01T02:12:36.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.414+0000 7fd21e013640 1 -- 172.21.15.50:0/691669057 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fd204067420 msgr2=0x7fd2040698e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:36.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.414+0000 7fd21e013640 1 --2- 172.21.15.50:0/691669057 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fd204067420 0x7fd2040698e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd20c011310 tx=0x7fd20c009190 comp rx=0 tx=0).stop 2024-04-01T02:12:36.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.414+0000 7fd21e013640 1 -- 172.21.15.50:0/691669057 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd218151f40 msgr2=0x7fd2181408c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:36.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.414+0000 7fd21e013640 1 --2- 172.21.15.50:0/691669057 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd218151f40 0x7fd2181408c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd2080af000 tx=0x7fd20801ba30 comp rx=0 tx=0).stop 2024-04-01T02:12:36.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.414+0000 7fd21e013640 1 -- 172.21.15.50:0/691669057 shutdown_connections 2024-04-01T02:12:36.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.414+0000 7fd21e013640 1 --2- 172.21.15.50:0/691669057 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fd204067420 0x7fd2040698e0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:36.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.414+0000 7fd21e013640 1 --2- 172.21.15.50:0/691669057 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd218152320 0x7fd218147240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:36.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.414+0000 7fd21e013640 1 --2- 172.21.15.50:0/691669057 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd218151f40 0x7fd2181408c0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:36.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.414+0000 7fd21e013640 1 --2- 172.21.15.50:0/691669057 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd2180ccd30 0x7fd2181f1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:36.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.414+0000 7fd21e013640 1 -- 172.21.15.50:0/691669057 >> 172.21.15.50:0/691669057 conn(0x7fd21806c330 msgr2=0x7fd2180ca2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T02:12:36.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.414+0000 7fd21e013640 1 -- 172.21.15.50:0/691669057 shutdown_connections 2024-04-01T02:12:36.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.414+0000 7fd21e013640 1 -- 172.21.15.50:0/691669057 wait complete. 2024-04-01T02:12:36.427 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-01T02:12:36.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.546+0000 7f49f01a4640 1 Processor -- start 2024-04-01T02:12:36.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.546+0000 7f49f01a4640 1 -- start start 2024-04-01T02:12:36.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.546+0000 7f49f01a4640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f49e8151de0 0x7f49e8157be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:36.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.546+0000 7f49f01a4640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f49e80c2900 0x7f49e80c5f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:36.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.546+0000 7f49f01a4640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49e80c30d0 con 0x7f49e8158120 2024-04-01T02:12:36.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.546+0000 7f49f01a4640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f49e815b370 con 0x7f49e8151de0 2024-04-01T02:12:36.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.546+0000 7f49f01a4640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f49e815c0f0 con 0x7f49e80c2900 2024-04-01T02:12:36.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.546+0000 7f49edf40640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f49e8151de0 0x7f49e8157be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:36.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.546+0000 7f49ee741640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f49e8158120 0x7f49e806ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:51678/0 (socket says 172.21.15.50:51678) 2024-04-01T02:12:36.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.546+0000 7f49ee741640 1 -- 172.21.15.50:0/3169135440 learned_addr learned my addr 172.21.15.50:0/3169135440 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-04-01T02:12:36.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.546+0000 7f49ed73f640 1 --2- 172.21.15.50:0/3169135440 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f49e80c2900 0x7f49e80c5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:36.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.550+0000 7f49edf40640 1 -- 172.21.15.50:0/3169135440 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f49e80c2900 msgr2=0x7f49e80c5f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T02:12:36.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.550+0000 7f49edf40640 1 --2- 172.21.15.50:0/3169135440 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f49e80c2900 0x7f49e80c5f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:36.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.550+0000 7f49edf40640 1 -- 172.21.15.50:0/3169135440 >> v1:172.21.15.50:6789/0 conn(0x7f49e8158120 legacy=0x7f49e806ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:36.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.550+0000 7f49edf40640 1 -- 172.21.15.50:0/3169135440 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49e80c2df0 con 0x7f49e8151de0 2024-04-01T02:12:36.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.550+0000 7f49ecf3e640 1 -- 172.21.15.50:0/3169135440 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4294138635 0 0) 0x7f49e80c30d0 con 0x7f49e8158120 2024-04-01T02:12:36.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.550+0000 7f49edf40640 1 --2- 172.21.15.50:0/3169135440 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49e8151de0 0x7f49e8157be0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f49e40097c0 tx=0x7f49e401ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9ec55c26e36c1bf server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:12:36.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.550+0000 7f49ecf3e640 1 -- 172.21.15.50:0/3169135440 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49e40b5070 con 0x7f49e8151de0 2024-04-01T02:12:36.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.550+0000 7f49ecf3e640 1 -- 172.21.15.50:0/3169135440 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49e40a8990 con 0x7f49e8151de0 2024-04-01T02:12:36.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.550+0000 7f49ecf3e640 1 -- 172.21.15.50:0/3169135440 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49e40a8d60 con 0x7f49e8151de0 2024-04-01T02:12:36.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.550+0000 7f49f01a4640 1 -- 172.21.15.50:0/3169135440 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49e8151de0 msgr2=0x7f49e8157be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:36.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.550+0000 7f49f01a4640 1 --2- 172.21.15.50:0/3169135440 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49e8151de0 0x7f49e8157be0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f49e40097c0 tx=0x7f49e401ec90 comp rx=0 tx=0).stop 2024-04-01T02:12:36.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.550+0000 7f49f01a4640 1 -- 172.21.15.50:0/3169135440 shutdown_connections 2024-04-01T02:12:36.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.550+0000 7f49f01a4640 1 --2- 172.21.15.50:0/3169135440 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f49e80c2900 0x7f49e80c5f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:36.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.550+0000 7f49f01a4640 1 --2- 172.21.15.50:0/3169135440 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49e8151de0 0x7f49e8157be0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:36.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.550+0000 7f49f01a4640 1 -- 172.21.15.50:0/3169135440 >> 172.21.15.50:0/3169135440 conn(0x7f49e8067560 msgr2=0x7f49e806b220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T02:12:36.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.550+0000 7f49f01a4640 1 -- 172.21.15.50:0/3169135440 shutdown_connections 2024-04-01T02:12:36.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.550+0000 7f49f01a4640 1 -- 172.21.15.50:0/3169135440 wait complete. 2024-04-01T02:12:36.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.554+0000 7f49f01a4640 1 Processor -- start 2024-04-01T02:12:36.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.554+0000 7f49f01a4640 1 -- start start 2024-04-01T02:12:36.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.554+0000 7f49f01a4640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f49e80c2900 0x7f49e81f1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:36.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.554+0000 7f49f01a4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49e8151de0 0x7f49e81e3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:36.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.554+0000 7f49f01a4640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f49e8158120 0x7f49e81ef0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:36.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.554+0000 7f49f01a4640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f49e815bbd0 con 0x7f49e8151de0 2024-04-01T02:12:36.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.554+0000 7f49f01a4640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f49e815b8f0 con 0x7f49e8158120 2024-04-01T02:12:36.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.554+0000 7f49f01a4640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f49e80c88a0 con 0x7f49e80c2900 2024-04-01T02:12:36.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.554+0000 7f49ed73f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49e8151de0 0x7f49e81e3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:36.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.554+0000 7f49ed73f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49e8151de0 0x7f49e81e3710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34512/0 (socket says 172.21.15.50:34512) 2024-04-01T02:12:36.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.554+0000 7f49ed73f640 1 -- 172.21.15.50:0/1524042836 learned_addr learned my addr 172.21.15.50:0/1524042836 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T02:12:36.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.554+0000 7f49ee741640 1 --2- 172.21.15.50:0/1524042836 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f49e8158120 0x7f49e81ef0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:36.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.554+0000 7f49edf40640 1 --2- 172.21.15.50:0/1524042836 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f49e80c2900 0x7f49e81f1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:36.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.554+0000 7f49ed73f640 1 -- 172.21.15.50:0/1524042836 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f49e80c2900 msgr2=0x7f49e81f1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:36.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.554+0000 7f49ed73f640 1 --2- 172.21.15.50:0/1524042836 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f49e80c2900 0x7f49e81f1bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:36.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.554+0000 7f49ed73f640 1 -- 172.21.15.50:0/1524042836 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f49e8158120 msgr2=0x7f49e81ef0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:36.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.554+0000 7f49ed73f640 1 --2- 172.21.15.50:0/1524042836 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f49e8158120 0x7f49e81ef0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:36.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.554+0000 7f49ed73f640 1 -- 172.21.15.50:0/1524042836 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49e80cbe90 con 0x7f49e8151de0 2024-04-01T02:12:36.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.554+0000 7f49ed73f640 1 --2- 172.21.15.50:0/1524042836 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49e8151de0 0x7f49e81e3710 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f49d800d620 tx=0x7f49d800dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:12:36.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.554+0000 7f49de7fc640 1 -- 172.21.15.50:0/1524042836 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49d800b620 con 0x7f49e8151de0 2024-04-01T02:12:36.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.554+0000 7f49de7fc640 1 -- 172.21.15.50:0/1524042836 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49d8019070 con 0x7f49e8151de0 2024-04-01T02:12:36.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.554+0000 7f49f01a4640 1 -- 172.21.15.50:0/1524042836 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49e80cc130 con 0x7f49e8151de0 2024-04-01T02:12:36.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.554+0000 7f49de7fc640 1 -- 172.21.15.50:0/1524042836 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49d800ba20 con 0x7f49e8151de0 2024-04-01T02:12:36.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.554+0000 7f49f01a4640 1 -- 172.21.15.50:0/1524042836 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49e80c9a10 con 0x7f49e8151de0 2024-04-01T02:12:36.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.554+0000 7f49f01a4640 1 -- 172.21.15.50:0/1524042836 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49e8068230 con 0x7f49e8151de0 2024-04-01T02:12:36.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.554+0000 7f49de7fc640 1 -- 172.21.15.50:0/1524042836 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 87103+0+0 (secure 0 0 0) 0x7f49d800bbc0 con 0x7f49e8151de0 2024-04-01T02:12:36.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.554+0000 7f49de7fc640 1 --2- 172.21.15.50:0/1524042836 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f49cc067420 0x7f49cc0698e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:36.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.554+0000 7f49de7fc640 1 -- 172.21.15.50:0/1524042836 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5738+0+0 (secure 0 0 0) 0x7f49d8085a90 con 0x7f49e8151de0 2024-04-01T02:12:36.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.558+0000 7f49edf40640 1 --2- 172.21.15.50:0/1524042836 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f49cc067420 0x7f49cc0698e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:36.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.558+0000 7f49edf40640 1 --2- 172.21.15.50:0/1524042836 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f49cc067420 0x7f49cc0698e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f49e40b2000 tx=0x7f49e40aa070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:12:36.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.562+0000 7f49de7fc640 1 -- 172.21.15.50:0/1524042836 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+176632 (secure 0 0 0) 0x7f49d80568a0 con 0x7f49e8151de0 2024-04-01T02:12:36.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.734+0000 7f49f01a4640 1 -- 172.21.15.50:0/1524042836 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f49e814be70 con 0x7f49e8151de0 2024-04-01T02:12:36.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.734+0000 7f49de7fc640 1 -- 172.21.15.50:0/1524042836 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) ==== 80+0+0 (secure 0 0 0) 0x7f49d80561a0 con 0x7f49e8151de0 2024-04-01T02:12:36.730 INFO:teuthology.orchestra.run.smithi050.stderr:listed 0 entries 2024-04-01T02:12:36.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.734+0000 7f49f01a4640 1 -- 172.21.15.50:0/1524042836 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f49cc067420 msgr2=0x7f49cc0698e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:36.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.734+0000 7f49f01a4640 1 --2- 172.21.15.50:0/1524042836 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f49cc067420 0x7f49cc0698e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f49e40b2000 tx=0x7f49e40aa070 comp rx=0 tx=0).stop 2024-04-01T02:12:36.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.734+0000 7f49f01a4640 1 -- 172.21.15.50:0/1524042836 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49e8151de0 msgr2=0x7f49e81e3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:36.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.734+0000 7f49f01a4640 1 --2- 172.21.15.50:0/1524042836 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49e8151de0 0x7f49e81e3710 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f49d800d620 tx=0x7f49d800dae0 comp rx=0 tx=0).stop 2024-04-01T02:12:36.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.734+0000 7f49f01a4640 1 -- 172.21.15.50:0/1524042836 shutdown_connections 2024-04-01T02:12:36.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.734+0000 7f49f01a4640 1 --2- 172.21.15.50:0/1524042836 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f49cc067420 0x7f49cc0698e0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:36.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.734+0000 7f49f01a4640 1 --2- 172.21.15.50:0/1524042836 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f49e8158120 0x7f49e81ef0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:36.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.734+0000 7f49f01a4640 1 --2- 172.21.15.50:0/1524042836 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49e8151de0 0x7f49e81e3710 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:36.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.734+0000 7f49f01a4640 1 --2- 172.21.15.50:0/1524042836 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f49e80c2900 0x7f49e81f1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:36.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.734+0000 7f49f01a4640 1 -- 172.21.15.50:0/1524042836 >> 172.21.15.50:0/1524042836 conn(0x7f49e8067560 msgr2=0x7f49e814de70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T02:12:36.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.734+0000 7f49f01a4640 1 -- 172.21.15.50:0/1524042836 shutdown_connections 2024-04-01T02:12:36.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.734+0000 7f49f01a4640 1 -- 172.21.15.50:0/1524042836 wait complete. 2024-04-01T02:12:36.750 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-04-01T02:12:36.750 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-01T02:12:36.755 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-01T02:12:36.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.922+0000 7fd6849e7640 1 Processor -- start 2024-04-01T02:12:36.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.922+0000 7fd6849e7640 1 -- start start 2024-04-01T02:12:36.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.922+0000 7fd6849e7640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd6800c73a0 0x7fd6800c2900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:36.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.922+0000 7fd6849e7640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fd6800c77c0 0x7fd6800c2e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:36.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.922+0000 7fd6849e7640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd680156a20 con 0x7fd680150e60 2024-04-01T02:12:36.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.922+0000 7fd6849e7640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fd6801578f0 con 0x7fd6800c73a0 2024-04-01T02:12:36.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.922+0000 7fd6849e7640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fd680156ce0 con 0x7fd6800c77c0 2024-04-01T02:12:36.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.922+0000 7fd67e59c640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fd680150e60 0x7fd680072f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:51684/0 (socket says 172.21.15.50:51684) 2024-04-01T02:12:36.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.922+0000 7fd67dd9b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd6800c73a0 0x7fd6800c2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:36.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.922+0000 7fd67e59c640 1 -- 172.21.15.50:0/3123759976 learned_addr learned my addr 172.21.15.50:0/3123759976 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-04-01T02:12:36.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.922+0000 7fd67ed9d640 1 --2- 172.21.15.50:0/3123759976 >> v2:172.21.15.97:3300/0 conn(0x7fd6800c77c0 0x7fd6800c2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:36.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.922+0000 7fd67dd9b640 1 -- 172.21.15.50:0/3123759976 >> v2:172.21.15.97:3300/0 conn(0x7fd6800c77c0 msgr2=0x7fd6800c2e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T02:12:36.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.922+0000 7fd67dd9b640 1 --2- 172.21.15.50:0/3123759976 >> v2:172.21.15.97:3300/0 conn(0x7fd6800c77c0 0x7fd6800c2e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:36.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.922+0000 7fd67dd9b640 1 -- 172.21.15.50:0/3123759976 >> v1:172.21.15.50:6789/0 conn(0x7fd680150e60 legacy=0x7fd680072f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:36.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.922+0000 7fd67dd9b640 1 -- 172.21.15.50:0/3123759976 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd680156fc0 con 0x7fd6800c73a0 2024-04-01T02:12:36.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.926+0000 7fd67dd9b640 1 --2- 172.21.15.50:0/3123759976 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6800c73a0 0x7fd6800c2900 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fd6740097c0 tx=0x7fd67401ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9baa7857bade3ca8 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:12:36.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.926+0000 7fd67d59a640 1 -- 172.21.15.50:0/3123759976 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6740b5070 con 0x7fd6800c73a0 2024-04-01T02:12:36.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.926+0000 7fd67d59a640 1 -- 172.21.15.50:0/3123759976 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6740a8950 con 0x7fd6800c73a0 2024-04-01T02:12:36.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.926+0000 7fd67d59a640 1 -- 172.21.15.50:0/3123759976 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6740a8d20 con 0x7fd6800c73a0 2024-04-01T02:12:36.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.926+0000 7fd6849e7640 1 -- 172.21.15.50:0/3123759976 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6800c73a0 msgr2=0x7fd6800c2900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:36.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.926+0000 7fd6849e7640 1 --2- 172.21.15.50:0/3123759976 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6800c73a0 0x7fd6800c2900 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fd6740097c0 tx=0x7fd67401ec50 comp rx=0 tx=0).stop 2024-04-01T02:12:36.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.926+0000 7fd6849e7640 1 -- 172.21.15.50:0/3123759976 shutdown_connections 2024-04-01T02:12:36.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.926+0000 7fd6849e7640 1 --2- 172.21.15.50:0/3123759976 >> v2:172.21.15.97:3300/0 conn(0x7fd6800c77c0 0x7fd6800c2e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:36.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.926+0000 7fd6849e7640 1 --2- 172.21.15.50:0/3123759976 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6800c73a0 0x7fd6800c2900 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:36.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.926+0000 7fd6849e7640 1 -- 172.21.15.50:0/3123759976 >> 172.21.15.50:0/3123759976 conn(0x7fd680067560 msgr2=0x7fd68006b220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T02:12:36.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.926+0000 7fd6849e7640 1 -- 172.21.15.50:0/3123759976 shutdown_connections 2024-04-01T02:12:36.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.926+0000 7fd6849e7640 1 -- 172.21.15.50:0/3123759976 wait complete. 2024-04-01T02:12:36.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.926+0000 7fd6849e7640 1 Processor -- start 2024-04-01T02:12:36.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.926+0000 7fd6849e7640 1 -- start start 2024-04-01T02:12:36.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.926+0000 7fd6849e7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6800c73a0 0x7fd6801efe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:36.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.926+0000 7fd6849e7640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd680150e60 0x7fd6801f3e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:36.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.926+0000 7fd6849e7640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd680152ff0 0x7fd68014f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:36.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.926+0000 7fd6849e7640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd68015a2f0 con 0x7fd6800c73a0 2024-04-01T02:12:36.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.926+0000 7fd6849e7640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fd680157580 con 0x7fd680152ff0 2024-04-01T02:12:36.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.926+0000 7fd6849e7640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fd68015a470 con 0x7fd680150e60 2024-04-01T02:12:36.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.926+0000 7fd67e59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6800c73a0 0x7fd6801efe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:36.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.926+0000 7fd67e59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6800c73a0 0x7fd6801efe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34520/0 (socket says 172.21.15.50:34520) 2024-04-01T02:12:36.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.926+0000 7fd67e59c640 1 -- 172.21.15.50:0/2320542243 learned_addr learned my addr 172.21.15.50:0/2320542243 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T02:12:36.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.926+0000 7fd67dd9b640 1 --2- 172.21.15.50:0/2320542243 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd680150e60 0x7fd6801f3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:36.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.926+0000 7fd67ed9d640 1 --2- 172.21.15.50:0/2320542243 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd680152ff0 0x7fd68014f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:36.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.926+0000 7fd67e59c640 1 -- 172.21.15.50:0/2320542243 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd680150e60 msgr2=0x7fd6801f3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:36.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.926+0000 7fd67e59c640 1 --2- 172.21.15.50:0/2320542243 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd680150e60 0x7fd6801f3e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:36.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.926+0000 7fd67e59c640 1 -- 172.21.15.50:0/2320542243 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd680152ff0 msgr2=0x7fd68014f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:36.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.926+0000 7fd67e59c640 1 --2- 172.21.15.50:0/2320542243 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd680152ff0 0x7fd68014f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:36.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.926+0000 7fd67e59c640 1 -- 172.21.15.50:0/2320542243 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd680152440 con 0x7fd6800c73a0 2024-04-01T02:12:36.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.926+0000 7fd67ed9d640 1 --2- 172.21.15.50:0/2320542243 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd680152ff0 0x7fd68014f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T02:12:36.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.926+0000 7fd67e59c640 1 --2- 172.21.15.50:0/2320542243 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6800c73a0 0x7fd6801efe00 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd67000c370 tx=0x7fd67000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:12:36.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.926+0000 7fd66effd640 1 -- 172.21.15.50:0/2320542243 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd670017070 con 0x7fd6800c73a0 2024-04-01T02:12:36.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.930+0000 7fd66effd640 1 -- 172.21.15.50:0/2320542243 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd670005cf0 con 0x7fd6800c73a0 2024-04-01T02:12:36.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.930+0000 7fd6849e7640 1 -- 172.21.15.50:0/2320542243 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6801f3370 con 0x7fd6800c73a0 2024-04-01T02:12:36.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.930+0000 7fd66effd640 1 -- 172.21.15.50:0/2320542243 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6700072f0 con 0x7fd6800c73a0 2024-04-01T02:12:36.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.930+0000 7fd6849e7640 1 -- 172.21.15.50:0/2320542243 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6801529e0 con 0x7fd6800c73a0 2024-04-01T02:12:36.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.930+0000 7fd6849e7640 1 -- 172.21.15.50:0/2320542243 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd680068230 con 0x7fd6800c73a0 2024-04-01T02:12:36.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.930+0000 7fd66effd640 1 -- 172.21.15.50:0/2320542243 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 87103+0+0 (secure 0 0 0) 0x7fd67001a070 con 0x7fd6800c73a0 2024-04-01T02:12:36.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.930+0000 7fd66effd640 1 --2- 172.21.15.50:0/2320542243 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fd660067450 0x7fd660069910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:36.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.930+0000 7fd66effd640 1 -- 172.21.15.50:0/2320542243 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5738+0+0 (secure 0 0 0) 0x7fd670084930 con 0x7fd6800c73a0 2024-04-01T02:12:36.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.930+0000 7fd67dd9b640 1 --2- 172.21.15.50:0/2320542243 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fd660067450 0x7fd660069910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:36.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.930+0000 7fd67dd9b640 1 --2- 172.21.15.50:0/2320542243 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fd660067450 0x7fd660069910 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd6740b2000 tx=0x7fd674008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:12:36.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:36.934+0000 7fd66effd640 1 -- 172.21.15.50:0/2320542243 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+176632 (secure 0 0 0) 0x7fd670055060 con 0x7fd6800c73a0 2024-04-01T02:12:37.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.094+0000 7fd6849e7640 1 -- 172.21.15.50:0/2320542243 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd6800712b0 con 0x7fd6800c73a0 2024-04-01T02:12:37.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.098+0000 7fd66effd640 1 -- 172.21.15.50:0/2320542243 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16574 (secure 0 0 0) 0x7fd670059100 con 0x7fd6800c73a0 2024-04-01T02:12:37.094 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-01T02:12:37.095 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":23,"fsid":"f67878a9-bc75-426b-962d-fa7bc2517f7d","created":"2024-04-01T01:55:31.562371+0000","modified":"2024-04-01T01:56:37.409424+0000","last_up_change":"2024-04-01T01:55:42.134502+0000","last_in_change":"2024-04-01T01:55:33.849789+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-01T01:55:42.134418+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-01T01:55:47.009880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-01T01:55:47.551516+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"81e8ca4f-bde8-419a-875f-73a1f4a641ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":4170468134},{"type":"v1","addr":"172.21.15.50:6825","nonce":4170468134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":4170468134},{"type":"v1","addr":"172.21.15.50:6827","nonce":4170468134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":4170468134},{"type":"v1","addr":"172.21.15.50:6831","nonce":4170468134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":4170468134},{"type":"v1","addr":"172.21.15.50:6829","nonce":4170468134}]},"public_addr":"172.21.15.50:6825/4170468134","cluster_addr":"172.21.15.50:6827/4170468134","heartbeat_back_addr":"172.21.15.50:6831/4170468134","heartbeat_front_addr":"172.21.15.50:6829/4170468134","state":["exists","up"]},{"osd":1,"uuid":"bd060ca0-7559-4d30-987c-62e59818431d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1794491326},{"type":"v1","addr":"172.21.15.50:6809","nonce":1794491326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1794491326},{"type":"v1","addr":"172.21.15.50:6811","nonce":1794491326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1794491326},{"type":"v1","addr":"172.21.15.50:6815","nonce":1794491326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1794491326},{"type":"v1","addr":"172.21.15.50:6813","nonce":1794491326}]},"public_addr":"172.21.15.50:6809/1794491326","cluster_addr":"172.21.15.50:6811/1794491326","heartbeat_back_addr":"172.21.15.50:6815/1794491326","heartbeat_front_addr":"172.21.15.50:6813/1794491326","state":["exists","up"]},{"osd":2,"uuid":"eac5d816-a281-4acd-aa7d-b96a8e0aa962","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":710247177},{"type":"v1","addr":"172.21.15.50:6801","nonce":710247177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":710247177},{"type":"v1","addr":"172.21.15.50:6803","nonce":710247177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":710247177},{"type":"v1","addr":"172.21.15.50:6807","nonce":710247177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":710247177},{"type":"v1","addr":"172.21.15.50:6805","nonce":710247177}]},"public_addr":"172.21.15.50:6801/710247177","cluster_addr":"172.21.15.50:6803/710247177","heartbeat_back_addr":"172.21.15.50:6807/710247177","heartbeat_front_addr":"172.21.15.50:6805/710247177","state":["exists","up"]},{"osd":3,"uuid":"12b23968-04a7-40b8-98c4-02b16ae28265","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":871680805},{"type":"v1","addr":"172.21.15.50:6817","nonce":871680805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":871680805},{"type":"v1","addr":"172.21.15.50:6819","nonce":871680805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":871680805},{"type":"v1","addr":"172.21.15.50:6823","nonce":871680805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":871680805},{"type":"v1","addr":"172.21.15.50:6821","nonce":871680805}]},"public_addr":"172.21.15.50:6817/871680805","cluster_addr":"172.21.15.50:6819/871680805","heartbeat_back_addr":"172.21.15.50:6823/871680805","heartbeat_front_addr":"172.21.15.50:6821/871680805","state":["exists","up"]},{"osd":4,"uuid":"0e6b1639-23b0-47d9-8b08-40c8ab6df818","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":1095319381},{"type":"v1","addr":"172.21.15.97:6801","nonce":1095319381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":1095319381},{"type":"v1","addr":"172.21.15.97:6803","nonce":1095319381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":1095319381},{"type":"v1","addr":"172.21.15.97:6807","nonce":1095319381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":1095319381},{"type":"v1","addr":"172.21.15.97:6805","nonce":1095319381}]},"public_addr":"172.21.15.97:6801/1095319381","cluster_addr":"172.21.15.97:6803/1095319381","heartbeat_back_addr":"172.21.15.97:6807/1095319381","heartbeat_front_addr":"172.21.15.97:6805/1095319381","state":["exists","up"]},{"osd":5,"uuid":"f0f876ef-0823-46e9-8fe4-9b7a64a94cee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":899031308},{"type":"v1","addr":"172.21.15.97:6817","nonce":899031308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":899031308},{"type":"v1","addr":"172.21.15.97:6819","nonce":899031308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":899031308},{"type":"v1","addr":"172.21.15.97:6823","nonce":899031308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":899031308},{"type":"v1","addr":"172.21.15.97:6821","nonce":899031308}]},"public_addr":"172.21.15.97:6817/899031308","cluster_addr":"172.21.15.97:6819/899031308","heartbeat_back_addr":"172.21.15.97:6823/899031308","heartbeat_front_addr":"172.21.15.97:6821/899031308","state":["exists","up"]},{"osd":6,"uuid":"d29a625e-83bf-40ef-a57e-618220b96b9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2224814961},{"type":"v1","addr":"172.21.15.97:6825","nonce":2224814961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2224814961},{"type":"v1","addr":"172.21.15.97:6827","nonce":2224814961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2224814961},{"type":"v1","addr":"172.21.15.97:6831","nonce":2224814961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2224814961},{"type":"v1","addr":"172.21.15.97:6829","nonce":2224814961}]},"public_addr":"172.21.15.97:6825/2224814961","cluster_addr":"172.21.15.97:6827/2224814961","heartbeat_back_addr":"172.21.15.97:6831/2224814961","heartbeat_front_addr":"172.21.15.97:6829/2224814961","state":["exists","up"]},{"osd":7,"uuid":"7bcfd8f1-7dc0-4013-af17-16da5a8d931d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":284968823},{"type":"v1","addr":"172.21.15.97:6809","nonce":284968823}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":284968823},{"type":"v1","addr":"172.21.15.97:6811","nonce":284968823}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6814","nonce":284968823},{"type":"v1","addr":"172.21.15.97:6815","nonce":284968823}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":284968823},{"type":"v1","addr":"172.21.15.97:6813","nonce":284968823}]},"public_addr":"172.21.15.97:6809/284968823","cluster_addr":"172.21.15.97:6811/284968823","heartbeat_back_addr":"172.21.15.97:6815/284968823","heartbeat_front_addr":"172.21.15.97:6813/284968823","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T01:55:39.369550+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T01:55:39.367285+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T01:55:39.458393+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T01:55:39.456179+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T01:55:39.463649+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T01:55:38.728924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T01:55:39.522411+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T01:55:39.432081+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.36","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-01T02:12:37.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.098+0000 7fd6849e7640 1 -- 172.21.15.50:0/2320542243 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fd660067450 msgr2=0x7fd660069910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:37.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.098+0000 7fd6849e7640 1 --2- 172.21.15.50:0/2320542243 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fd660067450 0x7fd660069910 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd6740b2000 tx=0x7fd674008040 comp rx=0 tx=0).stop 2024-04-01T02:12:37.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.098+0000 7fd6849e7640 1 -- 172.21.15.50:0/2320542243 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6800c73a0 msgr2=0x7fd6801efe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:37.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.098+0000 7fd6849e7640 1 --2- 172.21.15.50:0/2320542243 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6800c73a0 0x7fd6801efe00 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd67000c370 tx=0x7fd67000c830 comp rx=0 tx=0).stop 2024-04-01T02:12:37.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.098+0000 7fd6849e7640 1 -- 172.21.15.50:0/2320542243 shutdown_connections 2024-04-01T02:12:37.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.098+0000 7fd6849e7640 1 --2- 172.21.15.50:0/2320542243 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fd660067450 0x7fd660069910 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:37.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.098+0000 7fd6849e7640 1 --2- 172.21.15.50:0/2320542243 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd680152ff0 0x7fd68014f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:37.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.098+0000 7fd6849e7640 1 --2- 172.21.15.50:0/2320542243 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd680150e60 0x7fd6801f3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:37.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.098+0000 7fd6849e7640 1 --2- 172.21.15.50:0/2320542243 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6800c73a0 0x7fd6801efe00 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:37.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.098+0000 7fd6849e7640 1 -- 172.21.15.50:0/2320542243 >> 172.21.15.50:0/2320542243 conn(0x7fd680067560 msgr2=0x7fd6800c6200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T02:12:37.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.098+0000 7fd6849e7640 1 -- 172.21.15.50:0/2320542243 shutdown_connections 2024-04-01T02:12:37.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.098+0000 7fd6849e7640 1 -- 172.21.15.50:0/2320542243 wait complete. 2024-04-01T02:12:37.114 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-01T01:55:42.134418+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-01T01:55:47.009880+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-01T01:55:47.551516+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-01T02:12:37.114 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-01T02:12:37.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.234+0000 7fd15b047640 1 Processor -- start 2024-04-01T02:12:37.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.234+0000 7fd15b047640 1 -- start start 2024-04-01T02:12:37.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.234+0000 7fd15b047640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fd154152000 0x7fd1540c8090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:37.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.234+0000 7fd15b047640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1540c9240 con 0x7fd1540c3b70 2024-04-01T02:12:37.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.234+0000 7fd15b047640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1541523e0 con 0x7fd154157cf0 2024-04-01T02:12:37.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.234+0000 7fd15b047640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fd15415b2c0 con 0x7fd154152000 2024-04-01T02:12:37.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.234+0000 7fd153fff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fd1540c3b70 0x7fd15415ba30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:51692/0 (socket says 172.21.15.50:51692) 2024-04-01T02:12:37.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.234+0000 7fd153fff640 1 -- 172.21.15.50:0/1297476544 learned_addr learned my addr 172.21.15.50:0/1297476544 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-04-01T02:12:37.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.234+0000 7fd1537fe640 1 -- 172.21.15.50:0/1297476544 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2407902527 0 0) 0x7fd1540c9240 con 0x7fd1540c3b70 2024-04-01T02:12:37.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.234+0000 7fd158de3640 1 --2- 172.21.15.50:0/1297476544 >> v2:172.21.15.97:3300/0 conn(0x7fd154152000 0x7fd1540c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:37.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.234+0000 7fd1537fe640 1 -- 172.21.15.50:0/1297476544 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd13c003530 con 0x7fd1540c3b70 2024-04-01T02:12:37.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.234+0000 7fd1537fe640 1 -- 172.21.15.50:0/1297476544 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1845936074 0 0) 0x7fd13c003530 con 0x7fd1540c3b70 2024-04-01T02:12:37.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.234+0000 7fd1537fe640 1 -- 172.21.15.50:0/1297476544 >> v2:172.21.15.97:3300/0 conn(0x7fd154152000 msgr2=0x7fd1540c8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T02:12:37.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.234+0000 7fd1537fe640 1 --2- 172.21.15.50:0/1297476544 >> v2:172.21.15.97:3300/0 conn(0x7fd154152000 0x7fd1540c8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:37.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.234+0000 7fd1537fe640 1 -- 172.21.15.50:0/1297476544 >> v1:172.21.15.97:6789/0 conn(0x7fd154157cf0 legacy=0x7fd1540c3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:37.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.234+0000 7fd1537fe640 1 -- 172.21.15.50:0/1297476544 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd154158250 con 0x7fd1540c3b70 2024-04-01T02:12:37.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.234+0000 7fd1537fe640 1 -- 172.21.15.50:0/1297476544 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2779672543 0 0) 0x7fd144001680 con 0x7fd1540c3b70 2024-04-01T02:12:37.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.234+0000 7fd158de3640 1 --2- 172.21.15.50:0/1297476544 >> v2:172.21.15.97:3300/0 conn(0x7fd154152000 0x7fd1540c8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T02:12:37.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.234+0000 7fd1537fe640 1 -- 172.21.15.50:0/1297476544 >> v1:172.21.15.50:6789/0 conn(0x7fd1540c3b70 legacy=0x7fd15415ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:37.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.234+0000 7fd1537fe640 1 --2- 172.21.15.50:0/1297476544 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd13c0039c0 0x7fd13c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:37.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.234+0000 7fd1537fe640 1 --2- 172.21.15.50:0/1297476544 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd13c004810 0x7fd13c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:37.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.234+0000 7fd1537fe640 1 --2- 172.21.15.50:0/1297476544 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd13c0051d0 0x7fd13c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:37.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.234+0000 7fd1537fe640 1 -- 172.21.15.50:0/1297476544 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd15415b2c0 con 0x7fd13c004810 2024-04-01T02:12:37.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.234+0000 7fd1537fe640 1 -- 172.21.15.50:0/1297476544 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fd13c00c120 con 0x7fd13c0051d0 2024-04-01T02:12:37.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.234+0000 7fd1537fe640 1 -- 172.21.15.50:0/1297476544 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fd13c00c320 con 0x7fd13c0039c0 2024-04-01T02:12:37.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.234+0000 7fd153fff640 1 --2- 172.21.15.50:0/1297476544 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd13c004810 0x7fd13c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:37.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.234+0000 7fd158de3640 1 --2- 172.21.15.50:0/1297476544 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd13c0039c0 0x7fd13c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:37.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.234+0000 7fd1595e4640 1 --2- 172.21.15.50:0/1297476544 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd13c0051d0 0x7fd13c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:37.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.234+0000 7fd153fff640 1 -- 172.21.15.50:0/1297476544 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd13c0039c0 msgr2=0x7fd13c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T02:12:37.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.234+0000 7fd153fff640 1 --2- 172.21.15.50:0/1297476544 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd13c0039c0 0x7fd13c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:37.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.234+0000 7fd153fff640 1 -- 172.21.15.50:0/1297476544 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd13c0051d0 msgr2=0x7fd13c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T02:12:37.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.234+0000 7fd153fff640 1 --2- 172.21.15.50:0/1297476544 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd13c0051d0 0x7fd13c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:37.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.234+0000 7fd153fff640 1 -- 172.21.15.50:0/1297476544 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd13c003530 con 0x7fd13c004810 2024-04-01T02:12:37.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.234+0000 7fd1595e4640 1 -- 172.21.15.50:0/1297476544 reap_dead start 2024-04-01T02:12:37.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.238+0000 7fd153fff640 1 --2- 172.21.15.50:0/1297476544 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd13c004810 0x7fd13c004c90 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd14400c240 tx=0x7fd14401f3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=331ede08128afe0c server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:12:37.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.238+0000 7fd1537fe640 1 -- 172.21.15.50:0/1297476544 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd144007d20 con 0x7fd13c004810 2024-04-01T02:12:37.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.238+0000 7fd1537fe640 1 -- 172.21.15.50:0/1297476544 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd144005ae0 con 0x7fd13c004810 2024-04-01T02:12:37.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.238+0000 7fd1537fe640 1 -- 172.21.15.50:0/1297476544 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd144007070 con 0x7fd13c004810 2024-04-01T02:12:37.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.238+0000 7fd15b047640 1 -- 172.21.15.50:0/1297476544 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd13c004810 msgr2=0x7fd13c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:37.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.238+0000 7fd15b047640 1 --2- 172.21.15.50:0/1297476544 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd13c004810 0x7fd13c004c90 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd14400c240 tx=0x7fd14401f3f0 comp rx=0 tx=0).stop 2024-04-01T02:12:37.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.238+0000 7fd15b047640 1 -- 172.21.15.50:0/1297476544 shutdown_connections 2024-04-01T02:12:37.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.238+0000 7fd15b047640 1 --2- 172.21.15.50:0/1297476544 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd13c004810 0x7fd13c004c90 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:37.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.238+0000 7fd15b047640 1 -- 172.21.15.50:0/1297476544 >> 172.21.15.50:0/1297476544 conn(0x7fd1540710f0 msgr2=0x7fd154071500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T02:12:37.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.238+0000 7fd15b047640 1 -- 172.21.15.50:0/1297476544 shutdown_connections 2024-04-01T02:12:37.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.238+0000 7fd15b047640 1 -- 172.21.15.50:0/1297476544 wait complete. 2024-04-01T02:12:37.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.238+0000 7fd15b047640 1 Processor -- start 2024-04-01T02:12:37.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.238+0000 7fd15b047640 1 -- start start 2024-04-01T02:12:37.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.242+0000 7fd15b047640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd13c004810 0x7fd1541ed4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:37.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.242+0000 7fd15b047640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd154153c00 0x7fd1540cdea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:37.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.242+0000 7fd15b047640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd1540cd6f0 0x7fd154152620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:37.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.242+0000 7fd15b047640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd154158af0 con 0x7fd13c004810 2024-04-01T02:12:37.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.242+0000 7fd15b047640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fd154158810 con 0x7fd1540cd6f0 2024-04-01T02:12:37.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.242+0000 7fd15b047640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fd15415b510 con 0x7fd154153c00 2024-04-01T02:12:37.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.242+0000 7fd158de3640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd13c004810 0x7fd1541ed4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:37.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.242+0000 7fd158de3640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd13c004810 0x7fd1541ed4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34532/0 (socket says 172.21.15.50:34532) 2024-04-01T02:12:37.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.242+0000 7fd158de3640 1 -- 172.21.15.50:0/529889488 learned_addr learned my addr 172.21.15.50:0/529889488 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T02:12:37.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.242+0000 7fd1595e4640 1 --2- 172.21.15.50:0/529889488 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd1540cd6f0 0x7fd154152620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:37.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.242+0000 7fd153fff640 1 --2- 172.21.15.50:0/529889488 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd154153c00 0x7fd1540cdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:37.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.242+0000 7fd158de3640 1 -- 172.21.15.50:0/529889488 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd154153c00 msgr2=0x7fd1540cdea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:37.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.242+0000 7fd158de3640 1 --2- 172.21.15.50:0/529889488 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd154153c00 0x7fd1540cdea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:37.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.242+0000 7fd158de3640 1 -- 172.21.15.50:0/529889488 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd1540cd6f0 msgr2=0x7fd154152620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:37.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.242+0000 7fd158de3640 1 --2- 172.21.15.50:0/529889488 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd1540cd6f0 0x7fd154152620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:37.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.242+0000 7fd158de3640 1 -- 172.21.15.50:0/529889488 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd154159db0 con 0x7fd13c004810 2024-04-01T02:12:37.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.242+0000 7fd158de3640 1 --2- 172.21.15.50:0/529889488 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd13c004810 0x7fd1541ed4c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd148010840 tx=0x7fd148010d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:12:37.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.242+0000 7fd1517fa640 1 -- 172.21.15.50:0/529889488 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd14801a020 con 0x7fd13c004810 2024-04-01T02:12:37.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.242+0000 7fd1517fa640 1 -- 172.21.15.50:0/529889488 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd14800eb60 con 0x7fd13c004810 2024-04-01T02:12:37.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.242+0000 7fd1517fa640 1 -- 172.21.15.50:0/529889488 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd14800f040 con 0x7fd13c004810 2024-04-01T02:12:37.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.242+0000 7fd15b047640 1 -- 172.21.15.50:0/529889488 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd15415a090 con 0x7fd13c004810 2024-04-01T02:12:37.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.242+0000 7fd15b047640 1 -- 172.21.15.50:0/529889488 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd15415a650 con 0x7fd13c004810 2024-04-01T02:12:37.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.242+0000 7fd15b047640 1 -- 172.21.15.50:0/529889488 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd154068230 con 0x7fd13c004810 2024-04-01T02:12:37.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.242+0000 7fd1517fa640 1 -- 172.21.15.50:0/529889488 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 87103+0+0 (secure 0 0 0) 0x7fd14801d020 con 0x7fd13c004810 2024-04-01T02:12:37.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.242+0000 7fd1517fa640 1 --2- 172.21.15.50:0/529889488 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fd140067450 0x7fd140069910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:37.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.242+0000 7fd1517fa640 1 -- 172.21.15.50:0/529889488 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5738+0+0 (secure 0 0 0) 0x7fd148085fd0 con 0x7fd13c004810 2024-04-01T02:12:37.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.242+0000 7fd153fff640 1 --2- 172.21.15.50:0/529889488 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fd140067450 0x7fd140069910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:37.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.242+0000 7fd153fff640 1 --2- 172.21.15.50:0/529889488 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fd140067450 0x7fd140069910 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd1440af000 tx=0x7fd1440aa000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:12:37.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.246+0000 7fd1517fa640 1 -- 172.21.15.50:0/529889488 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+176632 (secure 0 0 0) 0x7fd148024020 con 0x7fd13c004810 2024-04-01T02:12:37.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.406+0000 7fd15b047640 1 -- 172.21.15.50:0/529889488 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fd1541e3820 con 0x7fd13c004810 2024-04-01T02:12:37.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.406+0000 7fd1517fa640 1 -- 172.21.15.50:0/529889488 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) ==== 93+0+10 (secure 0 0 0) 0x7fd148056d40 con 0x7fd13c004810 2024-04-01T02:12:37.405 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2024-04-01T02:12:37.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.410+0000 7fd15b047640 1 -- 172.21.15.50:0/529889488 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fd140067450 msgr2=0x7fd140069910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:37.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.410+0000 7fd15b047640 1 --2- 172.21.15.50:0/529889488 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fd140067450 0x7fd140069910 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd1440af000 tx=0x7fd1440aa000 comp rx=0 tx=0).stop 2024-04-01T02:12:37.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.410+0000 7fd15b047640 1 -- 172.21.15.50:0/529889488 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd13c004810 msgr2=0x7fd1541ed4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:37.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.410+0000 7fd15b047640 1 --2- 172.21.15.50:0/529889488 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd13c004810 0x7fd1541ed4c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd148010840 tx=0x7fd148010d00 comp rx=0 tx=0).stop 2024-04-01T02:12:37.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.410+0000 7fd15b047640 1 -- 172.21.15.50:0/529889488 shutdown_connections 2024-04-01T02:12:37.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.410+0000 7fd15b047640 1 --2- 172.21.15.50:0/529889488 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fd140067450 0x7fd140069910 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:37.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.410+0000 7fd15b047640 1 --2- 172.21.15.50:0/529889488 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd1540cd6f0 0x7fd154152620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:37.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.410+0000 7fd15b047640 1 --2- 172.21.15.50:0/529889488 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd154153c00 0x7fd1540cdea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:37.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.410+0000 7fd15b047640 1 --2- 172.21.15.50:0/529889488 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd13c004810 0x7fd1541ed4c0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:37.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.410+0000 7fd15b047640 1 -- 172.21.15.50:0/529889488 >> 172.21.15.50:0/529889488 conn(0x7fd1540710f0 msgr2=0x7fd1541513c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T02:12:37.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.410+0000 7fd15b047640 1 -- 172.21.15.50:0/529889488 shutdown_connections 2024-04-01T02:12:37.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.410+0000 7fd15b047640 1 -- 172.21.15.50:0/529889488 wait complete. 2024-04-01T02:12:37.422 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-01T02:12:37.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.554+0000 7f14e7768640 1 Processor -- start 2024-04-01T02:12:37.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.554+0000 7f14e7768640 1 -- start start 2024-04-01T02:12:37.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.558+0000 7f14e7768640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f14e00c5d80 0x7f14e006fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:37.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.558+0000 7f14e7768640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14e0157e80 con 0x7f14e00c6160 2024-04-01T02:12:37.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.558+0000 7f14e7768640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14e0158120 con 0x7f14e00ccd60 2024-04-01T02:12:37.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.558+0000 7f14e7768640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f14e0158400 con 0x7f14e00c5d80 2024-04-01T02:12:37.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.558+0000 7f14e4d03640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f14e00c6160 0x7f14e015b360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:51700/0 (socket says 172.21.15.50:51700) 2024-04-01T02:12:37.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.558+0000 7f14e4d03640 1 -- 172.21.15.50:0/880688883 learned_addr learned my addr 172.21.15.50:0/880688883 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-04-01T02:12:37.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.558+0000 7f14e5504640 1 --2- 172.21.15.50:0/880688883 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f14e00c5d80 0x7f14e006fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:37.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.558+0000 7f14d7fff640 1 -- 172.21.15.50:0/880688883 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3174569973 0 0) 0x7f14e0157e80 con 0x7f14e00c6160 2024-04-01T02:12:37.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.558+0000 7f14d7fff640 1 -- 172.21.15.50:0/880688883 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f14cc003530 con 0x7f14e00c6160 2024-04-01T02:12:37.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.558+0000 7f14d7fff640 1 -- 172.21.15.50:0/880688883 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1629828901 0 0) 0x7f14e0158120 con 0x7f14e00ccd60 2024-04-01T02:12:37.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.558+0000 7f14d7fff640 1 -- 172.21.15.50:0/880688883 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f14e0157e80 con 0x7f14e00ccd60 2024-04-01T02:12:37.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.558+0000 7f14e5504640 1 -- 172.21.15.50:0/880688883 >> v1:172.21.15.97:6789/0 conn(0x7f14e00ccd60 legacy=0x7f14e014e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:37.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.558+0000 7f14e5504640 1 -- 172.21.15.50:0/880688883 >> v1:172.21.15.50:6789/0 conn(0x7f14e00c6160 legacy=0x7f14e015b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:37.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.558+0000 7f14e5504640 1 -- 172.21.15.50:0/880688883 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14e01586e0 con 0x7f14e00c5d80 2024-04-01T02:12:37.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.562+0000 7f14e5504640 1 --2- 172.21.15.50:0/880688883 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f14e00c5d80 0x7f14e006fe20 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f14dc0097f0 tx=0x7f14dc01ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e6e562b21ff4712 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:12:37.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.562+0000 7f14d7fff640 1 -- 172.21.15.50:0/880688883 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14dc0b5070 con 0x7f14e00c5d80 2024-04-01T02:12:37.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.562+0000 7f14d7fff640 1 -- 172.21.15.50:0/880688883 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14dc0a8990 con 0x7f14e00c5d80 2024-04-01T02:12:37.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.562+0000 7f14d7fff640 1 -- 172.21.15.50:0/880688883 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14dc0a8d60 con 0x7f14e00c5d80 2024-04-01T02:12:37.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.562+0000 7f14e7768640 1 -- 172.21.15.50:0/880688883 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f14e00c5d80 msgr2=0x7f14e006fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:37.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.562+0000 7f14e7768640 1 --2- 172.21.15.50:0/880688883 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f14e00c5d80 0x7f14e006fe20 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f14dc0097f0 tx=0x7f14dc01ec90 comp rx=0 tx=0).stop 2024-04-01T02:12:37.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.562+0000 7f14e7768640 1 -- 172.21.15.50:0/880688883 shutdown_connections 2024-04-01T02:12:37.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.562+0000 7f14e7768640 1 --2- 172.21.15.50:0/880688883 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f14e00c5d80 0x7f14e006fe20 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:37.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.562+0000 7f14e7768640 1 -- 172.21.15.50:0/880688883 >> 172.21.15.50:0/880688883 conn(0x7f14e006c330 msgr2=0x7f14e006c740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T02:12:37.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.562+0000 7f14e7768640 1 -- 172.21.15.50:0/880688883 shutdown_connections 2024-04-01T02:12:37.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.562+0000 7f14e7768640 1 -- 172.21.15.50:0/880688883 wait complete. 2024-04-01T02:12:37.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.562+0000 7f14e7768640 1 Processor -- start 2024-04-01T02:12:37.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.562+0000 7f14e7768640 1 -- start start 2024-04-01T02:12:37.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.562+0000 7f14e7768640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14e00c5d80 0x7f14e01e3330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:37.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.562+0000 7f14e7768640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f14e00c6160 0x7f14e00c81b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:37.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.562+0000 7f14e7768640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f14e00ccd60 0x7f14e00c86f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:37.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.562+0000 7f14e7768640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f14e015bbf0 con 0x7f14e00c5d80 2024-04-01T02:12:37.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.562+0000 7f14e7768640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f14e015ba70 con 0x7f14e00c6160 2024-04-01T02:12:37.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.562+0000 7f14e7768640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f14e01e4050 con 0x7f14e00ccd60 2024-04-01T02:12:37.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.562+0000 7f14e5504640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14e00c5d80 0x7f14e01e3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:37.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.562+0000 7f14e5504640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14e00c5d80 0x7f14e01e3330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34536/0 (socket says 172.21.15.50:34536) 2024-04-01T02:12:37.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.562+0000 7f14e5504640 1 -- 172.21.15.50:0/322089586 learned_addr learned my addr 172.21.15.50:0/322089586 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T02:12:37.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.562+0000 7f14e4d03640 1 --2- 172.21.15.50:0/322089586 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f14e00c6160 0x7f14e00c81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:37.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.562+0000 7f14e5d05640 1 --2- 172.21.15.50:0/322089586 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f14e00ccd60 0x7f14e00c86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:37.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.566+0000 7f14e5504640 1 -- 172.21.15.50:0/322089586 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f14e00ccd60 msgr2=0x7f14e00c86f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:37.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.566+0000 7f14e5504640 1 --2- 172.21.15.50:0/322089586 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f14e00ccd60 0x7f14e00c86f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:37.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.566+0000 7f14e5504640 1 -- 172.21.15.50:0/322089586 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f14e00c6160 msgr2=0x7f14e00c81b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:37.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.566+0000 7f14e5504640 1 --2- 172.21.15.50:0/322089586 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f14e00c6160 0x7f14e00c81b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:37.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.566+0000 7f14e5504640 1 -- 172.21.15.50:0/322089586 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14e00c7cd0 con 0x7f14e00c5d80 2024-04-01T02:12:37.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.566+0000 7f14e5504640 1 --2- 172.21.15.50:0/322089586 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14e00c5d80 0x7f14e01e3330 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f14dc009740 tx=0x7f14dc01ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:12:37.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.566+0000 7f14d5ffb640 1 -- 172.21.15.50:0/322089586 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14dc0bf070 con 0x7f14e00c5d80 2024-04-01T02:12:37.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.566+0000 7f14d5ffb640 1 -- 172.21.15.50:0/322089586 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14dc0b0700 con 0x7f14e00c5d80 2024-04-01T02:12:37.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.566+0000 7f14e7768640 1 -- 172.21.15.50:0/322089586 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14e01e3d70 con 0x7f14e00c5d80 2024-04-01T02:12:37.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.566+0000 7f14d5ffb640 1 -- 172.21.15.50:0/322089586 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14dc0b5040 con 0x7f14e00c5d80 2024-04-01T02:12:37.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.566+0000 7f14e7768640 1 -- 172.21.15.50:0/322089586 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14e01ee8d0 con 0x7f14e00c5d80 2024-04-01T02:12:37.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.566+0000 7f14e7768640 1 -- 172.21.15.50:0/322089586 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14e00c7ea0 con 0x7f14e00c5d80 2024-04-01T02:12:37.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.566+0000 7f14d5ffb640 1 -- 172.21.15.50:0/322089586 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 87103+0+0 (secure 0 0 0) 0x7f14dc0b0af0 con 0x7f14e00c5d80 2024-04-01T02:12:37.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.566+0000 7f14d5ffb640 1 --2- 172.21.15.50:0/322089586 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f14c4067450 0x7f14c4069910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:37.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.566+0000 7f14d5ffb640 1 -- 172.21.15.50:0/322089586 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5738+0+0 (secure 0 0 0) 0x7f14dc121bd0 con 0x7f14e00c5d80 2024-04-01T02:12:37.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.566+0000 7f14e4d03640 1 --2- 172.21.15.50:0/322089586 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f14c4067450 0x7f14c4069910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:37.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.566+0000 7f14e4d03640 1 --2- 172.21.15.50:0/322089586 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f14c4067450 0x7f14c4069910 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f14e014d700 tx=0x7f14d0007d40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:12:37.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.570+0000 7f14d5ffb640 1 -- 172.21.15.50:0/322089586 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+176632 (secure 0 0 0) 0x7f14dc0187f0 con 0x7f14e00c5d80 2024-04-01T02:12:37.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.730+0000 7f14e7768640 1 -- 172.21.15.50:0/322089586 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f14e01ee400 con 0x7f14e00c5d80 2024-04-01T02:12:37.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.730+0000 7f14d5ffb640 1 -- 172.21.15.50:0/322089586 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) ==== 104+0+11 (secure 0 0 0) 0x7f14dc0f2300 con 0x7f14e00c5d80 2024-04-01T02:12:37.728 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2024-04-01T02:12:37.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.734+0000 7f14e7768640 1 -- 172.21.15.50:0/322089586 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f14c4067450 msgr2=0x7f14c4069910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:37.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.734+0000 7f14e7768640 1 --2- 172.21.15.50:0/322089586 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f14c4067450 0x7f14c4069910 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f14e014d700 tx=0x7f14d0007d40 comp rx=0 tx=0).stop 2024-04-01T02:12:37.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.734+0000 7f14e7768640 1 -- 172.21.15.50:0/322089586 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14e00c5d80 msgr2=0x7f14e01e3330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:37.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.734+0000 7f14e7768640 1 --2- 172.21.15.50:0/322089586 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14e00c5d80 0x7f14e01e3330 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f14dc009740 tx=0x7f14dc01ba30 comp rx=0 tx=0).stop 2024-04-01T02:12:37.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.734+0000 7f14e7768640 1 -- 172.21.15.50:0/322089586 shutdown_connections 2024-04-01T02:12:37.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.734+0000 7f14e7768640 1 --2- 172.21.15.50:0/322089586 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f14c4067450 0x7f14c4069910 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:37.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.734+0000 7f14e7768640 1 --2- 172.21.15.50:0/322089586 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f14e00ccd60 0x7f14e00c86f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:37.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.734+0000 7f14e7768640 1 --2- 172.21.15.50:0/322089586 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f14e00c6160 0x7f14e00c81b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:37.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.734+0000 7f14e7768640 1 --2- 172.21.15.50:0/322089586 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14e00c5d80 0x7f14e01e3330 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:37.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.734+0000 7f14e7768640 1 -- 172.21.15.50:0/322089586 >> 172.21.15.50:0/322089586 conn(0x7f14e006c330 msgr2=0x7f14e0154670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T02:12:37.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.734+0000 7f14e7768640 1 -- 172.21.15.50:0/322089586 shutdown_connections 2024-04-01T02:12:37.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.734+0000 7f14e7768640 1 -- 172.21.15.50:0/322089586 wait complete. 2024-04-01T02:12:37.748 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-01T02:12:37.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.862+0000 7f8a29e6b640 1 Processor -- start 2024-04-01T02:12:37.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.862+0000 7f8a29e6b640 1 -- start start 2024-04-01T02:12:37.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.866+0000 7f8a29e6b640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8a24153ed0 0x7f8a2415a950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:37.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.866+0000 7f8a29e6b640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a2415d690 con 0x7f8a240cb880 2024-04-01T02:12:37.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.866+0000 7f8a29e6b640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a2415d970 con 0x7f8a240ca720 2024-04-01T02:12:37.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.866+0000 7f8a29e6b640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f8a2415dc50 con 0x7f8a24153ed0 2024-04-01T02:12:37.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.866+0000 7f8a1bfff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f8a240cb880 0x7f8a2406ce50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:33674/0 (socket says 172.21.15.50:33674) 2024-04-01T02:12:37.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.866+0000 7f8a1bfff640 1 -- 172.21.15.50:0/1560687320 learned_addr learned my addr 172.21.15.50:0/1560687320 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-04-01T02:12:37.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.866+0000 7f8a237fe640 1 --2- 172.21.15.50:0/1560687320 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8a24153ed0 0x7f8a2415a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:37.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.866+0000 7f8a22ffd640 1 -- 172.21.15.50:0/1560687320 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2532850901 0 0) 0x7f8a2415d690 con 0x7f8a240cb880 2024-04-01T02:12:37.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.866+0000 7f8a22ffd640 1 -- 172.21.15.50:0/1560687320 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8a10003530 con 0x7f8a240cb880 2024-04-01T02:12:37.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.866+0000 7f8a22ffd640 1 -- 172.21.15.50:0/1560687320 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2023051536 0 0) 0x7f8a10003530 con 0x7f8a240cb880 2024-04-01T02:12:37.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.866+0000 7f8a22ffd640 1 -- 172.21.15.50:0/1560687320 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8a24153ed0 msgr2=0x7f8a2415a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T02:12:37.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.866+0000 7f8a22ffd640 1 --2- 172.21.15.50:0/1560687320 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8a24153ed0 0x7f8a2415a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:37.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.866+0000 7f8a22ffd640 1 -- 172.21.15.50:0/1560687320 >> v1:172.21.15.97:6789/0 conn(0x7f8a240ca720 legacy=0x7f8a240cab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:37.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.866+0000 7f8a22ffd640 1 -- 172.21.15.50:0/1560687320 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a2415df30 con 0x7f8a240cb880 2024-04-01T02:12:37.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.866+0000 7f8a22ffd640 1 -- 172.21.15.50:0/1560687320 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2779672543 0 0) 0x7f8a0c001680 con 0x7f8a240cb880 2024-04-01T02:12:37.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.866+0000 7f8a22ffd640 1 -- 172.21.15.50:0/1560687320 >> v1:172.21.15.50:6789/0 conn(0x7f8a240cb880 legacy=0x7f8a2406ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:37.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.866+0000 7f8a22ffd640 1 --2- 172.21.15.50:0/1560687320 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a100039f0 0x7f8a10003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:37.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.866+0000 7f8a22ffd640 1 --2- 172.21.15.50:0/1560687320 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8a24153ed0 0x7f8a10004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:37.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.866+0000 7f8a22ffd640 1 --2- 172.21.15.50:0/1560687320 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8a10004d50 0x7f8a100051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:37.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.866+0000 7f8a22ffd640 1 -- 172.21.15.50:0/1560687320 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8a2415dc50 con 0x7f8a100039f0 2024-04-01T02:12:37.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.866+0000 7f8a22ffd640 1 -- 172.21.15.50:0/1560687320 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f8a1000b9d0 con 0x7f8a10004d50 2024-04-01T02:12:37.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.866+0000 7f8a22ffd640 1 -- 172.21.15.50:0/1560687320 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f8a1000bbd0 con 0x7f8a24153ed0 2024-04-01T02:12:37.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.866+0000 7f8a237fe640 1 --2- 172.21.15.50:0/1560687320 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a100039f0 0x7f8a10003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:37.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.866+0000 7f8a23fff640 1 --2- 172.21.15.50:0/1560687320 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8a10004d50 0x7f8a100051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:37.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.866+0000 7f8a1bfff640 1 --2- 172.21.15.50:0/1560687320 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8a24153ed0 0x7f8a10004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:37.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.866+0000 7f8a237fe640 1 -- 172.21.15.50:0/1560687320 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8a24153ed0 msgr2=0x7f8a10004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T02:12:37.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.866+0000 7f8a237fe640 1 --2- 172.21.15.50:0/1560687320 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8a24153ed0 0x7f8a10004810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:37.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.866+0000 7f8a237fe640 1 -- 172.21.15.50:0/1560687320 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8a10004d50 msgr2=0x7f8a100051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T02:12:37.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.866+0000 7f8a237fe640 1 --2- 172.21.15.50:0/1560687320 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8a10004d50 0x7f8a100051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:37.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.866+0000 7f8a237fe640 1 -- 172.21.15.50:0/1560687320 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a10003530 con 0x7f8a100039f0 2024-04-01T02:12:37.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.866+0000 7f8a23fff640 1 --2- 172.21.15.50:0/1560687320 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8a10004d50 0x7f8a100051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T02:12:37.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.866+0000 7f8a237fe640 1 --2- 172.21.15.50:0/1560687320 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a100039f0 0x7f8a10003dd0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f8a14009ae0 tx=0x7f8a1401c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba5679481d11f4c9 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:12:37.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.866+0000 7f8a22ffd640 1 -- 172.21.15.50:0/1560687320 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a140b2070 con 0x7f8a100039f0 2024-04-01T02:12:37.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.866+0000 7f8a22ffd640 1 -- 172.21.15.50:0/1560687320 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a140a55a0 con 0x7f8a100039f0 2024-04-01T02:12:37.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.866+0000 7f8a22ffd640 1 -- 172.21.15.50:0/1560687320 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a140096b0 con 0x7f8a100039f0 2024-04-01T02:12:37.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.870+0000 7f8a29e6b640 1 -- 172.21.15.50:0/1560687320 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a100039f0 msgr2=0x7f8a10003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:37.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.870+0000 7f8a29e6b640 1 --2- 172.21.15.50:0/1560687320 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a100039f0 0x7f8a10003dd0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f8a14009ae0 tx=0x7f8a1401c9b0 comp rx=0 tx=0).stop 2024-04-01T02:12:37.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.870+0000 7f8a23fff640 1 -- 172.21.15.50:0/1560687320 reap_dead start 2024-04-01T02:12:37.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.870+0000 7f8a29e6b640 1 -- 172.21.15.50:0/1560687320 shutdown_connections 2024-04-01T02:12:37.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.870+0000 7f8a29e6b640 1 -- 172.21.15.50:0/1560687320 >> 172.21.15.50:0/1560687320 conn(0x7f8a24072d50 msgr2=0x7f8a2406c310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T02:12:37.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.870+0000 7f8a29e6b640 1 -- 172.21.15.50:0/1560687320 shutdown_connections 2024-04-01T02:12:37.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.870+0000 7f8a29e6b640 1 -- 172.21.15.50:0/1560687320 wait complete. 2024-04-01T02:12:37.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.870+0000 7f8a29e6b640 1 Processor -- start 2024-04-01T02:12:37.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.870+0000 7f8a29e6b640 1 -- start start 2024-04-01T02:12:37.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.870+0000 7f8a29e6b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a100039f0 0x7f8a2414a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:37.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.870+0000 7f8a29e6b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8a24158ea0 0x7f8a24151e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:37.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.870+0000 7f8a29e6b640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8a24157e90 0x7f8a241523b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:37.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.870+0000 7f8a29e6b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8a2415d330 con 0x7f8a100039f0 2024-04-01T02:12:37.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.870+0000 7f8a29e6b640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f8a240ca200 con 0x7f8a24158ea0 2024-04-01T02:12:37.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.870+0000 7f8a29e6b640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f8a241542b0 con 0x7f8a24157e90 2024-04-01T02:12:37.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.870+0000 7f8a237fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a100039f0 0x7f8a2414a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:37.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.870+0000 7f8a1bfff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8a24158ea0 0x7f8a24151e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:37.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.870+0000 7f8a237fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a100039f0 0x7f8a2414a170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50774/0 (socket says 172.21.15.50:50774) 2024-04-01T02:12:37.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.870+0000 7f8a237fe640 1 -- 172.21.15.50:0/2319631317 learned_addr learned my addr 172.21.15.50:0/2319631317 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T02:12:37.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.870+0000 7f8a23fff640 1 --2- 172.21.15.50:0/2319631317 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8a24157e90 0x7f8a241523b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:37.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.870+0000 7f8a237fe640 1 -- 172.21.15.50:0/2319631317 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8a24157e90 msgr2=0x7f8a241523b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:37.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.870+0000 7f8a237fe640 1 --2- 172.21.15.50:0/2319631317 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8a24157e90 0x7f8a241523b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:37.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.870+0000 7f8a237fe640 1 -- 172.21.15.50:0/2319631317 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8a24158ea0 msgr2=0x7f8a24151e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:37.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.870+0000 7f8a237fe640 1 --2- 172.21.15.50:0/2319631317 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8a24158ea0 0x7f8a24151e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:37.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.870+0000 7f8a237fe640 1 -- 172.21.15.50:0/2319631317 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a2414ae70 con 0x7f8a100039f0 2024-04-01T02:12:37.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.870+0000 7f8a237fe640 1 --2- 172.21.15.50:0/2319631317 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a100039f0 0x7f8a2414a170 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f8a1401ce90 tx=0x7f8a10005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:12:37.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.870+0000 7f8a20ff9640 1 -- 172.21.15.50:0/2319631317 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a140b2040 con 0x7f8a100039f0 2024-04-01T02:12:37.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.870+0000 7f8a20ff9640 1 -- 172.21.15.50:0/2319631317 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a1400f000 con 0x7f8a100039f0 2024-04-01T02:12:37.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.870+0000 7f8a29e6b640 1 -- 172.21.15.50:0/2319631317 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a2414b460 con 0x7f8a100039f0 2024-04-01T02:12:37.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.870+0000 7f8a20ff9640 1 -- 172.21.15.50:0/2319631317 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a14004020 con 0x7f8a100039f0 2024-04-01T02:12:37.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.870+0000 7f8a29e6b640 1 -- 172.21.15.50:0/2319631317 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a24151950 con 0x7f8a100039f0 2024-04-01T02:12:37.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.874+0000 7f8a29e6b640 1 -- 172.21.15.50:0/2319631317 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a24068230 con 0x7f8a100039f0 2024-04-01T02:12:37.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.874+0000 7f8a20ff9640 1 -- 172.21.15.50:0/2319631317 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 87103+0+0 (secure 0 0 0) 0x7f8a140c0030 con 0x7f8a100039f0 2024-04-01T02:12:37.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.874+0000 7f8a20ff9640 1 --2- 172.21.15.50:0/2319631317 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f8a04067450 0x7f8a04069910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:37.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.874+0000 7f8a20ff9640 1 -- 172.21.15.50:0/2319631317 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5738+0+0 (secure 0 0 0) 0x7f8a1411f250 con 0x7f8a100039f0 2024-04-01T02:12:37.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.874+0000 7f8a1bfff640 1 --2- 172.21.15.50:0/2319631317 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f8a04067450 0x7f8a04069910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:37.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.874+0000 7f8a1bfff640 1 --2- 172.21.15.50:0/2319631317 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f8a04067450 0x7f8a04069910 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8a24151650 tx=0x7f8a0c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:12:37.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:37.878+0000 7f8a20ff9640 1 -- 172.21.15.50:0/2319631317 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+176632 (secure 0 0 0) 0x7f8a140c7060 con 0x7f8a100039f0 2024-04-01T02:12:38.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:38.030+0000 7f8a29e6b640 1 -- 172.21.15.50:0/2319631317 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f8a240b5240 con 0x7f8a100039f0 2024-04-01T02:12:38.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:38.034+0000 7f8a20ff9640 1 -- 172.21.15.50:0/2319631317 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) ==== 100+0+11 (secure 0 0 0) 0x7f8a140166c0 con 0x7f8a100039f0 2024-04-01T02:12:38.030 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2024-04-01T02:12:38.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:38.034+0000 7f8a29e6b640 1 -- 172.21.15.50:0/2319631317 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f8a04067450 msgr2=0x7f8a04069910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:38.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:38.034+0000 7f8a29e6b640 1 --2- 172.21.15.50:0/2319631317 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f8a04067450 0x7f8a04069910 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8a24151650 tx=0x7f8a0c009040 comp rx=0 tx=0).stop 2024-04-01T02:12:38.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:38.034+0000 7f8a29e6b640 1 -- 172.21.15.50:0/2319631317 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a100039f0 msgr2=0x7f8a2414a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:38.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:38.034+0000 7f8a29e6b640 1 --2- 172.21.15.50:0/2319631317 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a100039f0 0x7f8a2414a170 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f8a1401ce90 tx=0x7f8a10005840 comp rx=0 tx=0).stop 2024-04-01T02:12:38.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:38.034+0000 7f8a29e6b640 1 -- 172.21.15.50:0/2319631317 shutdown_connections 2024-04-01T02:12:38.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:38.034+0000 7f8a29e6b640 1 --2- 172.21.15.50:0/2319631317 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f8a04067450 0x7f8a04069910 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:38.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:38.034+0000 7f8a29e6b640 1 --2- 172.21.15.50:0/2319631317 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8a24157e90 0x7f8a241523b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:38.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:38.034+0000 7f8a29e6b640 1 --2- 172.21.15.50:0/2319631317 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8a24158ea0 0x7f8a24151e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:38.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:38.034+0000 7f8a29e6b640 1 --2- 172.21.15.50:0/2319631317 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a100039f0 0x7f8a2414a170 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:38.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:38.034+0000 7f8a29e6b640 1 -- 172.21.15.50:0/2319631317 >> 172.21.15.50:0/2319631317 conn(0x7f8a24072d50 msgr2=0x7f8a2415a6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T02:12:38.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:38.034+0000 7f8a29e6b640 1 -- 172.21.15.50:0/2319631317 shutdown_connections 2024-04-01T02:12:38.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:38.034+0000 7f8a29e6b640 1 -- 172.21.15.50:0/2319631317 wait complete. 2024-04-01T02:12:38.048 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-01T02:12:38.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:38.170+0000 7f86fd4dc640 1 Processor -- start 2024-04-01T02:12:38.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:38.170+0000 7f86fd4dc640 1 -- start start 2024-04-01T02:12:38.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:38.174+0000 7f86fd4dc640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f86f80c7850 0x7f86f8163570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:38.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:38.174+0000 7f86fd4dc640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86f80c30d0 con 0x7f86f80c2900 2024-04-01T02:12:38.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:38.174+0000 7f86fd4dc640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86f815b370 con 0x7f86f8151de0 2024-04-01T02:12:38.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:38.174+0000 7f86fd4dc640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f86f815c0f0 con 0x7f86f80c7850 2024-04-01T02:12:38.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:38.174+0000 7f86ee7fc640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f86f80c2900 0x7f86f80c5f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:33684/0 (socket says 172.21.15.50:33684) 2024-04-01T02:12:38.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:38.174+0000 7f86ee7fc640 1 -- 172.21.15.50:0/511608016 learned_addr learned my addr 172.21.15.50:0/511608016 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-04-01T02:12:38.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:38.174+0000 7f86f77fe640 1 --2- 172.21.15.50:0/511608016 >> v2:172.21.15.97:3300/0 conn(0x7f86f80c7850 0x7f86f8163570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:38.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:38.174+0000 7f86f67fc640 1 -- 172.21.15.50:0/511608016 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 166740011 0 0) 0x7f86f80c30d0 con 0x7f86f80c2900 2024-04-01T02:12:38.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:38.174+0000 7f86f67fc640 1 -- 172.21.15.50:0/511608016 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f86e4003530 con 0x7f86f80c2900 2024-04-01T02:12:38.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:38.174+0000 7f86f77fe640 1 -- 172.21.15.50:0/511608016 >> v1:172.21.15.97:6789/0 conn(0x7f86f8151de0 legacy=0x7f86f8157be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:38.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:38.174+0000 7f86f77fe640 1 -- 172.21.15.50:0/511608016 >> v1:172.21.15.50:6789/0 conn(0x7f86f80c2900 legacy=0x7f86f80c5f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:38.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:38.174+0000 7f86f77fe640 1 -- 172.21.15.50:0/511608016 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86f80c2df0 con 0x7f86f80c7850 2024-04-01T02:12:38.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:38.174+0000 7f86f77fe640 1 --2- 172.21.15.50:0/511608016 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f86f80c7850 0x7f86f8163570 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f86f0009d90 tx=0x7f86f001c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5aff865d8fa01377 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:12:38.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:38.174+0000 7f86f67fc640 1 -- 172.21.15.50:0/511608016 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86f00b2070 con 0x7f86f80c7850 2024-04-01T02:12:38.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:38.178+0000 7f86f67fc640 1 -- 172.21.15.50:0/511608016 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86f00a5830 con 0x7f86f80c7850 2024-04-01T02:12:38.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:38.178+0000 7f86f67fc640 1 -- 172.21.15.50:0/511608016 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86f00a5be0 con 0x7f86f80c7850 2024-04-01T02:12:38.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:38.178+0000 7f86fd4dc640 1 -- 172.21.15.50:0/511608016 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f86f80c7850 msgr2=0x7f86f8163570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:38.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:38.178+0000 7f86fd4dc640 1 --2- 172.21.15.50:0/511608016 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f86f80c7850 0x7f86f8163570 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f86f0009d90 tx=0x7f86f001c970 comp rx=0 tx=0).stop 2024-04-01T02:12:38.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:38.178+0000 7f86fd4dc640 1 -- 172.21.15.50:0/511608016 shutdown_connections 2024-04-01T02:12:38.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:38.178+0000 7f86fd4dc640 1 --2- 172.21.15.50:0/511608016 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f86f80c7850 0x7f86f8163570 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:38.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:38.178+0000 7f86fd4dc640 1 -- 172.21.15.50:0/511608016 >> 172.21.15.50:0/511608016 conn(0x7f86f8067560 msgr2=0x7f86f806b220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T02:12:38.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:38.178+0000 7f86fd4dc640 1 -- 172.21.15.50:0/511608016 shutdown_connections 2024-04-01T02:12:38.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:38.178+0000 7f86fd4dc640 1 -- 172.21.15.50:0/511608016 wait complete. 2024-04-01T02:12:38.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:38.178+0000 7f86fd4dc640 1 Processor -- start 2024-04-01T02:12:38.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:38.178+0000 7f86fd4dc640 1 -- start start 2024-04-01T02:12:38.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:38.178+0000 7f86fd4dc640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f86f80c2900 0x7f86f81f2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:38.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:38.178+0000 7f86fd4dc640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f86f80c7850 0x7f86f8145be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:38.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:38.178+0000 7f86fd4dc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86f8151de0 0x7f86f8146120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:38.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:38.178+0000 7f86fd4dc640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f86f80c88a0 con 0x7f86f8151de0 2024-04-01T02:12:38.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:38.178+0000 7f86fd4dc640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f86f81582f0 con 0x7f86f80c2900 2024-04-01T02:12:38.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:38.178+0000 7f86fd4dc640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f86f80c8a20 con 0x7f86f80c7850 2024-04-01T02:12:38.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:38.178+0000 7f86f77fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86f8151de0 0x7f86f8146120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:38.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:38.178+0000 7f86f77fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86f8151de0 0x7f86f8146120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50776/0 (socket says 172.21.15.50:50776) 2024-04-01T02:12:38.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:38.178+0000 7f86f77fe640 1 -- 172.21.15.50:0/2552858134 learned_addr learned my addr 172.21.15.50:0/2552858134 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T02:12:38.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:38.178+0000 7f86f6ffd640 1 --2- 172.21.15.50:0/2552858134 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f86f80c2900 0x7f86f81f2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:38.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:38.178+0000 7f86ee7fc640 1 --2- 172.21.15.50:0/2552858134 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f86f80c7850 0x7f86f8145be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:38.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:38.178+0000 7f86f77fe640 1 -- 172.21.15.50:0/2552858134 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f86f80c7850 msgr2=0x7f86f8145be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:38.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:38.178+0000 7f86f77fe640 1 --2- 172.21.15.50:0/2552858134 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f86f80c7850 0x7f86f8145be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:38.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:38.178+0000 7f86f77fe640 1 -- 172.21.15.50:0/2552858134 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f86f80c2900 msgr2=0x7f86f81f2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:38.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:38.178+0000 7f86f77fe640 1 --2- 172.21.15.50:0/2552858134 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f86f80c2900 0x7f86f81f2cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:38.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:38.178+0000 7f86f77fe640 1 -- 172.21.15.50:0/2552858134 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86f8157f30 con 0x7f86f8151de0 2024-04-01T02:12:38.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:38.178+0000 7f86ee7fc640 1 --2- 172.21.15.50:0/2552858134 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f86f80c7850 0x7f86f8145be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T02:12:38.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:38.182+0000 7f86f77fe640 1 --2- 172.21.15.50:0/2552858134 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86f8151de0 0x7f86f8146120 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f86f00b0040 tx=0x7f86f0019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:12:38.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:38.182+0000 7f86effff640 1 -- 172.21.15.50:0/2552858134 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86f00b2050 con 0x7f86f8151de0 2024-04-01T02:12:38.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:38.182+0000 7f86fd4dc640 1 -- 172.21.15.50:0/2552858134 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86f80c9ba0 con 0x7f86f8151de0 2024-04-01T02:12:38.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:38.182+0000 7f86effff640 1 -- 172.21.15.50:0/2552858134 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86f00be070 con 0x7f86f8151de0 2024-04-01T02:12:38.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:38.182+0000 7f86effff640 1 -- 172.21.15.50:0/2552858134 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86f0003db0 con 0x7f86f8151de0 2024-04-01T02:12:38.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:38.182+0000 7f86fd4dc640 1 -- 172.21.15.50:0/2552858134 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86f80ca160 con 0x7f86f8151de0 2024-04-01T02:12:38.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:38.182+0000 7f86fd4dc640 1 -- 172.21.15.50:0/2552858134 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86f8068230 con 0x7f86f8151de0 2024-04-01T02:12:38.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:38.182+0000 7f86effff640 1 -- 172.21.15.50:0/2552858134 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 87103+0+0 (secure 0 0 0) 0x7f86f0004040 con 0x7f86f8151de0 2024-04-01T02:12:38.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:38.182+0000 7f86effff640 1 --2- 172.21.15.50:0/2552858134 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f86d8067420 0x7f86d80698e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:38.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:38.182+0000 7f86effff640 1 -- 172.21.15.50:0/2552858134 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5738+0+0 (secure 0 0 0) 0x7f86f0121190 con 0x7f86f8151de0 2024-04-01T02:12:38.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:38.182+0000 7f86f6ffd640 1 --2- 172.21.15.50:0/2552858134 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f86d8067420 0x7f86d80698e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:38.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:38.182+0000 7f86f6ffd640 1 --2- 172.21.15.50:0/2552858134 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f86d8067420 0x7f86d80698e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f86e8007fd0 tx=0x7f86e8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:12:38.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:38.186+0000 7f86effff640 1 -- 172.21.15.50:0/2552858134 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+176632 (secure 0 0 0) 0x7f86f0016560 con 0x7f86f8151de0 2024-04-01T02:12:38.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:38.362+0000 7f86fd4dc640 1 -- 172.21.15.50:0/2552858134 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f86f80ca330 con 0x7f86f8151de0 2024-04-01T02:12:38.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:38.362+0000 7f86effff640 1 -- 172.21.15.50:0/2552858134 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) ==== 80+0+0 (secure 0 0 0) 0x7f86f00f1fa0 con 0x7f86f8151de0 2024-04-01T02:12:38.359 INFO:teuthology.orchestra.run.smithi050.stderr:listed 0 entries 2024-04-01T02:12:38.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:38.362+0000 7f86fd4dc640 1 -- 172.21.15.50:0/2552858134 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f86d8067420 msgr2=0x7f86d80698e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:38.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:38.362+0000 7f86fd4dc640 1 --2- 172.21.15.50:0/2552858134 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f86d8067420 0x7f86d80698e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f86e8007fd0 tx=0x7f86e8009040 comp rx=0 tx=0).stop 2024-04-01T02:12:38.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:38.362+0000 7f86fd4dc640 1 -- 172.21.15.50:0/2552858134 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86f8151de0 msgr2=0x7f86f8146120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:38.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:38.362+0000 7f86fd4dc640 1 --2- 172.21.15.50:0/2552858134 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86f8151de0 0x7f86f8146120 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f86f00b0040 tx=0x7f86f0019710 comp rx=0 tx=0).stop 2024-04-01T02:12:38.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:38.362+0000 7f86fd4dc640 1 -- 172.21.15.50:0/2552858134 shutdown_connections 2024-04-01T02:12:38.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:38.362+0000 7f86fd4dc640 1 --2- 172.21.15.50:0/2552858134 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f86d8067420 0x7f86d80698e0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:38.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:38.362+0000 7f86fd4dc640 1 --2- 172.21.15.50:0/2552858134 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86f8151de0 0x7f86f8146120 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:38.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:38.362+0000 7f86fd4dc640 1 --2- 172.21.15.50:0/2552858134 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f86f80c7850 0x7f86f8145be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:38.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:38.362+0000 7f86fd4dc640 1 --2- 172.21.15.50:0/2552858134 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f86f80c2900 0x7f86f81f2cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:38.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:38.362+0000 7f86fd4dc640 1 -- 172.21.15.50:0/2552858134 >> 172.21.15.50:0/2552858134 conn(0x7f86f8067560 msgr2=0x7f86f814ebc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T02:12:38.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:38.362+0000 7f86fd4dc640 1 -- 172.21.15.50:0/2552858134 shutdown_connections 2024-04-01T02:12:38.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:38.362+0000 7f86fd4dc640 1 -- 172.21.15.50:0/2552858134 wait complete. 2024-04-01T02:12:38.379 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi050.front.sepia.ceph.com... 2024-04-01T02:12:38.379 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T02:12:38.379 DEBUG:teuthology.orchestra.run.smithi050:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-04-01T02:12:38.397 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi050.stderr:ceph-fuse[33064]: fuse finished with error 0 and tester_r 0 2024-04-01T02:12:38.421 INFO:teuthology.orchestra.run:waiting for 300 2024-04-01T02:12:44.522 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi050.front.sepia.ceph.com 2024-04-01T02:12:44.523 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T02:12:44.523 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-01T02:12:44.540 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T02:12:44.541 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2024-04-01T02:12:44.588 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-01T02:12:44.588 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T02:12:44.589 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-01T02:12:44.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T02:12:44.644 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link delete ceph-brx 2024-04-01T02:12:44.860 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-01T02:12:44.870 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-01T02:12:44.870 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-01T02:12:45.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.001+0000 7fd153375640 1 Processor -- start 2024-04-01T02:12:45.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.005+0000 7fd153375640 1 -- start start 2024-04-01T02:12:45.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.005+0000 7fd153375640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fd14c154200 0x7fd14c0cb780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:45.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.005+0000 7fd153375640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd14c06c480 0x7fd14c06c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:45.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.005+0000 7fd153375640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd14c1545e0 con 0x7fd14c0c4ab0 2024-04-01T02:12:45.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.005+0000 7fd153375640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fd14c15dd70 con 0x7fd14c154200 2024-04-01T02:12:45.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.005+0000 7fd153375640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fd14c0caae0 con 0x7fd14c06c480 2024-04-01T02:12:45.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.005+0000 7fd150910640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fd14c0c4ab0 0x7fd14c0cc180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:33694/0 (socket says 172.21.15.50:33694) 2024-04-01T02:12:45.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.005+0000 7fd150910640 1 -- 172.21.15.50:0/669741992 learned_addr learned my addr 172.21.15.50:0/669741992 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-04-01T02:12:45.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.005+0000 7fd151912640 1 --2- 172.21.15.50:0/669741992 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd14c06c480 0x7fd14c06c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:45.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.005+0000 7fd151111640 1 --2- 172.21.15.50:0/669741992 >> v2:172.21.15.97:3300/0 conn(0x7fd14c154200 0x7fd14c0cb780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:45.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.005+0000 7fd14bfff640 1 -- 172.21.15.50:0/669741992 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1973963990 0 0) 0x7fd14c1545e0 con 0x7fd14c0c4ab0 2024-04-01T02:12:45.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.005+0000 7fd14bfff640 1 -- 172.21.15.50:0/669741992 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd134003530 con 0x7fd14c0c4ab0 2024-04-01T02:12:45.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.005+0000 7fd14bfff640 1 -- 172.21.15.50:0/669741992 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2534936418 0 0) 0x7fd134003530 con 0x7fd14c0c4ab0 2024-04-01T02:12:45.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.005+0000 7fd14bfff640 1 -- 172.21.15.50:0/669741992 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd14c06c480 msgr2=0x7fd14c06c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T02:12:45.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.005+0000 7fd14bfff640 1 --2- 172.21.15.50:0/669741992 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd14c06c480 0x7fd14c06c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:45.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.005+0000 7fd14bfff640 1 -- 172.21.15.50:0/669741992 >> v2:172.21.15.97:3300/0 conn(0x7fd14c154200 msgr2=0x7fd14c0cb780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T02:12:45.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.005+0000 7fd14bfff640 1 --2- 172.21.15.50:0/669741992 >> v2:172.21.15.97:3300/0 conn(0x7fd14c154200 0x7fd14c0cb780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:45.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.005+0000 7fd14bfff640 1 -- 172.21.15.50:0/669741992 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd14c06ce50 con 0x7fd14c0c4ab0 2024-04-01T02:12:45.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.005+0000 7fd14bfff640 1 -- 172.21.15.50:0/669741992 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2779672543 0 0) 0x7fd140001a00 con 0x7fd14c0c4ab0 2024-04-01T02:12:45.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.005+0000 7fd14bfff640 1 -- 172.21.15.50:0/669741992 >> v1:172.21.15.50:6789/0 conn(0x7fd14c0c4ab0 legacy=0x7fd14c0cc180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:45.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.005+0000 7fd14bfff640 1 --2- 172.21.15.50:0/669741992 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd14c06c480 0x7fd1340039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:45.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.005+0000 7fd14bfff640 1 --2- 172.21.15.50:0/669741992 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd134003f90 0x7fd134004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:45.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.005+0000 7fd14bfff640 1 --2- 172.21.15.50:0/669741992 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd134004d50 0x7fd1340051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:45.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.005+0000 7fd14bfff640 1 -- 172.21.15.50:0/669741992 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd14c15dd70 con 0x7fd134004d50 2024-04-01T02:12:45.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.005+0000 7fd14bfff640 1 -- 172.21.15.50:0/669741992 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fd14c0caae0 con 0x7fd134003f90 2024-04-01T02:12:45.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.005+0000 7fd14bfff640 1 -- 172.21.15.50:0/669741992 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fd13400b9d0 con 0x7fd14c06c480 2024-04-01T02:12:45.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.005+0000 7fd151912640 1 --2- 172.21.15.50:0/669741992 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd134004d50 0x7fd1340051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:45.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.005+0000 7fd151111640 1 --2- 172.21.15.50:0/669741992 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd14c06c480 0x7fd1340039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:45.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.005+0000 7fd150910640 1 --2- 172.21.15.50:0/669741992 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd134003f90 0x7fd134004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:45.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.005+0000 7fd151912640 1 -- 172.21.15.50:0/669741992 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd14c06c480 msgr2=0x7fd1340039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T02:12:45.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.005+0000 7fd151912640 1 --2- 172.21.15.50:0/669741992 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd14c06c480 0x7fd1340039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:45.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.005+0000 7fd151912640 1 -- 172.21.15.50:0/669741992 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd134003f90 msgr2=0x7fd134004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T02:12:45.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.005+0000 7fd151912640 1 --2- 172.21.15.50:0/669741992 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd134003f90 0x7fd134004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:45.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.005+0000 7fd151912640 1 -- 172.21.15.50:0/669741992 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd134003530 con 0x7fd134004d50 2024-04-01T02:12:45.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.009+0000 7fd151912640 1 --2- 172.21.15.50:0/669741992 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd134004d50 0x7fd1340051d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd144009af0 tx=0x7fd14401ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d368d1cc3fabb3f5 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:12:45.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.009+0000 7fd14bfff640 1 -- 172.21.15.50:0/669741992 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1440b2070 con 0x7fd134004d50 2024-04-01T02:12:45.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.009+0000 7fd14bfff640 1 -- 172.21.15.50:0/669741992 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1440a5620 con 0x7fd134004d50 2024-04-01T02:12:45.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.009+0000 7fd14bfff640 1 -- 172.21.15.50:0/669741992 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd144009690 con 0x7fd134004d50 2024-04-01T02:12:45.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.009+0000 7fd153375640 1 -- 172.21.15.50:0/669741992 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd134004d50 msgr2=0x7fd1340051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:45.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.009+0000 7fd153375640 1 --2- 172.21.15.50:0/669741992 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd134004d50 0x7fd1340051d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd144009af0 tx=0x7fd14401ca30 comp rx=0 tx=0).stop 2024-04-01T02:12:45.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.009+0000 7fd151912640 1 -- 172.21.15.50:0/669741992 reap_dead start 2024-04-01T02:12:45.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.009+0000 7fd153375640 1 -- 172.21.15.50:0/669741992 shutdown_connections 2024-04-01T02:12:45.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.009+0000 7fd153375640 1 -- 172.21.15.50:0/669741992 >> 172.21.15.50:0/669741992 conn(0x7fd14c066f60 msgr2=0x7fd14c067370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T02:12:45.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.009+0000 7fd153375640 1 -- 172.21.15.50:0/669741992 shutdown_connections 2024-04-01T02:12:45.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.009+0000 7fd153375640 1 -- 172.21.15.50:0/669741992 wait complete. 2024-04-01T02:12:45.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.009+0000 7fd153375640 1 Processor -- start 2024-04-01T02:12:45.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.009+0000 7fd153375640 1 -- start start 2024-04-01T02:12:45.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.013+0000 7fd153375640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd14c15b9b0 0x7fd14c0c97e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:45.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.013+0000 7fd153375640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd14c15bd90 0x7fd14c1f00f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:45.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.013+0000 7fd153375640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd14c1577c0 0x7fd14c159250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:45.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.013+0000 7fd153375640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd14c0ca520 con 0x7fd14c15bd90 2024-04-01T02:12:45.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.013+0000 7fd153375640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fd14c15dfb0 con 0x7fd14c15b9b0 2024-04-01T02:12:45.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.013+0000 7fd153375640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fd14c0ca800 con 0x7fd14c1577c0 2024-04-01T02:12:45.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.013+0000 7fd150910640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd14c15bd90 0x7fd14c1f00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:45.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.013+0000 7fd150910640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd14c15bd90 0x7fd14c1f00f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50794/0 (socket says 172.21.15.50:50794) 2024-04-01T02:12:45.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.013+0000 7fd150910640 1 -- 172.21.15.50:0/3565165846 learned_addr learned my addr 172.21.15.50:0/3565165846 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T02:12:45.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.013+0000 7fd151912640 1 --2- 172.21.15.50:0/3565165846 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd14c1577c0 0x7fd14c159250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:45.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.013+0000 7fd151111640 1 --2- 172.21.15.50:0/3565165846 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd14c15b9b0 0x7fd14c0c97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:45.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.013+0000 7fd150910640 1 -- 172.21.15.50:0/3565165846 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd14c1577c0 msgr2=0x7fd14c159250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:45.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.013+0000 7fd150910640 1 --2- 172.21.15.50:0/3565165846 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd14c1577c0 0x7fd14c159250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:45.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.013+0000 7fd150910640 1 -- 172.21.15.50:0/3565165846 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd14c15b9b0 msgr2=0x7fd14c0c97e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:45.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.013+0000 7fd150910640 1 --2- 172.21.15.50:0/3565165846 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd14c15b9b0 0x7fd14c0c97e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:45.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.013+0000 7fd150910640 1 -- 172.21.15.50:0/3565165846 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd14c158380 con 0x7fd14c15bd90 2024-04-01T02:12:45.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.013+0000 7fd150910640 1 --2- 172.21.15.50:0/3565165846 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd14c15bd90 0x7fd14c1f00f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fd14000e410 tx=0x7fd14000e8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:12:45.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.013+0000 7fd149ffb640 1 -- 172.21.15.50:0/3565165846 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd140012590 con 0x7fd14c15bd90 2024-04-01T02:12:45.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.013+0000 7fd149ffb640 1 -- 172.21.15.50:0/3565165846 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd140018070 con 0x7fd14c15bd90 2024-04-01T02:12:45.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.013+0000 7fd153375640 1 -- 172.21.15.50:0/3565165846 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd14c158660 con 0x7fd14c15bd90 2024-04-01T02:12:45.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.013+0000 7fd149ffb640 1 -- 172.21.15.50:0/3565165846 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd140012990 con 0x7fd14c15bd90 2024-04-01T02:12:45.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.013+0000 7fd153375640 1 -- 172.21.15.50:0/3565165846 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd14c1ef8f0 con 0x7fd14c15bd90 2024-04-01T02:12:45.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.013+0000 7fd153375640 1 -- 172.21.15.50:0/3565165846 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd14c068230 con 0x7fd14c15bd90 2024-04-01T02:12:45.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.013+0000 7fd149ffb640 1 -- 172.21.15.50:0/3565165846 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 87103+0+0 (secure 0 0 0) 0x7fd140012b30 con 0x7fd14c15bd90 2024-04-01T02:12:45.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.013+0000 7fd149ffb640 1 --2- 172.21.15.50:0/3565165846 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fd138067420 0x7fd1380698e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:45.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.013+0000 7fd149ffb640 1 -- 172.21.15.50:0/3565165846 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5738+0+0 (secure 0 0 0) 0x7fd140086020 con 0x7fd14c15bd90 2024-04-01T02:12:45.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.013+0000 7fd151111640 1 --2- 172.21.15.50:0/3565165846 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fd138067420 0x7fd1380698e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:45.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.017+0000 7fd151111640 1 --2- 172.21.15.50:0/3565165846 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fd138067420 0x7fd1380698e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd13c009b60 tx=0x7fd13c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:12:45.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.017+0000 7fd149ffb640 1 -- 172.21.15.50:0/3565165846 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+176632 (secure 0 0 0) 0x7fd140012e20 con 0x7fd14c15bd90 2024-04-01T02:12:45.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.177+0000 7fd153375640 1 -- 172.21.15.50:0/3565165846 --> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd14c0cafe0 con 0x7fd138067420 2024-04-01T02:12:45.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.189+0000 7fd149ffb640 1 -- 172.21.15.50:0/3565165846 <== mgr.4103 v2:172.21.15.97:6832/1677467570 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+254883 (secure 0 0 0) 0x7fd14c0cafe0 con 0x7fd138067420 2024-04-01T02:12:45.191 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-01T02:12:45.193 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-04-01T02:12:45.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.193+0000 7fd153375640 1 -- 172.21.15.50:0/3565165846 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fd138067420 msgr2=0x7fd1380698e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:45.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.193+0000 7fd153375640 1 --2- 172.21.15.50:0/3565165846 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fd138067420 0x7fd1380698e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd13c009b60 tx=0x7fd13c008040 comp rx=0 tx=0).stop 2024-04-01T02:12:45.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.193+0000 7fd153375640 1 -- 172.21.15.50:0/3565165846 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd14c15bd90 msgr2=0x7fd14c1f00f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:45.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.193+0000 7fd153375640 1 --2- 172.21.15.50:0/3565165846 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd14c15bd90 0x7fd14c1f00f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fd14000e410 tx=0x7fd14000e8d0 comp rx=0 tx=0).stop 2024-04-01T02:12:45.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.193+0000 7fd153375640 1 -- 172.21.15.50:0/3565165846 shutdown_connections 2024-04-01T02:12:45.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.193+0000 7fd153375640 1 --2- 172.21.15.50:0/3565165846 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fd138067420 0x7fd1380698e0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:45.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.193+0000 7fd153375640 1 --2- 172.21.15.50:0/3565165846 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd14c1577c0 0x7fd14c159250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:45.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.193+0000 7fd153375640 1 --2- 172.21.15.50:0/3565165846 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd14c15bd90 0x7fd14c1f00f0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:45.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.193+0000 7fd153375640 1 --2- 172.21.15.50:0/3565165846 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd14c15b9b0 0x7fd14c0c97e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:45.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.193+0000 7fd153375640 1 -- 172.21.15.50:0/3565165846 >> 172.21.15.50:0/3565165846 conn(0x7fd14c066f60 msgr2=0x7fd14c0b23e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T02:12:45.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.193+0000 7fd153375640 1 -- 172.21.15.50:0/3565165846 shutdown_connections 2024-04-01T02:12:45.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.193+0000 7fd153375640 1 -- 172.21.15.50:0/3565165846 wait complete. 2024-04-01T02:12:45.212 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":528,"stamp":"2024-04-01T02:12:44.389554+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":414988212,"num_objects":742,"num_object_clones":0,"num_object_copies":1484,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":742,"num_whiteouts":0,"num_read":1875,"num_read_kb":2843,"num_write":55974,"num_write_kb":1354436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":62713,"ondisk_log_size":62713,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":993616,"kb_used_data":290256,"kb_used_omap":12,"kb_used_meta":703283,"kb_avail":753981104,"statfs":{"total":773094113280,"available":772076650496,"internally_reserved":0,"allocated":297222144,"data_stored":830642972,"data_compressed":57247476,"data_compressed_allocated":83542016,"data_compressed_original":620507992,"omap_allocated":12751,"internal_metadata":720162353},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":54,"apply_latency_ms":54,"commit_latency_ns":54000000,"apply_latency_ns":54000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":7294455,"num_objects":-15,"num_object_clones":0,"num_object_copies":-30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-15,"num_whiteouts":0,"num_read":17,"num_read_kb":36,"num_write":1013,"num_write_kb":19068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002985"},"pg_stats":[{"pgid":"3.3f","version":"23'487","reported_seq":511,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.726522+0000","last_change":"2024-04-01T01:55:49.279342+0000","last_active":"2024-04-01T02:12:38.726522+0000","last_peered":"2024-04-01T02:12:38.726522+0000","last_clean":"2024-04-01T02:12:38.726522+0000","last_became_active":"2024-04-01T01:55:49.279011+0000","last_became_peered":"2024-04-01T01:55:49.279011+0000","last_unstale":"2024-04-01T02:12:38.726522+0000","last_undegraded":"2024-04-01T02:12:38.726522+0000","last_fullsized":"2024-04-01T02:12:38.726522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:56:11.350186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4211749,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":345,"num_write_kb":18423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"23'557","reported_seq":581,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.676141+0000","last_change":"2024-04-01T01:55:49.247181+0000","last_active":"2024-04-01T02:12:38.676141+0000","last_peered":"2024-04-01T02:12:38.676141+0000","last_clean":"2024-04-01T02:12:38.676141+0000","last_became_active":"2024-04-01T01:55:49.246660+0000","last_became_peered":"2024-04-01T01:55:49.246660+0000","last_unstale":"2024-04-01T02:12:38.676141+0000","last_undegraded":"2024-04-01T02:12:38.676141+0000","last_fullsized":"2024-04-01T02:12:38.676141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":557,"log_dups_size":0,"ondisk_log_size":557,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:27:12.089520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3694421,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":432,"num_write_kb":10812,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"23'528","reported_seq":552,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.682048+0000","last_change":"2024-04-01T01:55:49.240347+0000","last_active":"2024-04-01T02:12:38.682048+0000","last_peered":"2024-04-01T02:12:38.682048+0000","last_clean":"2024-04-01T02:12:38.682048+0000","last_became_active":"2024-04-01T01:55:49.239904+0000","last_became_peered":"2024-04-01T01:55:49.239904+0000","last_unstale":"2024-04-01T02:12:38.682048+0000","last_undegraded":"2024-04-01T02:12:38.682048+0000","last_fullsized":"2024-04-01T02:12:38.682048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:37:43.280869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5131013,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":399,"num_write_kb":17827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"23'481","reported_seq":505,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.720237+0000","last_change":"2024-04-01T01:55:49.279352+0000","last_active":"2024-04-01T02:12:38.720237+0000","last_peered":"2024-04-01T02:12:38.720237+0000","last_clean":"2024-04-01T02:12:38.720237+0000","last_became_active":"2024-04-01T01:55:49.279041+0000","last_became_peered":"2024-04-01T01:55:49.279041+0000","last_unstale":"2024-04-01T02:12:38.720237+0000","last_undegraded":"2024-04-01T02:12:38.720237+0000","last_fullsized":"2024-04-01T02:12:38.720237+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":481,"log_dups_size":0,"ondisk_log_size":481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:13:13.114168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":658438,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":353,"num_write_kb":8202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"23'578","reported_seq":600,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.731752+0000","last_change":"2024-04-01T01:55:49.246874+0000","last_active":"2024-04-01T02:12:38.731752+0000","last_peered":"2024-04-01T02:12:38.731752+0000","last_clean":"2024-04-01T02:12:38.731752+0000","last_became_active":"2024-04-01T01:55:49.246152+0000","last_became_peered":"2024-04-01T01:55:49.246152+0000","last_unstale":"2024-04-01T02:12:38.731752+0000","last_undegraded":"2024-04-01T02:12:38.731752+0000","last_fullsized":"2024-04-01T02:12:38.731752+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":578,"log_dups_size":0,"ondisk_log_size":578,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:49:04.049108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3987251,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":442,"num_write_kb":11887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"23'477","reported_seq":499,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.714821+0000","last_change":"2024-04-01T01:55:49.254029+0000","last_active":"2024-04-01T02:12:38.714821+0000","last_peered":"2024-04-01T02:12:38.714821+0000","last_clean":"2024-04-01T02:12:38.714821+0000","last_became_active":"2024-04-01T01:55:49.253348+0000","last_became_peered":"2024-04-01T01:55:49.253348+0000","last_unstale":"2024-04-01T02:12:38.714821+0000","last_undegraded":"2024-04-01T02:12:38.714821+0000","last_fullsized":"2024-04-01T02:12:38.714821+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":477,"log_dups_size":0,"ondisk_log_size":477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:33:56.754206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3474466,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":343,"num_write_kb":9649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"23'559","reported_seq":581,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.702161+0000","last_change":"2024-04-01T01:55:49.247604+0000","last_active":"2024-04-01T02:12:38.702161+0000","last_peered":"2024-04-01T02:12:38.702161+0000","last_clean":"2024-04-01T02:12:38.702161+0000","last_became_active":"2024-04-01T01:55:49.247373+0000","last_became_peered":"2024-04-01T01:55:49.247373+0000","last_unstale":"2024-04-01T02:12:38.702161+0000","last_undegraded":"2024-04-01T02:12:38.702161+0000","last_fullsized":"2024-04-01T02:12:38.702161+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":559,"log_dups_size":0,"ondisk_log_size":559,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:13:16.513095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2878976,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":421,"num_write_kb":10504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"23'479","reported_seq":501,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.702730+0000","last_change":"2024-04-01T01:55:49.262994+0000","last_active":"2024-04-01T02:12:38.702730+0000","last_peered":"2024-04-01T02:12:38.702730+0000","last_clean":"2024-04-01T02:12:38.702730+0000","last_became_active":"2024-04-01T01:55:49.262736+0000","last_became_peered":"2024-04-01T01:55:49.262736+0000","last_unstale":"2024-04-01T02:12:38.702730+0000","last_undegraded":"2024-04-01T02:12:38.702730+0000","last_fullsized":"2024-04-01T02:12:38.702730+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":479,"log_dups_size":0,"ondisk_log_size":479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:35:14.625545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3489692,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":346,"num_write_kb":10932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"23'511","reported_seq":533,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.727389+0000","last_change":"2024-04-01T01:55:49.260244+0000","last_active":"2024-04-01T02:12:38.727389+0000","last_peered":"2024-04-01T02:12:38.727389+0000","last_clean":"2024-04-01T02:12:38.727389+0000","last_became_active":"2024-04-01T01:55:49.259745+0000","last_became_peered":"2024-04-01T01:55:49.259745+0000","last_unstale":"2024-04-01T02:12:38.727389+0000","last_undegraded":"2024-04-01T02:12:38.727389+0000","last_fullsized":"2024-04-01T02:12:38.727389+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":511,"log_dups_size":0,"ondisk_log_size":511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:00:34.607980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3721216,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":377,"num_write_kb":13356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"23'490","reported_seq":506,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.726657+0000","last_change":"2024-04-01T01:56:38.229250+0000","last_active":"2024-04-01T02:12:38.726657+0000","last_peered":"2024-04-01T02:12:38.726657+0000","last_clean":"2024-04-01T02:12:38.726657+0000","last_became_active":"2024-04-01T01:56:38.228548+0000","last_became_peered":"2024-04-01T01:56:38.228548+0000","last_unstale":"2024-04-01T02:12:38.726657+0000","last_undegraded":"2024-04-01T02:12:38.726657+0000","last_fullsized":"2024-04-01T02:12:38.726657+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":490,"log_dups_size":0,"ondisk_log_size":490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:15:01.912111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2985236,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":363,"num_write_kb":27800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.35","version":"23'471","reported_seq":493,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.732628+0000","last_change":"2024-04-01T01:55:49.271392+0000","last_active":"2024-04-01T02:12:38.732628+0000","last_peered":"2024-04-01T02:12:38.732628+0000","last_clean":"2024-04-01T02:12:38.732628+0000","last_became_active":"2024-04-01T01:55:49.270877+0000","last_became_peered":"2024-04-01T01:55:49.270877+0000","last_unstale":"2024-04-01T02:12:38.732628+0000","last_undegraded":"2024-04-01T02:12:38.732628+0000","last_fullsized":"2024-04-01T02:12:38.732628+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:44:29.950624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3409567,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":12314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"23'413","reported_seq":435,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.723596+0000","last_change":"2024-04-01T01:55:49.259816+0000","last_active":"2024-04-01T02:12:38.723596+0000","last_peered":"2024-04-01T02:12:38.723596+0000","last_clean":"2024-04-01T02:12:38.723596+0000","last_became_active":"2024-04-01T01:55:49.259193+0000","last_became_peered":"2024-04-01T01:55:49.259193+0000","last_unstale":"2024-04-01T02:12:38.723596+0000","last_undegraded":"2024-04-01T02:12:38.723596+0000","last_fullsized":"2024-04-01T02:12:38.723596+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:48:10.828398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2357039,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":282,"num_write_kb":7635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"23'431","reported_seq":453,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.701034+0000","last_change":"2024-04-01T01:55:49.247878+0000","last_active":"2024-04-01T02:12:38.701034+0000","last_peered":"2024-04-01T02:12:38.701034+0000","last_clean":"2024-04-01T02:12:38.701034+0000","last_became_active":"2024-04-01T01:55:49.247436+0000","last_became_peered":"2024-04-01T01:55:49.247436+0000","last_unstale":"2024-04-01T02:12:38.701034+0000","last_undegraded":"2024-04-01T02:12:38.701034+0000","last_fullsized":"2024-04-01T02:12:38.701034+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:26:09.632757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":608576,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":293,"num_write_kb":6624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"23'521","reported_seq":544,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.672100+0000","last_change":"2024-04-01T01:55:49.246266+0000","last_active":"2024-04-01T02:12:38.672100+0000","last_peered":"2024-04-01T02:12:38.672100+0000","last_clean":"2024-04-01T02:12:38.672100+0000","last_became_active":"2024-04-01T01:55:49.245650+0000","last_became_peered":"2024-04-01T01:55:49.245650+0000","last_unstale":"2024-04-01T02:12:38.672100+0000","last_undegraded":"2024-04-01T02:12:38.672100+0000","last_fullsized":"2024-04-01T02:12:38.672100+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":521,"log_dups_size":0,"ondisk_log_size":521,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:14:32.577522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3014274,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":389,"num_write_kb":12247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"23'508","reported_seq":531,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.702841+0000","last_change":"2024-04-01T01:55:49.248046+0000","last_active":"2024-04-01T02:12:38.702841+0000","last_peered":"2024-04-01T02:12:38.702841+0000","last_clean":"2024-04-01T02:12:38.702841+0000","last_became_active":"2024-04-01T01:55:49.247662+0000","last_became_peered":"2024-04-01T01:55:49.247662+0000","last_unstale":"2024-04-01T02:12:38.702841+0000","last_undegraded":"2024-04-01T02:12:38.702841+0000","last_fullsized":"2024-04-01T02:12:38.702841+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":508,"log_dups_size":0,"ondisk_log_size":508,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:59:26.879090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3985408,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":369,"num_write_kb":15794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"23'682","reported_seq":705,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.721747+0000","last_change":"2024-04-01T01:55:49.269484+0000","last_active":"2024-04-01T02:12:38.721747+0000","last_peered":"2024-04-01T02:12:38.721747+0000","last_clean":"2024-04-01T02:12:38.721747+0000","last_became_active":"2024-04-01T01:55:49.261839+0000","last_became_peered":"2024-04-01T01:55:49.261839+0000","last_unstale":"2024-04-01T02:12:38.721747+0000","last_undegraded":"2024-04-01T02:12:38.721747+0000","last_fullsized":"2024-04-01T02:12:38.721747+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":682,"log_dups_size":0,"ondisk_log_size":682,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:44:29.950624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6390669,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":553,"num_write_kb":46118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"23'595","reported_seq":618,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.734605+0000","last_change":"2024-04-01T01:55:49.276113+0000","last_active":"2024-04-01T02:12:38.734605+0000","last_peered":"2024-04-01T02:12:38.734605+0000","last_clean":"2024-04-01T02:12:38.734605+0000","last_became_active":"2024-04-01T01:55:49.275727+0000","last_became_peered":"2024-04-01T01:55:49.275727+0000","last_unstale":"2024-04-01T02:12:38.734605+0000","last_undegraded":"2024-04-01T02:12:38.734605+0000","last_fullsized":"2024-04-01T02:12:38.734605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":595,"log_dups_size":0,"ondisk_log_size":595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:50:59.209071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1955840,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":457,"num_write_kb":17131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"23'506","reported_seq":529,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.726548+0000","last_change":"2024-04-01T01:55:49.252859+0000","last_active":"2024-04-01T02:12:38.726548+0000","last_peered":"2024-04-01T02:12:38.726548+0000","last_clean":"2024-04-01T02:12:38.726548+0000","last_became_active":"2024-04-01T01:55:49.252553+0000","last_became_peered":"2024-04-01T01:55:49.252553+0000","last_unstale":"2024-04-01T02:12:38.726548+0000","last_undegraded":"2024-04-01T02:12:38.726548+0000","last_fullsized":"2024-04-01T02:12:38.726548+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":506,"log_dups_size":0,"ondisk_log_size":506,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:13:13.114168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5136348,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":357,"num_write_kb":34023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"23'525","reported_seq":548,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.713522+0000","last_change":"2024-04-01T01:55:49.260274+0000","last_active":"2024-04-01T02:12:38.713522+0000","last_peered":"2024-04-01T02:12:38.713522+0000","last_clean":"2024-04-01T02:12:38.713522+0000","last_became_active":"2024-04-01T01:55:49.259935+0000","last_became_peered":"2024-04-01T01:55:49.259935+0000","last_unstale":"2024-04-01T02:12:38.713522+0000","last_undegraded":"2024-04-01T02:12:38.713522+0000","last_fullsized":"2024-04-01T02:12:38.713522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":525,"log_dups_size":0,"ondisk_log_size":525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:24:55.348340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6314527,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":390,"num_write_kb":35275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"23'655","reported_seq":678,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.720819+0000","last_change":"2024-04-01T01:55:49.259523+0000","last_active":"2024-04-01T02:12:38.720819+0000","last_peered":"2024-04-01T02:12:38.720819+0000","last_clean":"2024-04-01T02:12:38.720819+0000","last_became_active":"2024-04-01T01:55:49.258670+0000","last_became_peered":"2024-04-01T01:55:49.258670+0000","last_unstale":"2024-04-01T02:12:38.720819+0000","last_undegraded":"2024-04-01T02:12:38.720819+0000","last_fullsized":"2024-04-01T02:12:38.720819+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":655,"log_dups_size":0,"ondisk_log_size":655,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:08:54.832554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3478562,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":525,"num_write_kb":13686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"23'528","reported_seq":551,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.713062+0000","last_change":"2024-04-01T01:55:49.243824+0000","last_active":"2024-04-01T02:12:38.713062+0000","last_peered":"2024-04-01T02:12:38.713062+0000","last_clean":"2024-04-01T02:12:38.713062+0000","last_became_active":"2024-04-01T01:55:49.243518+0000","last_became_peered":"2024-04-01T01:55:49.243518+0000","last_unstale":"2024-04-01T02:12:38.713062+0000","last_undegraded":"2024-04-01T02:12:38.713062+0000","last_fullsized":"2024-04-01T02:12:38.713062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:24:42.777720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1873749,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":387,"num_write_kb":9989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"23'557","reported_seq":580,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.697153+0000","last_change":"2024-04-01T01:55:49.258207+0000","last_active":"2024-04-01T02:12:38.697153+0000","last_peered":"2024-04-01T02:12:38.697153+0000","last_clean":"2024-04-01T02:12:38.697153+0000","last_became_active":"2024-04-01T01:55:49.257576+0000","last_became_peered":"2024-04-01T01:55:49.257576+0000","last_unstale":"2024-04-01T02:12:38.697153+0000","last_undegraded":"2024-04-01T02:12:38.697153+0000","last_fullsized":"2024-04-01T02:12:38.697153+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":557,"log_dups_size":0,"ondisk_log_size":557,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:13:13.114168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3745621,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":429,"num_write_kb":26683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"23'495","reported_seq":518,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.697781+0000","last_change":"2024-04-01T01:55:49.250832+0000","last_active":"2024-04-01T02:12:38.697781+0000","last_peered":"2024-04-01T02:12:38.697781+0000","last_clean":"2024-04-01T02:12:38.697781+0000","last_became_active":"2024-04-01T01:55:49.250522+0000","last_became_peered":"2024-04-01T01:55:49.250522+0000","last_unstale":"2024-04-01T02:12:38.697781+0000","last_undegraded":"2024-04-01T02:12:38.697781+0000","last_fullsized":"2024-04-01T02:12:38.697781+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:47:04.592262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1694624,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":361,"num_write_kb":9747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"23'519","reported_seq":542,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.712726+0000","last_change":"2024-04-01T01:55:49.270067+0000","last_active":"2024-04-01T02:12:38.712726+0000","last_peered":"2024-04-01T02:12:38.712726+0000","last_clean":"2024-04-01T02:12:38.712726+0000","last_became_active":"2024-04-01T01:55:49.269694+0000","last_became_peered":"2024-04-01T01:55:49.269694+0000","last_unstale":"2024-04-01T02:12:38.712726+0000","last_undegraded":"2024-04-01T02:12:38.712726+0000","last_fullsized":"2024-04-01T02:12:38.712726+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":519,"log_dups_size":0,"ondisk_log_size":519,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:21:46.367144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4783138,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384,"num_write_kb":12273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"23'556","reported_seq":579,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.722272+0000","last_change":"2024-04-01T01:55:49.243460+0000","last_active":"2024-04-01T02:12:38.722272+0000","last_peered":"2024-04-01T02:12:38.722272+0000","last_clean":"2024-04-01T02:12:38.722272+0000","last_became_active":"2024-04-01T01:55:49.243017+0000","last_became_peered":"2024-04-01T01:55:49.243017+0000","last_unstale":"2024-04-01T02:12:38.722272+0000","last_undegraded":"2024-04-01T02:12:38.722272+0000","last_fullsized":"2024-04-01T02:12:38.722272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":556,"log_dups_size":0,"ondisk_log_size":556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:20:18.156798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3977024,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":423,"num_write_kb":11436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"23'580","reported_seq":603,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.740597+0000","last_change":"2024-04-01T01:55:49.280226+0000","last_active":"2024-04-01T02:12:38.740597+0000","last_peered":"2024-04-01T02:12:38.740597+0000","last_clean":"2024-04-01T02:12:38.740597+0000","last_became_active":"2024-04-01T01:55:49.279882+0000","last_became_peered":"2024-04-01T01:55:49.279882+0000","last_unstale":"2024-04-01T02:12:38.740597+0000","last_undegraded":"2024-04-01T02:12:38.740597+0000","last_fullsized":"2024-04-01T02:12:38.740597+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":580,"log_dups_size":0,"ondisk_log_size":580,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:06:48.999905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8142848,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":413,"num_write_kb":37888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"23'766","reported_seq":789,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.659698+0000","last_change":"2024-04-01T01:55:49.249890+0000","last_active":"2024-04-01T02:12:38.659698+0000","last_peered":"2024-04-01T02:12:38.659698+0000","last_clean":"2024-04-01T02:12:38.659698+0000","last_became_active":"2024-04-01T01:55:49.249588+0000","last_became_peered":"2024-04-01T01:55:49.249588+0000","last_unstale":"2024-04-01T02:12:38.659698+0000","last_undegraded":"2024-04-01T02:12:38.659698+0000","last_fullsized":"2024-04-01T02:12:38.659698+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":766,"log_dups_size":0,"ondisk_log_size":766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:02:25.180455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4497408,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":644,"num_write_kb":39031,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"23'440","reported_seq":463,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.674903+0000","last_change":"2024-04-01T01:55:49.254529+0000","last_active":"2024-04-01T02:12:38.674903+0000","last_peered":"2024-04-01T02:12:38.674903+0000","last_clean":"2024-04-01T02:12:38.674903+0000","last_became_active":"2024-04-01T01:55:49.253726+0000","last_became_peered":"2024-04-01T01:55:49.253726+0000","last_unstale":"2024-04-01T02:12:38.674903+0000","last_undegraded":"2024-04-01T02:12:38.674903+0000","last_fullsized":"2024-04-01T02:12:38.674903+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:55:44.175129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2117070,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":308,"num_write_kb":8584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"23'485","reported_seq":509,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.676378+0000","last_change":"2024-04-01T01:55:49.252043+0000","last_active":"2024-04-01T02:12:38.676378+0000","last_peered":"2024-04-01T02:12:38.676378+0000","last_clean":"2024-04-01T02:12:38.676378+0000","last_became_active":"2024-04-01T01:55:49.251760+0000","last_became_peered":"2024-04-01T01:55:49.251760+0000","last_unstale":"2024-04-01T02:12:38.676378+0000","last_undegraded":"2024-04-01T02:12:38.676378+0000","last_fullsized":"2024-04-01T02:12:38.676378+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:12:25.325040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1909794,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":354,"num_write_kb":10727,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"23'882","reported_seq":906,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.722329+0000","last_change":"2024-04-01T01:55:49.270451+0000","last_active":"2024-04-01T02:12:38.722329+0000","last_peered":"2024-04-01T02:12:38.722329+0000","last_clean":"2024-04-01T02:12:38.722329+0000","last_became_active":"2024-04-01T01:55:49.269636+0000","last_became_peered":"2024-04-01T01:55:49.269636+0000","last_unstale":"2024-04-01T02:12:38.722329+0000","last_undegraded":"2024-04-01T02:12:38.722329+0000","last_fullsized":"2024-04-01T02:12:38.722329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":882,"log_dups_size":0,"ondisk_log_size":882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:11:14.234867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6037504,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":748,"num_write_kb":31167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"23'555","reported_seq":579,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.683302+0000","last_change":"2024-04-01T01:55:49.266187+0000","last_active":"2024-04-01T02:12:38.683302+0000","last_peered":"2024-04-01T02:12:38.683302+0000","last_clean":"2024-04-01T02:12:38.683302+0000","last_became_active":"2024-04-01T01:55:49.265946+0000","last_became_peered":"2024-04-01T01:55:49.265946+0000","last_unstale":"2024-04-01T02:12:38.683302+0000","last_undegraded":"2024-04-01T02:12:38.683302+0000","last_fullsized":"2024-04-01T02:12:38.683302+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":555,"log_dups_size":0,"ondisk_log_size":555,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:37:46.890765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4188782,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":415,"num_write_kb":13639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"23'519","reported_seq":543,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.715900+0000","last_change":"2024-04-01T01:55:49.273104+0000","last_active":"2024-04-01T02:12:38.715900+0000","last_peered":"2024-04-01T02:12:38.715900+0000","last_clean":"2024-04-01T02:12:38.715900+0000","last_became_active":"2024-04-01T01:55:49.272742+0000","last_became_peered":"2024-04-01T01:55:49.272742+0000","last_unstale":"2024-04-01T02:12:38.715900+0000","last_undegraded":"2024-04-01T02:12:38.715900+0000","last_fullsized":"2024-04-01T02:12:38.715900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":519,"log_dups_size":0,"ondisk_log_size":519,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:37:46.890765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2869248,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":375,"num_write_kb":19168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"23'536","reported_seq":558,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.691868+0000","last_change":"2024-04-01T01:55:49.241595+0000","last_active":"2024-04-01T02:12:38.691868+0000","last_peered":"2024-04-01T02:12:38.691868+0000","last_clean":"2024-04-01T02:12:38.691868+0000","last_became_active":"2024-04-01T01:55:49.238286+0000","last_became_peered":"2024-04-01T01:55:49.238286+0000","last_unstale":"2024-04-01T02:12:38.691868+0000","last_undegraded":"2024-04-01T02:12:38.691868+0000","last_fullsized":"2024-04-01T02:12:38.691868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":536,"log_dups_size":0,"ondisk_log_size":536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:06:48.999905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6652831,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":403,"num_write_kb":17955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"23'644","reported_seq":668,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:08:21.199984+0000","last_change":"2024-04-01T01:55:48.225145+0000","last_active":"2024-04-01T02:08:21.199984+0000","last_peered":"2024-04-01T02:08:21.199984+0000","last_clean":"2024-04-01T02:08:21.199984+0000","last_became_active":"2024-04-01T01:55:48.224408+0000","last_became_peered":"2024-04-01T01:55:48.224408+0000","last_unstale":"2024-04-01T02:08:21.199984+0000","last_undegraded":"2024-04-01T02:08:21.199984+0000","last_fullsized":"2024-04-01T02:08:21.199984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":644,"log_dups_size":0,"ondisk_log_size":644,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:41:59.465915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":643,"num_write_kb":4346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"23'476","reported_seq":498,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.721153+0000","last_change":"2024-04-01T01:55:49.247771+0000","last_active":"2024-04-01T02:12:38.721153+0000","last_peered":"2024-04-01T02:12:38.721153+0000","last_clean":"2024-04-01T02:12:38.721153+0000","last_became_active":"2024-04-01T01:55:49.247496+0000","last_became_peered":"2024-04-01T01:55:49.247496+0000","last_unstale":"2024-04-01T02:12:38.721153+0000","last_undegraded":"2024-04-01T02:12:38.721153+0000","last_fullsized":"2024-04-01T02:12:38.721153+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":476,"log_dups_size":0,"ondisk_log_size":476,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:02:25.180455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3922463,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":358,"num_write_kb":10126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"23'1916","reported_seq":1940,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.604118+0000","last_change":"2024-04-01T01:55:48.221934+0000","last_active":"2024-04-01T02:12:38.604118+0000","last_peered":"2024-04-01T02:12:38.604118+0000","last_clean":"2024-04-01T02:12:38.604118+0000","last_became_active":"2024-04-01T01:55:48.221614+0000","last_became_peered":"2024-04-01T01:55:48.221614+0000","last_unstale":"2024-04-01T02:12:38.604118+0000","last_undegraded":"2024-04-01T02:12:38.604118+0000","last_fullsized":"2024-04-01T02:12:38.604118+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":1916,"log_dups_size":0,"ondisk_log_size":1916,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:06:47.990123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16687772,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1912,"num_write_kb":17167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"23'393","reported_seq":417,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:10:16.229529+0000","last_change":"2024-04-01T01:55:48.217879+0000","last_active":"2024-04-01T02:10:16.229529+0000","last_peered":"2024-04-01T02:10:16.229529+0000","last_clean":"2024-04-01T02:10:16.229529+0000","last_became_active":"2024-04-01T01:55:48.216141+0000","last_became_peered":"2024-04-01T01:55:48.216141+0000","last_unstale":"2024-04-01T02:10:16.229529+0000","last_undegraded":"2024-04-01T02:10:16.229529+0000","last_fullsized":"2024-04-01T02:10:16.229529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:36:42.625449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":392,"num_write_kb":4245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"23'553","reported_seq":575,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.685589+0000","last_change":"2024-04-01T01:55:49.246424+0000","last_active":"2024-04-01T02:12:38.685589+0000","last_peered":"2024-04-01T02:12:38.685589+0000","last_clean":"2024-04-01T02:12:38.685589+0000","last_became_active":"2024-04-01T01:55:49.243823+0000","last_became_peered":"2024-04-01T01:55:49.243823+0000","last_unstale":"2024-04-01T02:12:38.685589+0000","last_undegraded":"2024-04-01T02:12:38.685589+0000","last_fullsized":"2024-04-01T02:12:38.685589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":553,"log_dups_size":0,"ondisk_log_size":553,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:27:45.663474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3965184,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":412,"num_write_kb":14098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"23'1752","reported_seq":1777,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:11:59.821172+0000","last_change":"2024-04-01T01:55:48.222831+0000","last_active":"2024-04-01T02:11:59.821172+0000","last_peered":"2024-04-01T02:11:59.821172+0000","last_clean":"2024-04-01T02:11:59.821172+0000","last_became_active":"2024-04-01T01:55:48.222535+0000","last_became_peered":"2024-04-01T01:55:48.222535+0000","last_unstale":"2024-04-01T02:11:59.821172+0000","last_undegraded":"2024-04-01T02:11:59.821172+0000","last_fullsized":"2024-04-01T02:11:59.821172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":1752,"log_dups_size":0,"ondisk_log_size":1752,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:49:34.960786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1749,"num_write_kb":12993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"23'533","reported_seq":555,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.685623+0000","last_change":"2024-04-01T01:55:49.231967+0000","last_active":"2024-04-01T02:12:38.685623+0000","last_peered":"2024-04-01T02:12:38.685623+0000","last_clean":"2024-04-01T02:12:38.685623+0000","last_became_active":"2024-04-01T01:55:49.230659+0000","last_became_peered":"2024-04-01T01:55:49.230659+0000","last_unstale":"2024-04-01T02:12:38.685623+0000","last_undegraded":"2024-04-01T02:12:38.685623+0000","last_fullsized":"2024-04-01T02:12:38.685623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":533,"log_dups_size":0,"ondisk_log_size":533,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:57:31.843504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3477908,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":407,"num_write_kb":10690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"23'1","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:10:18.221449+0000","last_change":"2024-04-01T01:55:48.216724+0000","last_active":"2024-04-01T02:10:18.221449+0000","last_peered":"2024-04-01T02:10:18.221449+0000","last_clean":"2024-04-01T02:10:18.221449+0000","last_became_active":"2024-04-01T01:55:48.216318+0000","last_became_peered":"2024-04-01T01:55:48.216318+0000","last_unstale":"2024-04-01T02:10:18.221449+0000","last_undegraded":"2024-04-01T02:10:18.221449+0000","last_fullsized":"2024-04-01T02:10:18.221449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:25:51.219789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"23'551","reported_seq":573,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.741076+0000","last_change":"2024-04-01T01:55:49.280230+0000","last_active":"2024-04-01T02:12:38.741076+0000","last_peered":"2024-04-01T02:12:38.741076+0000","last_clean":"2024-04-01T02:12:38.741076+0000","last_became_active":"2024-04-01T01:55:49.279866+0000","last_became_peered":"2024-04-01T01:55:49.279866+0000","last_unstale":"2024-04-01T02:12:38.741076+0000","last_undegraded":"2024-04-01T02:12:38.741076+0000","last_fullsized":"2024-04-01T02:12:38.741076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":551,"log_dups_size":0,"ondisk_log_size":551,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:00:34.607980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2636189,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":401,"num_write_kb":10506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"23'494","reported_seq":519,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:27.512140+0000","last_change":"2024-04-01T01:55:48.213879+0000","last_active":"2024-04-01T02:12:27.512140+0000","last_peered":"2024-04-01T02:12:27.512140+0000","last_clean":"2024-04-01T02:12:27.512140+0000","last_became_active":"2024-04-01T01:55:48.213610+0000","last_became_peered":"2024-04-01T01:55:48.213610+0000","last_unstale":"2024-04-01T02:12:27.512140+0000","last_undegraded":"2024-04-01T02:12:27.512140+0000","last_fullsized":"2024-04-01T02:12:27.512140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":494,"log_dups_size":0,"ondisk_log_size":494,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:33:55.744424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":490,"num_write_kb":4342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"23'507","reported_seq":529,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.704049+0000","last_change":"2024-04-01T01:55:49.261532+0000","last_active":"2024-04-01T02:12:38.704049+0000","last_peered":"2024-04-01T02:12:38.704049+0000","last_clean":"2024-04-01T02:12:38.704049+0000","last_became_active":"2024-04-01T01:55:49.261260+0000","last_became_peered":"2024-04-01T01:55:49.261260+0000","last_unstale":"2024-04-01T02:12:38.704049+0000","last_undegraded":"2024-04-01T02:12:38.704049+0000","last_fullsized":"2024-04-01T02:12:38.704049+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":507,"log_dups_size":0,"ondisk_log_size":507,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:30:02.149564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2169152,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":377,"num_write_kb":10428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"23'1317","reported_seq":1342,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:37.139675+0000","last_change":"2024-04-01T01:55:48.227054+0000","last_active":"2024-04-01T02:12:37.139675+0000","last_peered":"2024-04-01T02:12:37.139675+0000","last_clean":"2024-04-01T02:12:37.139675+0000","last_became_active":"2024-04-01T01:55:48.226061+0000","last_became_peered":"2024-04-01T01:55:48.226061+0000","last_unstale":"2024-04-01T02:12:37.139675+0000","last_undegraded":"2024-04-01T02:12:37.139675+0000","last_fullsized":"2024-04-01T02:12:37.139675+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":1317,"log_dups_size":0,"ondisk_log_size":1317,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:18:27.840431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1316,"num_write_kb":5169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"23'650","reported_seq":673,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.727577+0000","last_change":"2024-04-01T01:55:49.261662+0000","last_active":"2024-04-01T02:12:38.727577+0000","last_peered":"2024-04-01T02:12:38.727577+0000","last_clean":"2024-04-01T02:12:38.727577+0000","last_became_active":"2024-04-01T01:55:49.261286+0000","last_became_peered":"2024-04-01T01:55:49.261286+0000","last_unstale":"2024-04-01T02:12:38.727577+0000","last_undegraded":"2024-04-01T02:12:38.727577+0000","last_fullsized":"2024-04-01T02:12:38.727577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":650,"log_dups_size":0,"ondisk_log_size":650,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:56:11.350186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3031627,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":532,"num_write_kb":22303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"23'1654","reported_seq":1679,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:23.004257+0000","last_change":"2024-04-01T01:55:48.219739+0000","last_active":"2024-04-01T02:12:23.004257+0000","last_peered":"2024-04-01T02:12:23.004257+0000","last_clean":"2024-04-01T02:12:23.004257+0000","last_became_active":"2024-04-01T01:55:48.219107+0000","last_became_peered":"2024-04-01T01:55:48.219107+0000","last_unstale":"2024-04-01T02:12:23.004257+0000","last_undegraded":"2024-04-01T02:12:23.004257+0000","last_fullsized":"2024-04-01T02:12:23.004257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":1654,"log_dups_size":0,"ondisk_log_size":1654,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:14:12.790111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1651,"num_write_kb":13025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"23'479","reported_seq":501,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.717152+0000","last_change":"2024-04-01T01:55:49.255056+0000","last_active":"2024-04-01T02:12:38.717152+0000","last_peered":"2024-04-01T02:12:38.717152+0000","last_clean":"2024-04-01T02:12:38.717152+0000","last_became_active":"2024-04-01T01:55:49.247910+0000","last_became_peered":"2024-04-01T01:55:49.247910+0000","last_unstale":"2024-04-01T02:12:38.717152+0000","last_undegraded":"2024-04-01T02:12:38.717152+0000","last_fullsized":"2024-04-01T02:12:38.717152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":479,"log_dups_size":0,"ondisk_log_size":479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T13:02:55.577616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3214612,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":324,"num_write_kb":15075,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"23'1306","reported_seq":1331,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:09:48.210530+0000","last_change":"2024-04-01T01:55:48.215613+0000","last_active":"2024-04-01T02:09:48.210530+0000","last_peered":"2024-04-01T02:09:48.210530+0000","last_clean":"2024-04-01T02:09:48.210530+0000","last_became_active":"2024-04-01T01:55:48.214669+0000","last_became_peered":"2024-04-01T01:55:48.214669+0000","last_unstale":"2024-04-01T02:09:48.210530+0000","last_undegraded":"2024-04-01T02:09:48.210530+0000","last_fullsized":"2024-04-01T02:09:48.210530+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":1306,"log_dups_size":0,"ondisk_log_size":1306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:25:51.219789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1305,"num_write_kb":8736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"23'502","reported_seq":525,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.703951+0000","last_change":"2024-04-01T01:55:49.270153+0000","last_active":"2024-04-01T02:12:38.703951+0000","last_peered":"2024-04-01T02:12:38.703951+0000","last_clean":"2024-04-01T02:12:38.703951+0000","last_became_active":"2024-04-01T01:55:49.269840+0000","last_became_peered":"2024-04-01T01:55:49.269840+0000","last_unstale":"2024-04-01T02:12:38.703951+0000","last_undegraded":"2024-04-01T02:12:38.703951+0000","last_fullsized":"2024-04-01T02:12:38.703951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":502,"log_dups_size":0,"ondisk_log_size":502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:00:34.607980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2873887,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":372,"num_write_kb":10690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:09:48.231670+0000","last_change":"2024-04-01T01:55:48.214783+0000","last_active":"2024-04-01T02:09:48.231670+0000","last_peered":"2024-04-01T02:09:48.231670+0000","last_clean":"2024-04-01T02:09:48.231670+0000","last_became_active":"2024-04-01T01:55:48.213463+0000","last_became_peered":"2024-04-01T01:55:48.213463+0000","last_unstale":"2024-04-01T02:09:48.231670+0000","last_undegraded":"2024-04-01T02:09:48.231670+0000","last_fullsized":"2024-04-01T02:09:48.231670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:00:33.598198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"23'694","reported_seq":717,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.732478+0000","last_change":"2024-04-01T01:55:49.274841+0000","last_active":"2024-04-01T02:12:38.732478+0000","last_peered":"2024-04-01T02:12:38.732478+0000","last_clean":"2024-04-01T02:12:38.732478+0000","last_became_active":"2024-04-01T01:55:49.274430+0000","last_became_peered":"2024-04-01T01:55:49.274430+0000","last_unstale":"2024-04-01T02:12:38.732478+0000","last_undegraded":"2024-04-01T02:12:38.732478+0000","last_fullsized":"2024-04-01T02:12:38.732478+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":694,"log_dups_size":0,"ondisk_log_size":694,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T13:25:36.254927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1869911,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":559,"num_write_kb":109429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:09:48.233532+0000","last_change":"2024-04-01T01:55:48.210944+0000","last_active":"2024-04-01T02:09:48.233532+0000","last_peered":"2024-04-01T02:09:48.233532+0000","last_clean":"2024-04-01T02:09:48.233532+0000","last_became_active":"2024-04-01T01:55:48.210616+0000","last_became_peered":"2024-04-01T01:55:48.210616+0000","last_unstale":"2024-04-01T02:09:48.233532+0000","last_undegraded":"2024-04-01T02:09:48.233532+0000","last_fullsized":"2024-04-01T02:09:48.233532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:38:32.247471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"23'514","reported_seq":537,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.691443+0000","last_change":"2024-04-01T01:55:49.239528+0000","last_active":"2024-04-01T02:12:38.691443+0000","last_peered":"2024-04-01T02:12:38.691443+0000","last_clean":"2024-04-01T02:12:38.691443+0000","last_became_active":"2024-04-01T01:55:49.238805+0000","last_became_peered":"2024-04-01T01:55:49.238805+0000","last_unstale":"2024-04-01T02:12:38.691443+0000","last_undegraded":"2024-04-01T02:12:38.691443+0000","last_fullsized":"2024-04-01T02:12:38.691443+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":514,"log_dups_size":0,"ondisk_log_size":514,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:37:46.890765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1821215,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":368,"num_write_kb":8386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"23'816","reported_seq":841,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:11:05.530786+0000","last_change":"2024-04-01T01:55:48.211677+0000","last_active":"2024-04-01T02:11:05.530786+0000","last_peered":"2024-04-01T02:11:05.530786+0000","last_clean":"2024-04-01T02:11:05.530786+0000","last_became_active":"2024-04-01T01:55:48.210893+0000","last_became_peered":"2024-04-01T01:55:48.210893+0000","last_unstale":"2024-04-01T02:11:05.530786+0000","last_undegraded":"2024-04-01T02:11:05.530786+0000","last_fullsized":"2024-04-01T02:11:05.530786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:04:19.568533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":818,"num_write_kb":8585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"23'607","reported_seq":630,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.717565+0000","last_change":"2024-04-01T01:55:49.261872+0000","last_active":"2024-04-01T02:12:38.717565+0000","last_peered":"2024-04-01T02:12:38.717565+0000","last_clean":"2024-04-01T02:12:38.717565+0000","last_became_active":"2024-04-01T01:55:49.261517+0000","last_became_peered":"2024-04-01T01:55:49.261517+0000","last_unstale":"2024-04-01T02:12:38.717565+0000","last_undegraded":"2024-04-01T02:12:38.717565+0000","last_fullsized":"2024-04-01T02:12:38.717565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":607,"log_dups_size":0,"ondisk_log_size":607,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T13:02:55.577616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5805184,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":464,"num_write_kb":32813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"23'422","reported_seq":447,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:09:43.759499+0000","last_change":"2024-04-01T01:55:48.198687+0000","last_active":"2024-04-01T02:09:43.759499+0000","last_peered":"2024-04-01T02:09:43.759499+0000","last_clean":"2024-04-01T02:09:43.759499+0000","last_became_active":"2024-04-01T01:55:48.198319+0000","last_became_peered":"2024-04-01T01:55:48.198319+0000","last_unstale":"2024-04-01T02:09:43.759499+0000","last_undegraded":"2024-04-01T02:09:43.759499+0000","last_fullsized":"2024-04-01T02:09:43.759499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:37:45.880984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":421,"num_write_kb":4293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"23'517","reported_seq":540,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.738045+0000","last_change":"2024-04-01T01:55:49.272424+0000","last_active":"2024-04-01T02:12:38.738045+0000","last_peered":"2024-04-01T02:12:38.738045+0000","last_clean":"2024-04-01T02:12:38.738045+0000","last_became_active":"2024-04-01T01:55:49.265670+0000","last_became_peered":"2024-04-01T01:55:49.265670+0000","last_unstale":"2024-04-01T02:12:38.738045+0000","last_undegraded":"2024-04-01T02:12:38.738045+0000","last_fullsized":"2024-04-01T02:12:38.738045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":517,"log_dups_size":0,"ondisk_log_size":517,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:26:09.632757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4958208,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":395,"num_write_kb":11184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"23'500","reported_seq":525,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:09:22.676923+0000","last_change":"2024-04-01T01:55:48.219312+0000","last_active":"2024-04-01T02:09:22.676923+0000","last_peered":"2024-04-01T02:09:22.676923+0000","last_clean":"2024-04-01T02:09:22.676923+0000","last_became_active":"2024-04-01T01:55:48.218562+0000","last_became_peered":"2024-04-01T01:55:48.218562+0000","last_unstale":"2024-04-01T02:09:22.676923+0000","last_undegraded":"2024-04-01T02:09:22.676923+0000","last_fullsized":"2024-04-01T02:09:22.676923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":500,"log_dups_size":0,"ondisk_log_size":500,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:38:32.247471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":500,"num_write_kb":4281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"23'489","reported_seq":512,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.733305+0000","last_change":"2024-04-01T01:55:49.268041+0000","last_active":"2024-04-01T02:12:38.733305+0000","last_peered":"2024-04-01T02:12:38.733305+0000","last_clean":"2024-04-01T02:12:38.733305+0000","last_became_active":"2024-04-01T01:55:49.267502+0000","last_became_peered":"2024-04-01T01:55:49.267502+0000","last_unstale":"2024-04-01T02:12:38.733305+0000","last_undegraded":"2024-04-01T02:12:38.733305+0000","last_fullsized":"2024-04-01T02:12:38.733305+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":489,"log_dups_size":0,"ondisk_log_size":489,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:21:46.367144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2609152,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":355,"num_write_kb":9167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"23'652","reported_seq":677,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:09:21.209057+0000","last_change":"2024-04-01T01:55:48.216662+0000","last_active":"2024-04-01T02:09:21.209057+0000","last_peered":"2024-04-01T02:09:21.209057+0000","last_clean":"2024-04-01T02:09:21.209057+0000","last_became_active":"2024-04-01T01:55:48.215852+0000","last_became_peered":"2024-04-01T01:55:48.215852+0000","last_unstale":"2024-04-01T02:09:21.209057+0000","last_undegraded":"2024-04-01T02:09:21.209057+0000","last_fullsized":"2024-04-01T02:09:21.209057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":652,"log_dups_size":0,"ondisk_log_size":652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:25:39.713293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":651,"num_write_kb":4358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"23'532","reported_seq":555,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.706848+0000","last_change":"2024-04-01T01:55:49.256142+0000","last_active":"2024-04-01T02:12:38.706848+0000","last_peered":"2024-04-01T02:12:38.706848+0000","last_clean":"2024-04-01T02:12:38.706848+0000","last_became_active":"2024-04-01T01:55:49.255781+0000","last_became_peered":"2024-04-01T01:55:49.255781+0000","last_unstale":"2024-04-01T02:12:38.706848+0000","last_undegraded":"2024-04-01T02:12:38.706848+0000","last_fullsized":"2024-04-01T02:12:38.706848+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":532,"log_dups_size":0,"ondisk_log_size":532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:10:23.571126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3486100,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384,"num_write_kb":10452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"23'482","reported_seq":507,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:07.732858+0000","last_change":"2024-04-01T01:55:48.219851+0000","last_active":"2024-04-01T02:12:07.732858+0000","last_peered":"2024-04-01T02:12:07.732858+0000","last_clean":"2024-04-01T02:12:07.732858+0000","last_became_active":"2024-04-01T01:55:48.215898+0000","last_became_peered":"2024-04-01T01:55:48.215898+0000","last_unstale":"2024-04-01T02:12:07.732858+0000","last_undegraded":"2024-04-01T02:12:07.732858+0000","last_fullsized":"2024-04-01T02:12:07.732858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:18:27.840431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":481,"num_write_kb":4326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"23'543","reported_seq":566,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.725313+0000","last_change":"2024-04-01T01:55:49.275452+0000","last_active":"2024-04-01T02:12:38.725313+0000","last_peered":"2024-04-01T02:12:38.725313+0000","last_clean":"2024-04-01T02:12:38.725313+0000","last_became_active":"2024-04-01T01:55:49.274600+0000","last_became_peered":"2024-04-01T01:55:49.274600+0000","last_unstale":"2024-04-01T02:12:38.725313+0000","last_undegraded":"2024-04-01T02:12:38.725313+0000","last_fullsized":"2024-04-01T02:12:38.725313+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":543,"log_dups_size":0,"ondisk_log_size":543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:19:24.052574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3740270,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":421,"num_write_kb":13583,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":182,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:09:43.218713+0000","last_change":"2024-04-01T01:55:43.145201+0000","last_active":"2024-04-01T02:09:43.218713+0000","last_peered":"2024-04-01T02:09:43.218713+0000","last_clean":"2024-04-01T02:09:43.218713+0000","last_became_active":"2024-04-01T01:55:43.144882+0000","last_became_peered":"2024-04-01T01:55:43.144882+0000","last_unstale":"2024-04-01T02:09:43.218713+0000","last_undegraded":"2024-04-01T02:09:43.218713+0000","last_fullsized":"2024-04-01T02:09:43.218713+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:42.134502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:42.134502+0000","last_clean_scrub_stamp":"2024-04-01T01:55:42.134502+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:02:26.589535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"23'539","reported_seq":565,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:11:39.852771+0000","last_change":"2024-04-01T01:55:48.207222+0000","last_active":"2024-04-01T02:11:39.852771+0000","last_peered":"2024-04-01T02:11:39.852771+0000","last_clean":"2024-04-01T02:11:39.852771+0000","last_became_active":"2024-04-01T01:55:48.206293+0000","last_became_peered":"2024-04-01T01:55:48.206293+0000","last_unstale":"2024-04-01T02:11:39.852771+0000","last_undegraded":"2024-04-01T02:11:39.852771+0000","last_fullsized":"2024-04-01T02:11:39.852771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":539,"log_dups_size":0,"ondisk_log_size":539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:37:45.880984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":538,"num_write_kb":4366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"23'475","reported_seq":499,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.699425+0000","last_change":"2024-04-01T01:55:49.273517+0000","last_active":"2024-04-01T02:12:38.699425+0000","last_peered":"2024-04-01T02:12:38.699425+0000","last_clean":"2024-04-01T02:12:38.699425+0000","last_became_active":"2024-04-01T01:55:49.273197+0000","last_became_peered":"2024-04-01T01:55:49.273197+0000","last_unstale":"2024-04-01T02:12:38.699425+0000","last_undegraded":"2024-04-01T02:12:38.699425+0000","last_fullsized":"2024-04-01T02:12:38.699425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:14:32.577522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2100352,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":362,"num_write_kb":7512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"23'1724","reported_seq":1750,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:11:27.553670+0000","last_change":"2024-04-01T01:55:48.214341+0000","last_active":"2024-04-01T02:11:27.553670+0000","last_peered":"2024-04-01T02:11:27.553670+0000","last_clean":"2024-04-01T02:11:27.553670+0000","last_became_active":"2024-04-01T01:55:48.213914+0000","last_became_peered":"2024-04-01T01:55:48.213914+0000","last_unstale":"2024-04-01T02:11:27.553670+0000","last_undegraded":"2024-04-01T02:11:27.553670+0000","last_fullsized":"2024-04-01T02:11:27.553670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":1724,"log_dups_size":0,"ondisk_log_size":1724,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:09:28.276592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1721,"num_write_kb":12994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"23'521","reported_seq":545,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.699651+0000","last_change":"2024-04-01T01:55:49.272106+0000","last_active":"2024-04-01T02:12:38.699651+0000","last_peered":"2024-04-01T02:12:38.699651+0000","last_clean":"2024-04-01T02:12:38.699651+0000","last_became_active":"2024-04-01T01:55:49.271821+0000","last_became_peered":"2024-04-01T01:55:49.271821+0000","last_unstale":"2024-04-01T02:12:38.699651+0000","last_undegraded":"2024-04-01T02:12:38.699651+0000","last_fullsized":"2024-04-01T02:12:38.699651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":521,"log_dups_size":0,"ondisk_log_size":521,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T13:22:31.821166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2398580,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":392,"num_write_kb":9213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"23'1760","reported_seq":3545,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:37.134355+0000","last_change":"2024-04-01T01:55:48.218296+0000","last_active":"2024-04-01T02:12:37.134355+0000","last_peered":"2024-04-01T02:12:37.134355+0000","last_clean":"2024-04-01T02:12:37.134355+0000","last_became_active":"2024-04-01T01:55:48.217516+0000","last_became_peered":"2024-04-01T01:55:48.217516+0000","last_unstale":"2024-04-01T02:12:37.134355+0000","last_undegraded":"2024-04-01T02:12:37.134355+0000","last_fullsized":"2024-04-01T02:12:37.134355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":1760,"log_dups_size":0,"ondisk_log_size":1760,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:36:42.625449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1520757,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1759,"num_read_kb":2743,"num_write":1759,"num_write_kb":2743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"23'578","reported_seq":602,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.683159+0000","last_change":"2024-04-01T01:55:49.246734+0000","last_active":"2024-04-01T02:12:38.683159+0000","last_peered":"2024-04-01T02:12:38.683159+0000","last_clean":"2024-04-01T02:12:38.683159+0000","last_became_active":"2024-04-01T01:55:49.246152+0000","last_became_peered":"2024-04-01T01:55:49.246152+0000","last_unstale":"2024-04-01T02:12:38.683159+0000","last_undegraded":"2024-04-01T02:12:38.683159+0000","last_fullsized":"2024-04-01T02:12:38.683159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":578,"log_dups_size":0,"ondisk_log_size":578,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:52:34.992185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4683946,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":447,"num_write_kb":12840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"23'1294","reported_seq":1320,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:10:23.234493+0000","last_change":"2024-04-01T01:55:48.222956+0000","last_active":"2024-04-01T02:10:23.234493+0000","last_peered":"2024-04-01T02:10:23.234493+0000","last_clean":"2024-04-01T02:10:23.234493+0000","last_became_active":"2024-04-01T01:55:48.222414+0000","last_became_peered":"2024-04-01T01:55:48.222414+0000","last_unstale":"2024-04-01T02:10:23.234493+0000","last_undegraded":"2024-04-01T02:10:23.234493+0000","last_fullsized":"2024-04-01T02:10:23.234493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":1294,"log_dups_size":0,"ondisk_log_size":1294,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:26:08.622975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1292,"num_write_kb":8711,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"23'509","reported_seq":533,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.733441+0000","last_change":"2024-04-01T01:55:49.247633+0000","last_active":"2024-04-01T02:12:38.733441+0000","last_peered":"2024-04-01T02:12:38.733441+0000","last_clean":"2024-04-01T02:12:38.733441+0000","last_became_active":"2024-04-01T01:55:49.247285+0000","last_became_peered":"2024-04-01T01:55:49.247285+0000","last_unstale":"2024-04-01T02:12:38.733441+0000","last_undegraded":"2024-04-01T02:12:38.733441+0000","last_fullsized":"2024-04-01T02:12:38.733441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":509,"log_dups_size":0,"ondisk_log_size":509,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:15:01.912111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1905973,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":374,"num_write_kb":9925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"23'411","reported_seq":437,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:11:49.203845+0000","last_change":"2024-04-01T01:55:48.226323+0000","last_active":"2024-04-01T02:11:49.203845+0000","last_peered":"2024-04-01T02:11:49.203845+0000","last_clean":"2024-04-01T02:11:49.203845+0000","last_became_active":"2024-04-01T01:55:48.225487+0000","last_became_peered":"2024-04-01T01:55:48.225487+0000","last_unstale":"2024-04-01T02:11:49.203845+0000","last_undegraded":"2024-04-01T02:11:49.203845+0000","last_fullsized":"2024-04-01T02:11:49.203845+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:13:17.832963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":410,"num_write_kb":4283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"23'561","reported_seq":585,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.695026+0000","last_change":"2024-04-01T01:55:49.265542+0000","last_active":"2024-04-01T02:12:38.695026+0000","last_peered":"2024-04-01T02:12:38.695026+0000","last_clean":"2024-04-01T02:12:38.695026+0000","last_became_active":"2024-04-01T01:55:49.264914+0000","last_became_peered":"2024-04-01T01:55:49.264914+0000","last_unstale":"2024-04-01T02:12:38.695026+0000","last_undegraded":"2024-04-01T02:12:38.695026+0000","last_fullsized":"2024-04-01T02:12:38.695026+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":561,"log_dups_size":0,"ondisk_log_size":561,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:55:44.175129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3471816,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":416,"num_write_kb":10624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"23'809","reported_seq":835,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:11:54.724715+0000","last_change":"2024-04-01T01:55:48.227292+0000","last_active":"2024-04-01T02:11:54.724715+0000","last_peered":"2024-04-01T02:11:54.724715+0000","last_clean":"2024-04-01T02:11:54.724715+0000","last_became_active":"2024-04-01T01:55:48.226948+0000","last_became_peered":"2024-04-01T01:55:48.226948+0000","last_unstale":"2024-04-01T02:11:54.724715+0000","last_undegraded":"2024-04-01T02:11:54.724715+0000","last_fullsized":"2024-04-01T02:11:54.724715+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":809,"log_dups_size":0,"ondisk_log_size":809,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:55:43.165347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":807,"num_write_kb":8573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"23'580","reported_seq":604,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.666892+0000","last_change":"2024-04-01T01:55:49.244171+0000","last_active":"2024-04-01T02:12:38.666892+0000","last_peered":"2024-04-01T02:12:38.666892+0000","last_clean":"2024-04-01T02:12:38.666892+0000","last_became_active":"2024-04-01T01:55:49.241632+0000","last_became_peered":"2024-04-01T01:55:49.241632+0000","last_unstale":"2024-04-01T02:12:38.666892+0000","last_undegraded":"2024-04-01T02:12:38.666892+0000","last_fullsized":"2024-04-01T02:12:38.666892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":580,"log_dups_size":0,"ondisk_log_size":580,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:24:42.777720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1649698,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":453,"num_write_kb":12096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"23'923","reported_seq":948,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.128694+0000","last_change":"2024-04-01T01:55:48.204432+0000","last_active":"2024-04-01T02:12:38.128694+0000","last_peered":"2024-04-01T02:12:38.128694+0000","last_clean":"2024-04-01T02:12:38.128694+0000","last_became_active":"2024-04-01T01:55:48.203576+0000","last_became_peered":"2024-04-01T01:55:48.203576+0000","last_unstale":"2024-04-01T02:12:38.128694+0000","last_undegraded":"2024-04-01T02:12:38.128694+0000","last_fullsized":"2024-04-01T02:12:38.128694+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":923,"log_dups_size":0,"ondisk_log_size":923,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:49:34.960786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2724,"num_write_kb":1428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"23'518","reported_seq":541,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.675180+0000","last_change":"2024-04-01T01:55:49.244993+0000","last_active":"2024-04-01T02:12:38.675180+0000","last_peered":"2024-04-01T02:12:38.675180+0000","last_clean":"2024-04-01T02:12:38.675180+0000","last_became_active":"2024-04-01T01:55:49.244632+0000","last_became_peered":"2024-04-01T01:55:49.244632+0000","last_unstale":"2024-04-01T02:12:38.675180+0000","last_undegraded":"2024-04-01T02:12:38.675180+0000","last_fullsized":"2024-04-01T02:12:38.675180+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":518,"log_dups_size":0,"ondisk_log_size":518,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:30:26.148968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2231074,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":416,"num_write_kb":11781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"23'451","reported_seq":476,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:11:20.248134+0000","last_change":"2024-04-01T01:55:48.221282+0000","last_active":"2024-04-01T02:11:20.248134+0000","last_peered":"2024-04-01T02:11:20.248134+0000","last_clean":"2024-04-01T02:11:20.248134+0000","last_became_active":"2024-04-01T01:55:48.220889+0000","last_became_peered":"2024-04-01T01:55:48.220889+0000","last_unstale":"2024-04-01T02:11:20.248134+0000","last_undegraded":"2024-04-01T02:11:20.248134+0000","last_fullsized":"2024-04-01T02:11:20.248134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:13:12.104386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":451,"num_write_kb":4303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"23'576","reported_seq":599,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.681858+0000","last_change":"2024-04-01T01:55:49.251927+0000","last_active":"2024-04-01T02:12:38.681858+0000","last_peered":"2024-04-01T02:12:38.681858+0000","last_clean":"2024-04-01T02:12:38.681858+0000","last_became_active":"2024-04-01T01:55:49.251641+0000","last_became_peered":"2024-04-01T01:55:49.251641+0000","last_unstale":"2024-04-01T02:12:38.681858+0000","last_undegraded":"2024-04-01T02:12:38.681858+0000","last_fullsized":"2024-04-01T02:12:38.681858+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T13:22:31.821166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1372160,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":436,"num_write_kb":14438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"23'656","reported_seq":681,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:08:48.226321+0000","last_change":"2024-04-01T01:55:48.204161+0000","last_active":"2024-04-01T02:08:48.226321+0000","last_peered":"2024-04-01T02:08:48.226321+0000","last_clean":"2024-04-01T02:08:48.226321+0000","last_became_active":"2024-04-01T01:55:48.203828+0000","last_became_peered":"2024-04-01T01:55:48.203828+0000","last_unstale":"2024-04-01T02:08:48.226321+0000","last_undegraded":"2024-04-01T02:08:48.226321+0000","last_fullsized":"2024-04-01T02:08:48.226321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":656,"log_dups_size":0,"ondisk_log_size":656,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:04:19.568533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":655,"num_write_kb":4360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"23'536","reported_seq":559,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:35.139930+0000","last_change":"2024-04-01T01:55:49.259699+0000","last_active":"2024-04-01T02:12:35.139930+0000","last_peered":"2024-04-01T02:12:35.139930+0000","last_clean":"2024-04-01T02:12:35.139930+0000","last_became_active":"2024-04-01T01:55:49.259332+0000","last_became_peered":"2024-04-01T01:55:49.259332+0000","last_unstale":"2024-04-01T02:12:35.139930+0000","last_undegraded":"2024-04-01T02:12:35.139930+0000","last_fullsized":"2024-04-01T02:12:35.139930+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":536,"log_dups_size":0,"ondisk_log_size":536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:02:41.829474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2628206,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":12728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"23'521","reported_seq":546,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:11:11.799786+0000","last_change":"2024-04-01T01:55:48.206742+0000","last_active":"2024-04-01T02:11:11.799786+0000","last_peered":"2024-04-01T02:11:11.799786+0000","last_clean":"2024-04-01T02:11:11.799786+0000","last_became_active":"2024-04-01T01:55:48.206027+0000","last_became_peered":"2024-04-01T01:55:48.206027+0000","last_unstale":"2024-04-01T02:11:11.799786+0000","last_undegraded":"2024-04-01T02:11:11.799786+0000","last_fullsized":"2024-04-01T02:11:11.799786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":521,"log_dups_size":0,"ondisk_log_size":521,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:18:27.840431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":520,"num_write_kb":4323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"23'492","reported_seq":515,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.675506+0000","last_change":"2024-04-01T01:55:49.246379+0000","last_active":"2024-04-01T02:12:38.675506+0000","last_peered":"2024-04-01T02:12:38.675506+0000","last_clean":"2024-04-01T02:12:38.675506+0000","last_became_active":"2024-04-01T01:55:49.245774+0000","last_became_peered":"2024-04-01T01:55:49.245774+0000","last_unstale":"2024-04-01T02:12:38.675506+0000","last_undegraded":"2024-04-01T02:12:38.675506+0000","last_fullsized":"2024-04-01T02:12:38.675506+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":492,"log_dups_size":0,"ondisk_log_size":492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:25:48.896071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2457258,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":347,"num_write_kb":7703,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"23'731","reported_seq":756,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:21.550193+0000","last_change":"2024-04-01T01:55:48.222218+0000","last_active":"2024-04-01T02:12:21.550193+0000","last_peered":"2024-04-01T02:12:21.550193+0000","last_clean":"2024-04-01T02:12:21.550193+0000","last_became_active":"2024-04-01T01:55:48.221148+0000","last_became_peered":"2024-04-01T01:55:48.221148+0000","last_unstale":"2024-04-01T02:12:21.550193+0000","last_undegraded":"2024-04-01T02:12:21.550193+0000","last_fullsized":"2024-04-01T02:12:21.550193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":731,"log_dups_size":0,"ondisk_log_size":731,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:25:51.219789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":729,"num_write_kb":8526,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"23'573","reported_seq":596,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.673104+0000","last_change":"2024-04-01T01:55:49.249648+0000","last_active":"2024-04-01T02:12:38.673104+0000","last_peered":"2024-04-01T02:12:38.673104+0000","last_clean":"2024-04-01T02:12:38.673104+0000","last_became_active":"2024-04-01T01:55:49.248925+0000","last_became_peered":"2024-04-01T01:55:49.248925+0000","last_unstale":"2024-04-01T02:12:38.673104+0000","last_undegraded":"2024-04-01T02:12:38.673104+0000","last_fullsized":"2024-04-01T02:12:38.673104+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":573,"log_dups_size":0,"ondisk_log_size":573,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:33:56.754206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4491912,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":426,"num_write_kb":28953,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"23'1469","reported_seq":1494,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:16.455768+0000","last_change":"2024-04-01T01:55:48.207522+0000","last_active":"2024-04-01T02:12:16.455768+0000","last_peered":"2024-04-01T02:12:16.455768+0000","last_clean":"2024-04-01T02:12:16.455768+0000","last_became_active":"2024-04-01T01:55:48.206856+0000","last_became_peered":"2024-04-01T01:55:48.206856+0000","last_unstale":"2024-04-01T02:12:16.455768+0000","last_undegraded":"2024-04-01T02:12:16.455768+0000","last_fullsized":"2024-04-01T02:12:16.455768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":1469,"log_dups_size":0,"ondisk_log_size":1469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:33:55.744424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1465,"num_write_kb":12919,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"23'559","reported_seq":582,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.722571+0000","last_change":"2024-04-01T01:55:49.274489+0000","last_active":"2024-04-01T02:12:38.722571+0000","last_peered":"2024-04-01T02:12:38.722571+0000","last_clean":"2024-04-01T02:12:38.722571+0000","last_became_active":"2024-04-01T01:55:49.270254+0000","last_became_peered":"2024-04-01T01:55:49.270254+0000","last_unstale":"2024-04-01T02:12:38.722571+0000","last_undegraded":"2024-04-01T02:12:38.722571+0000","last_fullsized":"2024-04-01T02:12:38.722571+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":559,"log_dups_size":0,"ondisk_log_size":559,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T13:09:00.491227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5269504,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":425,"num_write_kb":26844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"23'507","reported_seq":529,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.733757+0000","last_change":"2024-04-01T01:55:49.275782+0000","last_active":"2024-04-01T02:12:38.733757+0000","last_peered":"2024-04-01T02:12:38.733757+0000","last_clean":"2024-04-01T02:12:38.733757+0000","last_became_active":"2024-04-01T01:55:49.275050+0000","last_became_peered":"2024-04-01T01:55:49.275050+0000","last_unstale":"2024-04-01T02:12:38.733757+0000","last_undegraded":"2024-04-01T02:12:38.733757+0000","last_fullsized":"2024-04-01T02:12:38.733757+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":507,"log_dups_size":0,"ondisk_log_size":507,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:26:15.406856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1932316,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":383,"num_write_kb":9512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"23'404","reported_seq":428,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:09:28.169392+0000","last_change":"2024-04-01T01:55:48.223704+0000","last_active":"2024-04-01T02:09:28.169392+0000","last_peered":"2024-04-01T02:09:28.169392+0000","last_clean":"2024-04-01T02:09:28.169392+0000","last_became_active":"2024-04-01T01:55:48.223220+0000","last_became_peered":"2024-04-01T01:55:48.223220+0000","last_unstale":"2024-04-01T02:09:28.169392+0000","last_undegraded":"2024-04-01T02:09:28.169392+0000","last_fullsized":"2024-04-01T02:09:28.169392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:49:34.960786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":404,"num_write_kb":4216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"23'478","reported_seq":500,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.712722+0000","last_change":"2024-04-01T01:55:49.264857+0000","last_active":"2024-04-01T02:12:38.712722+0000","last_peered":"2024-04-01T02:12:38.712722+0000","last_clean":"2024-04-01T02:12:38.712722+0000","last_became_active":"2024-04-01T01:55:49.258478+0000","last_became_peered":"2024-04-01T01:55:49.258478+0000","last_unstale":"2024-04-01T02:12:38.712722+0000","last_undegraded":"2024-04-01T02:12:38.712722+0000","last_fullsized":"2024-04-01T02:12:38.712722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":478,"log_dups_size":0,"ondisk_log_size":478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:33:56.754206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2118876,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":354,"num_write_kb":10865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"23'1762","reported_seq":1786,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:10:48.103318+0000","last_change":"2024-04-01T01:55:48.218370+0000","last_active":"2024-04-01T02:10:48.103318+0000","last_peered":"2024-04-01T02:10:48.103318+0000","last_clean":"2024-04-01T02:10:48.103318+0000","last_became_active":"2024-04-01T01:55:48.217755+0000","last_became_peered":"2024-04-01T01:55:48.217755+0000","last_unstale":"2024-04-01T02:10:48.103318+0000","last_undegraded":"2024-04-01T02:10:48.103318+0000","last_fullsized":"2024-04-01T02:10:48.103318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":1762,"log_dups_size":0,"ondisk_log_size":1762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:09:28.276592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1758,"num_write_kb":13032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"23'607","reported_seq":631,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.722636+0000","last_change":"2024-04-01T01:55:49.243377+0000","last_active":"2024-04-01T02:12:38.722636+0000","last_peered":"2024-04-01T02:12:38.722636+0000","last_clean":"2024-04-01T02:12:38.722636+0000","last_became_active":"2024-04-01T01:55:49.242851+0000","last_became_peered":"2024-04-01T01:55:49.242851+0000","last_unstale":"2024-04-01T02:12:38.722636+0000","last_undegraded":"2024-04-01T02:12:38.722636+0000","last_fullsized":"2024-04-01T02:12:38.722636+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":607,"log_dups_size":0,"ondisk_log_size":607,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:48:38.596647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2501666,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":481,"num_write_kb":61542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"23'1142","reported_seq":1168,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:27.519474+0000","last_change":"2024-04-01T01:55:48.213862+0000","last_active":"2024-04-01T02:12:27.519474+0000","last_peered":"2024-04-01T02:12:27.519474+0000","last_clean":"2024-04-01T02:12:27.519474+0000","last_became_active":"2024-04-01T01:55:48.213122+0000","last_became_peered":"2024-04-01T01:55:48.213122+0000","last_unstale":"2024-04-01T02:12:27.519474+0000","last_undegraded":"2024-04-01T02:12:27.519474+0000","last_fullsized":"2024-04-01T02:12:27.519474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":1142,"log_dups_size":0,"ondisk_log_size":1142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:59:23.563864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1140,"num_write_kb":8675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"23'568","reported_seq":592,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.724948+0000","last_change":"2024-04-01T01:55:49.252273+0000","last_active":"2024-04-01T02:12:38.724948+0000","last_peered":"2024-04-01T02:12:38.724948+0000","last_clean":"2024-04-01T02:12:38.724948+0000","last_became_active":"2024-04-01T01:55:49.251963+0000","last_became_peered":"2024-04-01T01:55:49.251963+0000","last_unstale":"2024-04-01T02:12:38.724948+0000","last_undegraded":"2024-04-01T02:12:38.724948+0000","last_fullsized":"2024-04-01T02:12:38.724948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":568,"log_dups_size":0,"ondisk_log_size":568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:56:18.086766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1665465,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":447,"num_write_kb":10082,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"23'994","reported_seq":1020,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:11:32.607321+0000","last_change":"2024-04-01T01:55:48.225858+0000","last_active":"2024-04-01T02:11:32.607321+0000","last_peered":"2024-04-01T02:11:32.607321+0000","last_clean":"2024-04-01T02:11:32.607321+0000","last_became_active":"2024-04-01T01:55:48.224494+0000","last_became_peered":"2024-04-01T01:55:48.224494+0000","last_unstale":"2024-04-01T02:11:32.607321+0000","last_undegraded":"2024-04-01T02:11:32.607321+0000","last_fullsized":"2024-04-01T02:11:32.607321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":994,"log_dups_size":0,"ondisk_log_size":994,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:09:28.276592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389190,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":993,"num_write_kb":8588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":215832773,"num_objects":671,"num_object_clones":0,"num_object_copies":1342,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":671,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26120,"num_write_kb":1144114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":33914880,"data_stored":431659406,"data_compressed":20248526,"data_compressed_allocated":27738112,"data_compressed_original":427758424,"omap_allocated":0,"internal_metadata":0},"log_size":34657,"ondisk_log_size":34657,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":198565071,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":1759,"num_read_kb":2743,"num_write":29695,"num_write_kb":207906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":261308416,"data_stored":397130142,"data_compressed":36932112,"data_compressed_allocated":55713792,"data_compressed_original":191602688,"omap_allocated":0,"internal_metadata":0},"log_size":27939,"ondisk_log_size":27939,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66838,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509648,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":103636,"kb_used_data":23884,"kb_used_omap":1,"kb_used_meta":79742,"kb_avail":94268204,"statfs":{"total":96636764160,"available":96530640896,"internally_reserved":0,"allocated":24457216,"data_stored":69188313,"data_compressed":4487044,"data_compressed_allocated":6590464,"data_compressed_original":51672926,"omap_allocated":1590,"internal_metadata":81656266},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509649,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":119288,"kb_used_data":33968,"kb_used_omap":1,"kb_used_meta":85310,"kb_avail":94252552,"statfs":{"total":96636764160,"available":96514613248,"internally_reserved":0,"allocated":34783232,"data_stored":88936133,"data_compressed":7023647,"data_compressed_allocated":10317824,"data_compressed_original":64849434,"omap_allocated":1595,"internal_metadata":87357893},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509647,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":184280,"kb_used_data":62864,"kb_used_omap":1,"kb_used_meta":121406,"kb_avail":94187560,"statfs":{"total":96636764160,"available":96448061440,"internally_reserved":0,"allocated":64372736,"data_stored":164997377,"data_compressed":11682465,"data_compressed_allocated":17096704,"data_compressed_original":118219990,"omap_allocated":1592,"internal_metadata":124320200},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509648,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":93932,"kb_used_data":26660,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94277908,"statfs":{"total":96636764160,"available":96540577792,"internally_reserved":0,"allocated":27299840,"data_stored":94836675,"data_compressed":5914255,"data_compressed_allocated":8593408,"data_compressed_original":76574396,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509648,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":96400,"kb_used_data":29128,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94275440,"statfs":{"total":96636764160,"available":96538050560,"internally_reserved":0,"allocated":29827072,"data_stored":88082926,"data_compressed":5618475,"data_compressed_allocated":8155136,"data_compressed_original":66844186,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509647,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":161932,"kb_used_data":50244,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":94209908,"statfs":{"total":96636764160,"available":96470945792,"internally_reserved":0,"allocated":51449856,"data_stored":133539293,"data_compressed":9646909,"data_compressed_allocated":14168064,"data_compressed_original":96757598,"omap_allocated":1595,"internal_metadata":114358725},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542351,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":95764,"kb_used_data":24332,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94276076,"statfs":{"total":96636764160,"available":96538701824,"internally_reserved":0,"allocated":24915968,"data_stored":74736278,"data_compressed":5225453,"data_compressed_allocated":7524352,"data_compressed_original":57747294,"omap_allocated":1594,"internal_metadata":73136582},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575056,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":138384,"kb_used_data":39176,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":94233456,"statfs":{"total":96636764160,"available":96495058944,"internally_reserved":0,"allocated":40116224,"data_stored":116325977,"data_compressed":7649228,"data_compressed_allocated":11096064,"data_compressed_original":87842168,"omap_allocated":1595,"internal_metadata":101579205},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33419,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33419,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":46268416,"data_stored":71213780,"data_compressed":6727789,"data_compressed_allocated":10149888,"data_compressed_original":35106816,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":25587712,"data_stored":37748806,"data_compressed":3257537,"data_compressed_allocated":4939776,"data_compressed_original":17104896,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":22360064,"data_stored":33555104,"data_compressed":3040138,"data_compressed_allocated":4640768,"data_compressed_original":15843328,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":58277888,"data_stored":87991522,"data_compressed":8070060,"data_compressed_allocated":12161024,"data_compressed_original":41881600,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":31485952,"data_stored":50332992,"data_compressed":5217803,"data_compressed_allocated":7843840,"data_compressed_original":26705920,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":34701312,"data_stored":51852497,"data_compressed":4625369,"data_compressed_allocated":6967296,"data_compressed_original":24129536,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":21364736,"data_stored":33554432,"data_compressed":3299283,"data_compressed_allocated":4878336,"data_compressed_original":17068032,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":21262336,"data_stored":30881009,"data_compressed":2694133,"data_compressed_allocated":4132864,"data_compressed_original":13762560,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4947968,"data_stored":62241427,"data_compressed":2919120,"data_compressed_allocated":4018176,"data_compressed_original":61650782,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3940352,"data_stored":49659666,"data_compressed":2327519,"data_compressed_allocated":3170304,"data_compressed_original":49165850,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4706304,"data_stored":61197485,"data_compressed":2874117,"data_compressed_allocated":3952640,"data_compressed_original":60731068,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":5861376,"data_stored":76921769,"data_compressed":3612405,"data_compressed_allocated":4935680,"data_compressed_original":76338390,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":3063808,"data_stored":38519055,"data_compressed":1805844,"data_compressed_allocated":2473984,"data_compressed_original":38143514,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":5115904,"data_stored":63799026,"data_compressed":2990440,"data_compressed_allocated":4083712,"data_compressed_original":63139192,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":3317760,"data_stored":41097760,"data_compressed":1926170,"data_compressed_allocated":2646016,"data_compressed_original":40679262,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":2961408,"data_stored":38223218,"data_compressed":1792911,"data_compressed_allocated":2457600,"data_compressed_original":37910366,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-01T02:12:45.217 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-01T02:12:45.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.377+0000 7f0f82f65640 1 Processor -- start 2024-04-01T02:12:45.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.377+0000 7f0f82f65640 1 -- start start 2024-04-01T02:12:45.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.377+0000 7f0f82f65640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0f7c1502a0 0x7f0f7c0c3e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:45.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.377+0000 7f0f82f65640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0f7c0c6c60 0x7f0f7c0c7850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:45.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.377+0000 7f0f82f65640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f0f7c071250 0x7f0f7c06ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:45.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.377+0000 7f0f82f65640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f0f7c0716a0 con 0x7f0f7c0c6c60 2024-04-01T02:12:45.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.377+0000 7f0f82f65640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f0f7c156cc0 con 0x7f0f7c071250 2024-04-01T02:12:45.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.377+0000 7f0f82f65640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f0f7c0c5ea0 con 0x7f0f7c1502a0 2024-04-01T02:12:45.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.377+0000 7f0f7bfff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0f7c0c6c60 0x7f0f7c0c7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:45.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.377+0000 7f0f7bfff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0f7c0c6c60 0x7f0f7c0c7850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50806/0 (socket says 172.21.15.50:50806) 2024-04-01T02:12:45.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.377+0000 7f0f7bfff640 1 -- 172.21.15.50:0/2676015842 learned_addr learned my addr 172.21.15.50:0/2676015842 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T02:12:45.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.377+0000 7f0f81502640 1 --2- 172.21.15.50:0/2676015842 >> v2:172.21.15.97:3300/0 conn(0x7f0f7c071250 0x7f0f7c06ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:45.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.377+0000 7f0f80d01640 1 --2- 172.21.15.50:0/2676015842 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0f7c1502a0 0x7f0f7c0c3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:45.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.377+0000 7f0f7bfff640 1 -- 172.21.15.50:0/2676015842 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0f7c1502a0 msgr2=0x7f0f7c0c3e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T02:12:45.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.377+0000 7f0f7bfff640 1 --2- 172.21.15.50:0/2676015842 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0f7c1502a0 0x7f0f7c0c3e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:45.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.377+0000 7f0f7bfff640 1 -- 172.21.15.50:0/2676015842 >> v2:172.21.15.97:3300/0 conn(0x7f0f7c071250 msgr2=0x7f0f7c06ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T02:12:45.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.377+0000 7f0f7bfff640 1 --2- 172.21.15.50:0/2676015842 >> v2:172.21.15.97:3300/0 conn(0x7f0f7c071250 0x7f0f7c06ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:45.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.377+0000 7f0f7bfff640 1 -- 172.21.15.50:0/2676015842 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f7c0c6180 con 0x7f0f7c0c6c60 2024-04-01T02:12:45.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.377+0000 7f0f81502640 1 --2- 172.21.15.50:0/2676015842 >> v2:172.21.15.97:3300/0 conn(0x7f0f7c071250 0x7f0f7c06ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T02:12:45.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.381+0000 7f0f7bfff640 1 --2- 172.21.15.50:0/2676015842 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f7c0c6c60 0x7f0f7c0c7850 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f0f7c06c2e0 tx=0x7f0f7001ff40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9c5946b6e134908 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:12:45.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.381+0000 7f0f7b7fe640 1 -- 172.21.15.50:0/2676015842 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f700b6070 con 0x7f0f7c0c6c60 2024-04-01T02:12:45.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.381+0000 7f0f7b7fe640 1 -- 172.21.15.50:0/2676015842 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f700a9d10 con 0x7f0f7c0c6c60 2024-04-01T02:12:45.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.381+0000 7f0f7b7fe640 1 -- 172.21.15.50:0/2676015842 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f700b1660 con 0x7f0f7c0c6c60 2024-04-01T02:12:45.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.381+0000 7f0f82f65640 1 -- 172.21.15.50:0/2676015842 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f7c0c6c60 msgr2=0x7f0f7c0c7850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:45.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.381+0000 7f0f82f65640 1 --2- 172.21.15.50:0/2676015842 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f7c0c6c60 0x7f0f7c0c7850 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f0f7c06c2e0 tx=0x7f0f7001ff40 comp rx=0 tx=0).stop 2024-04-01T02:12:45.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.381+0000 7f0f82f65640 1 -- 172.21.15.50:0/2676015842 shutdown_connections 2024-04-01T02:12:45.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.381+0000 7f0f82f65640 1 --2- 172.21.15.50:0/2676015842 >> v2:172.21.15.97:3300/0 conn(0x7f0f7c071250 0x7f0f7c06ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:45.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.381+0000 7f0f82f65640 1 --2- 172.21.15.50:0/2676015842 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f7c0c6c60 0x7f0f7c0c7850 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:45.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.381+0000 7f0f82f65640 1 --2- 172.21.15.50:0/2676015842 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0f7c1502a0 0x7f0f7c0c3e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:45.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.381+0000 7f0f82f65640 1 -- 172.21.15.50:0/2676015842 >> 172.21.15.50:0/2676015842 conn(0x7f0f7c067560 msgr2=0x7f0f7c06b220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T02:12:45.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.381+0000 7f0f82f65640 1 -- 172.21.15.50:0/2676015842 shutdown_connections 2024-04-01T02:12:45.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.381+0000 7f0f82f65640 1 -- 172.21.15.50:0/2676015842 wait complete. 2024-04-01T02:12:45.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.381+0000 7f0f82f65640 1 Processor -- start 2024-04-01T02:12:45.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.381+0000 7f0f82f65640 1 -- start start 2024-04-01T02:12:45.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.381+0000 7f0f82f65640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0f7c071250 0x7f0f7c1ddde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:45.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.381+0000 7f0f82f65640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f7c0c6c60 0x7f0f7c1f10e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:45.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.381+0000 7f0f82f65640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0f7c1502a0 0x7f0f7c155540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:45.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.381+0000 7f0f82f65640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f0f7c156fa0 con 0x7f0f7c0c6c60 2024-04-01T02:12:45.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.381+0000 7f0f82f65640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f0f7c0c6740 con 0x7f0f7c1502a0 2024-04-01T02:12:45.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.381+0000 7f0f82f65640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f0f7c0c8c70 con 0x7f0f7c071250 2024-04-01T02:12:45.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.381+0000 7f0f7bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f7c0c6c60 0x7f0f7c1f10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:45.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.381+0000 7f0f7bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f7c0c6c60 0x7f0f7c1f10e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50816/0 (socket says 172.21.15.50:50816) 2024-04-01T02:12:45.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.381+0000 7f0f7bfff640 1 -- 172.21.15.50:0/2537820137 learned_addr learned my addr 172.21.15.50:0/2537820137 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T02:12:45.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.381+0000 7f0f80d01640 1 --2- 172.21.15.50:0/2537820137 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0f7c071250 0x7f0f7c1ddde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:45.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.381+0000 7f0f81502640 1 --2- 172.21.15.50:0/2537820137 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0f7c1502a0 0x7f0f7c155540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:45.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.381+0000 7f0f7bfff640 1 -- 172.21.15.50:0/2537820137 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0f7c071250 msgr2=0x7f0f7c1ddde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:45.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.381+0000 7f0f7bfff640 1 --2- 172.21.15.50:0/2537820137 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0f7c071250 0x7f0f7c1ddde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:45.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.381+0000 7f0f7bfff640 1 -- 172.21.15.50:0/2537820137 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0f7c1502a0 msgr2=0x7f0f7c155540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:45.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.381+0000 7f0f7bfff640 1 --2- 172.21.15.50:0/2537820137 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0f7c1502a0 0x7f0f7c155540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:45.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.381+0000 7f0f7bfff640 1 -- 172.21.15.50:0/2537820137 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f7c1f3380 con 0x7f0f7c0c6c60 2024-04-01T02:12:45.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.385+0000 7f0f7bfff640 1 --2- 172.21.15.50:0/2537820137 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f7c0c6c60 0x7f0f7c1f10e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f0f700207e0 tx=0x7f0f7001cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:12:45.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.385+0000 7f0f797fa640 1 -- 172.21.15.50:0/2537820137 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f700c1070 con 0x7f0f7c0c6c60 2024-04-01T02:12:45.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.385+0000 7f0f797fa640 1 -- 172.21.15.50:0/2537820137 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f700bc460 con 0x7f0f7c0c6c60 2024-04-01T02:12:45.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.385+0000 7f0f797fa640 1 -- 172.21.15.50:0/2537820137 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f700b6070 con 0x7f0f7c0c6c60 2024-04-01T02:12:45.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.385+0000 7f0f82f65640 1 -- 172.21.15.50:0/2537820137 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f7c1de490 con 0x7f0f7c0c6c60 2024-04-01T02:12:45.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.385+0000 7f0f82f65640 1 -- 172.21.15.50:0/2537820137 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f7c1f3620 con 0x7f0f7c0c6c60 2024-04-01T02:12:45.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.385+0000 7f0f82f65640 1 -- 172.21.15.50:0/2537820137 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f7c0c7a50 con 0x7f0f7c0c6c60 2024-04-01T02:12:45.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.385+0000 7f0f797fa640 1 -- 172.21.15.50:0/2537820137 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 87103+0+0 (secure 0 0 0) 0x7f0f700ba070 con 0x7f0f7c0c6c60 2024-04-01T02:12:45.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.385+0000 7f0f797fa640 1 --2- 172.21.15.50:0/2537820137 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f0f68067420 0x7f0f680698e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:45.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.385+0000 7f0f797fa640 1 -- 172.21.15.50:0/2537820137 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5738+0+0 (secure 0 0 0) 0x7f0f70122e20 con 0x7f0f7c0c6c60 2024-04-01T02:12:45.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.385+0000 7f0f80d01640 1 --2- 172.21.15.50:0/2537820137 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f0f68067420 0x7f0f680698e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:45.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.385+0000 7f0f80d01640 1 --2- 172.21.15.50:0/2537820137 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f0f68067420 0x7f0f680698e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c00b9d0 tx=0x7f0f6c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:12:45.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.389+0000 7f0f797fa640 1 -- 172.21.15.50:0/2537820137 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+176632 (secure 0 0 0) 0x7f0f700ca020 con 0x7f0f7c0c6c60 2024-04-01T02:12:45.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.545+0000 7f0f82f65640 1 -- 172.21.15.50:0/2537820137 --> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0f7c068230 con 0x7f0f68067420 2024-04-01T02:12:45.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.561+0000 7f0f797fa640 1 -- 172.21.15.50:0/2537820137 <== mgr.4103 v2:172.21.15.97:6832/1677467570 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+254883 (secure 0 0 0) 0x7f0f7c068230 con 0x7f0f68067420 2024-04-01T02:12:45.564 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-01T02:12:45.565 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-04-01T02:12:45.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.569+0000 7f0f82f65640 1 -- 172.21.15.50:0/2537820137 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f0f68067420 msgr2=0x7f0f680698e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:45.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.569+0000 7f0f82f65640 1 --2- 172.21.15.50:0/2537820137 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f0f68067420 0x7f0f680698e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c00b9d0 tx=0x7f0f6c008040 comp rx=0 tx=0).stop 2024-04-01T02:12:45.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.569+0000 7f0f82f65640 1 -- 172.21.15.50:0/2537820137 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f7c0c6c60 msgr2=0x7f0f7c1f10e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:45.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.569+0000 7f0f82f65640 1 --2- 172.21.15.50:0/2537820137 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f7c0c6c60 0x7f0f7c1f10e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f0f700207e0 tx=0x7f0f7001cce0 comp rx=0 tx=0).stop 2024-04-01T02:12:45.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.569+0000 7f0f82f65640 1 -- 172.21.15.50:0/2537820137 shutdown_connections 2024-04-01T02:12:45.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.569+0000 7f0f82f65640 1 --2- 172.21.15.50:0/2537820137 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f0f68067420 0x7f0f680698e0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:45.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.569+0000 7f0f82f65640 1 --2- 172.21.15.50:0/2537820137 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0f7c1502a0 0x7f0f7c155540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:45.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.569+0000 7f0f82f65640 1 --2- 172.21.15.50:0/2537820137 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f7c0c6c60 0x7f0f7c1f10e0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:45.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.569+0000 7f0f82f65640 1 --2- 172.21.15.50:0/2537820137 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0f7c071250 0x7f0f7c1ddde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:45.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.569+0000 7f0f82f65640 1 -- 172.21.15.50:0/2537820137 >> 172.21.15.50:0/2537820137 conn(0x7f0f7c067560 msgr2=0x7f0f7c06b220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T02:12:45.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.569+0000 7f0f82f65640 1 -- 172.21.15.50:0/2537820137 shutdown_connections 2024-04-01T02:12:45.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.569+0000 7f0f82f65640 1 -- 172.21.15.50:0/2537820137 wait complete. 2024-04-01T02:12:45.584 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":528,"stamp":"2024-04-01T02:12:44.389554+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":414988212,"num_objects":742,"num_object_clones":0,"num_object_copies":1484,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":742,"num_whiteouts":0,"num_read":1875,"num_read_kb":2843,"num_write":55974,"num_write_kb":1354436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":62713,"ondisk_log_size":62713,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":993616,"kb_used_data":290256,"kb_used_omap":12,"kb_used_meta":703283,"kb_avail":753981104,"statfs":{"total":773094113280,"available":772076650496,"internally_reserved":0,"allocated":297222144,"data_stored":830642972,"data_compressed":57247476,"data_compressed_allocated":83542016,"data_compressed_original":620507992,"omap_allocated":12751,"internal_metadata":720162353},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":54,"apply_latency_ms":54,"commit_latency_ns":54000000,"apply_latency_ns":54000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":7294455,"num_objects":-15,"num_object_clones":0,"num_object_copies":-30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-15,"num_whiteouts":0,"num_read":17,"num_read_kb":36,"num_write":1013,"num_write_kb":19068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002985"},"pg_stats":[{"pgid":"3.3f","version":"23'487","reported_seq":511,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.726522+0000","last_change":"2024-04-01T01:55:49.279342+0000","last_active":"2024-04-01T02:12:38.726522+0000","last_peered":"2024-04-01T02:12:38.726522+0000","last_clean":"2024-04-01T02:12:38.726522+0000","last_became_active":"2024-04-01T01:55:49.279011+0000","last_became_peered":"2024-04-01T01:55:49.279011+0000","last_unstale":"2024-04-01T02:12:38.726522+0000","last_undegraded":"2024-04-01T02:12:38.726522+0000","last_fullsized":"2024-04-01T02:12:38.726522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:56:11.350186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4211749,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":345,"num_write_kb":18423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"23'557","reported_seq":581,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.676141+0000","last_change":"2024-04-01T01:55:49.247181+0000","last_active":"2024-04-01T02:12:38.676141+0000","last_peered":"2024-04-01T02:12:38.676141+0000","last_clean":"2024-04-01T02:12:38.676141+0000","last_became_active":"2024-04-01T01:55:49.246660+0000","last_became_peered":"2024-04-01T01:55:49.246660+0000","last_unstale":"2024-04-01T02:12:38.676141+0000","last_undegraded":"2024-04-01T02:12:38.676141+0000","last_fullsized":"2024-04-01T02:12:38.676141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":557,"log_dups_size":0,"ondisk_log_size":557,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:27:12.089520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3694421,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":432,"num_write_kb":10812,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"23'528","reported_seq":552,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.682048+0000","last_change":"2024-04-01T01:55:49.240347+0000","last_active":"2024-04-01T02:12:38.682048+0000","last_peered":"2024-04-01T02:12:38.682048+0000","last_clean":"2024-04-01T02:12:38.682048+0000","last_became_active":"2024-04-01T01:55:49.239904+0000","last_became_peered":"2024-04-01T01:55:49.239904+0000","last_unstale":"2024-04-01T02:12:38.682048+0000","last_undegraded":"2024-04-01T02:12:38.682048+0000","last_fullsized":"2024-04-01T02:12:38.682048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:37:43.280869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5131013,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":399,"num_write_kb":17827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"23'481","reported_seq":505,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.720237+0000","last_change":"2024-04-01T01:55:49.279352+0000","last_active":"2024-04-01T02:12:38.720237+0000","last_peered":"2024-04-01T02:12:38.720237+0000","last_clean":"2024-04-01T02:12:38.720237+0000","last_became_active":"2024-04-01T01:55:49.279041+0000","last_became_peered":"2024-04-01T01:55:49.279041+0000","last_unstale":"2024-04-01T02:12:38.720237+0000","last_undegraded":"2024-04-01T02:12:38.720237+0000","last_fullsized":"2024-04-01T02:12:38.720237+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":481,"log_dups_size":0,"ondisk_log_size":481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:13:13.114168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":658438,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":353,"num_write_kb":8202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"23'578","reported_seq":600,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.731752+0000","last_change":"2024-04-01T01:55:49.246874+0000","last_active":"2024-04-01T02:12:38.731752+0000","last_peered":"2024-04-01T02:12:38.731752+0000","last_clean":"2024-04-01T02:12:38.731752+0000","last_became_active":"2024-04-01T01:55:49.246152+0000","last_became_peered":"2024-04-01T01:55:49.246152+0000","last_unstale":"2024-04-01T02:12:38.731752+0000","last_undegraded":"2024-04-01T02:12:38.731752+0000","last_fullsized":"2024-04-01T02:12:38.731752+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":578,"log_dups_size":0,"ondisk_log_size":578,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:49:04.049108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3987251,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":442,"num_write_kb":11887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"23'477","reported_seq":499,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.714821+0000","last_change":"2024-04-01T01:55:49.254029+0000","last_active":"2024-04-01T02:12:38.714821+0000","last_peered":"2024-04-01T02:12:38.714821+0000","last_clean":"2024-04-01T02:12:38.714821+0000","last_became_active":"2024-04-01T01:55:49.253348+0000","last_became_peered":"2024-04-01T01:55:49.253348+0000","last_unstale":"2024-04-01T02:12:38.714821+0000","last_undegraded":"2024-04-01T02:12:38.714821+0000","last_fullsized":"2024-04-01T02:12:38.714821+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":477,"log_dups_size":0,"ondisk_log_size":477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:33:56.754206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3474466,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":343,"num_write_kb":9649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"23'559","reported_seq":581,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.702161+0000","last_change":"2024-04-01T01:55:49.247604+0000","last_active":"2024-04-01T02:12:38.702161+0000","last_peered":"2024-04-01T02:12:38.702161+0000","last_clean":"2024-04-01T02:12:38.702161+0000","last_became_active":"2024-04-01T01:55:49.247373+0000","last_became_peered":"2024-04-01T01:55:49.247373+0000","last_unstale":"2024-04-01T02:12:38.702161+0000","last_undegraded":"2024-04-01T02:12:38.702161+0000","last_fullsized":"2024-04-01T02:12:38.702161+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":559,"log_dups_size":0,"ondisk_log_size":559,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:13:16.513095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2878976,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":421,"num_write_kb":10504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"23'479","reported_seq":501,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.702730+0000","last_change":"2024-04-01T01:55:49.262994+0000","last_active":"2024-04-01T02:12:38.702730+0000","last_peered":"2024-04-01T02:12:38.702730+0000","last_clean":"2024-04-01T02:12:38.702730+0000","last_became_active":"2024-04-01T01:55:49.262736+0000","last_became_peered":"2024-04-01T01:55:49.262736+0000","last_unstale":"2024-04-01T02:12:38.702730+0000","last_undegraded":"2024-04-01T02:12:38.702730+0000","last_fullsized":"2024-04-01T02:12:38.702730+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":479,"log_dups_size":0,"ondisk_log_size":479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:35:14.625545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3489692,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":346,"num_write_kb":10932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"23'511","reported_seq":533,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.727389+0000","last_change":"2024-04-01T01:55:49.260244+0000","last_active":"2024-04-01T02:12:38.727389+0000","last_peered":"2024-04-01T02:12:38.727389+0000","last_clean":"2024-04-01T02:12:38.727389+0000","last_became_active":"2024-04-01T01:55:49.259745+0000","last_became_peered":"2024-04-01T01:55:49.259745+0000","last_unstale":"2024-04-01T02:12:38.727389+0000","last_undegraded":"2024-04-01T02:12:38.727389+0000","last_fullsized":"2024-04-01T02:12:38.727389+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":511,"log_dups_size":0,"ondisk_log_size":511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:00:34.607980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3721216,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":377,"num_write_kb":13356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"23'490","reported_seq":506,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.726657+0000","last_change":"2024-04-01T01:56:38.229250+0000","last_active":"2024-04-01T02:12:38.726657+0000","last_peered":"2024-04-01T02:12:38.726657+0000","last_clean":"2024-04-01T02:12:38.726657+0000","last_became_active":"2024-04-01T01:56:38.228548+0000","last_became_peered":"2024-04-01T01:56:38.228548+0000","last_unstale":"2024-04-01T02:12:38.726657+0000","last_undegraded":"2024-04-01T02:12:38.726657+0000","last_fullsized":"2024-04-01T02:12:38.726657+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":490,"log_dups_size":0,"ondisk_log_size":490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:15:01.912111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2985236,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":363,"num_write_kb":27800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.35","version":"23'471","reported_seq":493,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.732628+0000","last_change":"2024-04-01T01:55:49.271392+0000","last_active":"2024-04-01T02:12:38.732628+0000","last_peered":"2024-04-01T02:12:38.732628+0000","last_clean":"2024-04-01T02:12:38.732628+0000","last_became_active":"2024-04-01T01:55:49.270877+0000","last_became_peered":"2024-04-01T01:55:49.270877+0000","last_unstale":"2024-04-01T02:12:38.732628+0000","last_undegraded":"2024-04-01T02:12:38.732628+0000","last_fullsized":"2024-04-01T02:12:38.732628+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:44:29.950624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3409567,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":12314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"23'413","reported_seq":435,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.723596+0000","last_change":"2024-04-01T01:55:49.259816+0000","last_active":"2024-04-01T02:12:38.723596+0000","last_peered":"2024-04-01T02:12:38.723596+0000","last_clean":"2024-04-01T02:12:38.723596+0000","last_became_active":"2024-04-01T01:55:49.259193+0000","last_became_peered":"2024-04-01T01:55:49.259193+0000","last_unstale":"2024-04-01T02:12:38.723596+0000","last_undegraded":"2024-04-01T02:12:38.723596+0000","last_fullsized":"2024-04-01T02:12:38.723596+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:48:10.828398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2357039,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":282,"num_write_kb":7635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"23'431","reported_seq":453,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.701034+0000","last_change":"2024-04-01T01:55:49.247878+0000","last_active":"2024-04-01T02:12:38.701034+0000","last_peered":"2024-04-01T02:12:38.701034+0000","last_clean":"2024-04-01T02:12:38.701034+0000","last_became_active":"2024-04-01T01:55:49.247436+0000","last_became_peered":"2024-04-01T01:55:49.247436+0000","last_unstale":"2024-04-01T02:12:38.701034+0000","last_undegraded":"2024-04-01T02:12:38.701034+0000","last_fullsized":"2024-04-01T02:12:38.701034+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:26:09.632757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":608576,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":293,"num_write_kb":6624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"23'521","reported_seq":544,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.672100+0000","last_change":"2024-04-01T01:55:49.246266+0000","last_active":"2024-04-01T02:12:38.672100+0000","last_peered":"2024-04-01T02:12:38.672100+0000","last_clean":"2024-04-01T02:12:38.672100+0000","last_became_active":"2024-04-01T01:55:49.245650+0000","last_became_peered":"2024-04-01T01:55:49.245650+0000","last_unstale":"2024-04-01T02:12:38.672100+0000","last_undegraded":"2024-04-01T02:12:38.672100+0000","last_fullsized":"2024-04-01T02:12:38.672100+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":521,"log_dups_size":0,"ondisk_log_size":521,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:14:32.577522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3014274,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":389,"num_write_kb":12247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"23'508","reported_seq":531,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.702841+0000","last_change":"2024-04-01T01:55:49.248046+0000","last_active":"2024-04-01T02:12:38.702841+0000","last_peered":"2024-04-01T02:12:38.702841+0000","last_clean":"2024-04-01T02:12:38.702841+0000","last_became_active":"2024-04-01T01:55:49.247662+0000","last_became_peered":"2024-04-01T01:55:49.247662+0000","last_unstale":"2024-04-01T02:12:38.702841+0000","last_undegraded":"2024-04-01T02:12:38.702841+0000","last_fullsized":"2024-04-01T02:12:38.702841+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":508,"log_dups_size":0,"ondisk_log_size":508,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:59:26.879090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3985408,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":369,"num_write_kb":15794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"23'682","reported_seq":705,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.721747+0000","last_change":"2024-04-01T01:55:49.269484+0000","last_active":"2024-04-01T02:12:38.721747+0000","last_peered":"2024-04-01T02:12:38.721747+0000","last_clean":"2024-04-01T02:12:38.721747+0000","last_became_active":"2024-04-01T01:55:49.261839+0000","last_became_peered":"2024-04-01T01:55:49.261839+0000","last_unstale":"2024-04-01T02:12:38.721747+0000","last_undegraded":"2024-04-01T02:12:38.721747+0000","last_fullsized":"2024-04-01T02:12:38.721747+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":682,"log_dups_size":0,"ondisk_log_size":682,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:44:29.950624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6390669,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":553,"num_write_kb":46118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"23'595","reported_seq":618,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.734605+0000","last_change":"2024-04-01T01:55:49.276113+0000","last_active":"2024-04-01T02:12:38.734605+0000","last_peered":"2024-04-01T02:12:38.734605+0000","last_clean":"2024-04-01T02:12:38.734605+0000","last_became_active":"2024-04-01T01:55:49.275727+0000","last_became_peered":"2024-04-01T01:55:49.275727+0000","last_unstale":"2024-04-01T02:12:38.734605+0000","last_undegraded":"2024-04-01T02:12:38.734605+0000","last_fullsized":"2024-04-01T02:12:38.734605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":595,"log_dups_size":0,"ondisk_log_size":595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:50:59.209071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1955840,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":457,"num_write_kb":17131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"23'506","reported_seq":529,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.726548+0000","last_change":"2024-04-01T01:55:49.252859+0000","last_active":"2024-04-01T02:12:38.726548+0000","last_peered":"2024-04-01T02:12:38.726548+0000","last_clean":"2024-04-01T02:12:38.726548+0000","last_became_active":"2024-04-01T01:55:49.252553+0000","last_became_peered":"2024-04-01T01:55:49.252553+0000","last_unstale":"2024-04-01T02:12:38.726548+0000","last_undegraded":"2024-04-01T02:12:38.726548+0000","last_fullsized":"2024-04-01T02:12:38.726548+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":506,"log_dups_size":0,"ondisk_log_size":506,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:13:13.114168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5136348,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":357,"num_write_kb":34023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"23'525","reported_seq":548,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.713522+0000","last_change":"2024-04-01T01:55:49.260274+0000","last_active":"2024-04-01T02:12:38.713522+0000","last_peered":"2024-04-01T02:12:38.713522+0000","last_clean":"2024-04-01T02:12:38.713522+0000","last_became_active":"2024-04-01T01:55:49.259935+0000","last_became_peered":"2024-04-01T01:55:49.259935+0000","last_unstale":"2024-04-01T02:12:38.713522+0000","last_undegraded":"2024-04-01T02:12:38.713522+0000","last_fullsized":"2024-04-01T02:12:38.713522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":525,"log_dups_size":0,"ondisk_log_size":525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:24:55.348340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6314527,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":390,"num_write_kb":35275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"23'655","reported_seq":678,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.720819+0000","last_change":"2024-04-01T01:55:49.259523+0000","last_active":"2024-04-01T02:12:38.720819+0000","last_peered":"2024-04-01T02:12:38.720819+0000","last_clean":"2024-04-01T02:12:38.720819+0000","last_became_active":"2024-04-01T01:55:49.258670+0000","last_became_peered":"2024-04-01T01:55:49.258670+0000","last_unstale":"2024-04-01T02:12:38.720819+0000","last_undegraded":"2024-04-01T02:12:38.720819+0000","last_fullsized":"2024-04-01T02:12:38.720819+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":655,"log_dups_size":0,"ondisk_log_size":655,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:08:54.832554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3478562,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":525,"num_write_kb":13686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"23'528","reported_seq":551,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.713062+0000","last_change":"2024-04-01T01:55:49.243824+0000","last_active":"2024-04-01T02:12:38.713062+0000","last_peered":"2024-04-01T02:12:38.713062+0000","last_clean":"2024-04-01T02:12:38.713062+0000","last_became_active":"2024-04-01T01:55:49.243518+0000","last_became_peered":"2024-04-01T01:55:49.243518+0000","last_unstale":"2024-04-01T02:12:38.713062+0000","last_undegraded":"2024-04-01T02:12:38.713062+0000","last_fullsized":"2024-04-01T02:12:38.713062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:24:42.777720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1873749,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":387,"num_write_kb":9989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"23'557","reported_seq":580,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.697153+0000","last_change":"2024-04-01T01:55:49.258207+0000","last_active":"2024-04-01T02:12:38.697153+0000","last_peered":"2024-04-01T02:12:38.697153+0000","last_clean":"2024-04-01T02:12:38.697153+0000","last_became_active":"2024-04-01T01:55:49.257576+0000","last_became_peered":"2024-04-01T01:55:49.257576+0000","last_unstale":"2024-04-01T02:12:38.697153+0000","last_undegraded":"2024-04-01T02:12:38.697153+0000","last_fullsized":"2024-04-01T02:12:38.697153+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":557,"log_dups_size":0,"ondisk_log_size":557,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:13:13.114168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3745621,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":429,"num_write_kb":26683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"23'495","reported_seq":518,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.697781+0000","last_change":"2024-04-01T01:55:49.250832+0000","last_active":"2024-04-01T02:12:38.697781+0000","last_peered":"2024-04-01T02:12:38.697781+0000","last_clean":"2024-04-01T02:12:38.697781+0000","last_became_active":"2024-04-01T01:55:49.250522+0000","last_became_peered":"2024-04-01T01:55:49.250522+0000","last_unstale":"2024-04-01T02:12:38.697781+0000","last_undegraded":"2024-04-01T02:12:38.697781+0000","last_fullsized":"2024-04-01T02:12:38.697781+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:47:04.592262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1694624,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":361,"num_write_kb":9747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"23'519","reported_seq":542,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.712726+0000","last_change":"2024-04-01T01:55:49.270067+0000","last_active":"2024-04-01T02:12:38.712726+0000","last_peered":"2024-04-01T02:12:38.712726+0000","last_clean":"2024-04-01T02:12:38.712726+0000","last_became_active":"2024-04-01T01:55:49.269694+0000","last_became_peered":"2024-04-01T01:55:49.269694+0000","last_unstale":"2024-04-01T02:12:38.712726+0000","last_undegraded":"2024-04-01T02:12:38.712726+0000","last_fullsized":"2024-04-01T02:12:38.712726+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":519,"log_dups_size":0,"ondisk_log_size":519,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:21:46.367144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4783138,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384,"num_write_kb":12273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"23'556","reported_seq":579,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.722272+0000","last_change":"2024-04-01T01:55:49.243460+0000","last_active":"2024-04-01T02:12:38.722272+0000","last_peered":"2024-04-01T02:12:38.722272+0000","last_clean":"2024-04-01T02:12:38.722272+0000","last_became_active":"2024-04-01T01:55:49.243017+0000","last_became_peered":"2024-04-01T01:55:49.243017+0000","last_unstale":"2024-04-01T02:12:38.722272+0000","last_undegraded":"2024-04-01T02:12:38.722272+0000","last_fullsized":"2024-04-01T02:12:38.722272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":556,"log_dups_size":0,"ondisk_log_size":556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:20:18.156798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3977024,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":423,"num_write_kb":11436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"23'580","reported_seq":603,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.740597+0000","last_change":"2024-04-01T01:55:49.280226+0000","last_active":"2024-04-01T02:12:38.740597+0000","last_peered":"2024-04-01T02:12:38.740597+0000","last_clean":"2024-04-01T02:12:38.740597+0000","last_became_active":"2024-04-01T01:55:49.279882+0000","last_became_peered":"2024-04-01T01:55:49.279882+0000","last_unstale":"2024-04-01T02:12:38.740597+0000","last_undegraded":"2024-04-01T02:12:38.740597+0000","last_fullsized":"2024-04-01T02:12:38.740597+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":580,"log_dups_size":0,"ondisk_log_size":580,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:06:48.999905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8142848,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":413,"num_write_kb":37888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"23'766","reported_seq":789,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.659698+0000","last_change":"2024-04-01T01:55:49.249890+0000","last_active":"2024-04-01T02:12:38.659698+0000","last_peered":"2024-04-01T02:12:38.659698+0000","last_clean":"2024-04-01T02:12:38.659698+0000","last_became_active":"2024-04-01T01:55:49.249588+0000","last_became_peered":"2024-04-01T01:55:49.249588+0000","last_unstale":"2024-04-01T02:12:38.659698+0000","last_undegraded":"2024-04-01T02:12:38.659698+0000","last_fullsized":"2024-04-01T02:12:38.659698+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":766,"log_dups_size":0,"ondisk_log_size":766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:02:25.180455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4497408,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":644,"num_write_kb":39031,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"23'440","reported_seq":463,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.674903+0000","last_change":"2024-04-01T01:55:49.254529+0000","last_active":"2024-04-01T02:12:38.674903+0000","last_peered":"2024-04-01T02:12:38.674903+0000","last_clean":"2024-04-01T02:12:38.674903+0000","last_became_active":"2024-04-01T01:55:49.253726+0000","last_became_peered":"2024-04-01T01:55:49.253726+0000","last_unstale":"2024-04-01T02:12:38.674903+0000","last_undegraded":"2024-04-01T02:12:38.674903+0000","last_fullsized":"2024-04-01T02:12:38.674903+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:55:44.175129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2117070,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":308,"num_write_kb":8584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"23'485","reported_seq":509,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.676378+0000","last_change":"2024-04-01T01:55:49.252043+0000","last_active":"2024-04-01T02:12:38.676378+0000","last_peered":"2024-04-01T02:12:38.676378+0000","last_clean":"2024-04-01T02:12:38.676378+0000","last_became_active":"2024-04-01T01:55:49.251760+0000","last_became_peered":"2024-04-01T01:55:49.251760+0000","last_unstale":"2024-04-01T02:12:38.676378+0000","last_undegraded":"2024-04-01T02:12:38.676378+0000","last_fullsized":"2024-04-01T02:12:38.676378+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:12:25.325040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1909794,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":354,"num_write_kb":10727,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"23'882","reported_seq":906,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.722329+0000","last_change":"2024-04-01T01:55:49.270451+0000","last_active":"2024-04-01T02:12:38.722329+0000","last_peered":"2024-04-01T02:12:38.722329+0000","last_clean":"2024-04-01T02:12:38.722329+0000","last_became_active":"2024-04-01T01:55:49.269636+0000","last_became_peered":"2024-04-01T01:55:49.269636+0000","last_unstale":"2024-04-01T02:12:38.722329+0000","last_undegraded":"2024-04-01T02:12:38.722329+0000","last_fullsized":"2024-04-01T02:12:38.722329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":882,"log_dups_size":0,"ondisk_log_size":882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:11:14.234867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6037504,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":748,"num_write_kb":31167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"23'555","reported_seq":579,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.683302+0000","last_change":"2024-04-01T01:55:49.266187+0000","last_active":"2024-04-01T02:12:38.683302+0000","last_peered":"2024-04-01T02:12:38.683302+0000","last_clean":"2024-04-01T02:12:38.683302+0000","last_became_active":"2024-04-01T01:55:49.265946+0000","last_became_peered":"2024-04-01T01:55:49.265946+0000","last_unstale":"2024-04-01T02:12:38.683302+0000","last_undegraded":"2024-04-01T02:12:38.683302+0000","last_fullsized":"2024-04-01T02:12:38.683302+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":555,"log_dups_size":0,"ondisk_log_size":555,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:37:46.890765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4188782,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":415,"num_write_kb":13639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"23'519","reported_seq":543,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.715900+0000","last_change":"2024-04-01T01:55:49.273104+0000","last_active":"2024-04-01T02:12:38.715900+0000","last_peered":"2024-04-01T02:12:38.715900+0000","last_clean":"2024-04-01T02:12:38.715900+0000","last_became_active":"2024-04-01T01:55:49.272742+0000","last_became_peered":"2024-04-01T01:55:49.272742+0000","last_unstale":"2024-04-01T02:12:38.715900+0000","last_undegraded":"2024-04-01T02:12:38.715900+0000","last_fullsized":"2024-04-01T02:12:38.715900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":519,"log_dups_size":0,"ondisk_log_size":519,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:37:46.890765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2869248,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":375,"num_write_kb":19168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"23'536","reported_seq":558,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.691868+0000","last_change":"2024-04-01T01:55:49.241595+0000","last_active":"2024-04-01T02:12:38.691868+0000","last_peered":"2024-04-01T02:12:38.691868+0000","last_clean":"2024-04-01T02:12:38.691868+0000","last_became_active":"2024-04-01T01:55:49.238286+0000","last_became_peered":"2024-04-01T01:55:49.238286+0000","last_unstale":"2024-04-01T02:12:38.691868+0000","last_undegraded":"2024-04-01T02:12:38.691868+0000","last_fullsized":"2024-04-01T02:12:38.691868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":536,"log_dups_size":0,"ondisk_log_size":536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:06:48.999905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6652831,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":403,"num_write_kb":17955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"23'644","reported_seq":668,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:08:21.199984+0000","last_change":"2024-04-01T01:55:48.225145+0000","last_active":"2024-04-01T02:08:21.199984+0000","last_peered":"2024-04-01T02:08:21.199984+0000","last_clean":"2024-04-01T02:08:21.199984+0000","last_became_active":"2024-04-01T01:55:48.224408+0000","last_became_peered":"2024-04-01T01:55:48.224408+0000","last_unstale":"2024-04-01T02:08:21.199984+0000","last_undegraded":"2024-04-01T02:08:21.199984+0000","last_fullsized":"2024-04-01T02:08:21.199984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":644,"log_dups_size":0,"ondisk_log_size":644,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:41:59.465915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":643,"num_write_kb":4346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"23'476","reported_seq":498,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.721153+0000","last_change":"2024-04-01T01:55:49.247771+0000","last_active":"2024-04-01T02:12:38.721153+0000","last_peered":"2024-04-01T02:12:38.721153+0000","last_clean":"2024-04-01T02:12:38.721153+0000","last_became_active":"2024-04-01T01:55:49.247496+0000","last_became_peered":"2024-04-01T01:55:49.247496+0000","last_unstale":"2024-04-01T02:12:38.721153+0000","last_undegraded":"2024-04-01T02:12:38.721153+0000","last_fullsized":"2024-04-01T02:12:38.721153+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":476,"log_dups_size":0,"ondisk_log_size":476,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:02:25.180455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3922463,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":358,"num_write_kb":10126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"23'1916","reported_seq":1940,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.604118+0000","last_change":"2024-04-01T01:55:48.221934+0000","last_active":"2024-04-01T02:12:38.604118+0000","last_peered":"2024-04-01T02:12:38.604118+0000","last_clean":"2024-04-01T02:12:38.604118+0000","last_became_active":"2024-04-01T01:55:48.221614+0000","last_became_peered":"2024-04-01T01:55:48.221614+0000","last_unstale":"2024-04-01T02:12:38.604118+0000","last_undegraded":"2024-04-01T02:12:38.604118+0000","last_fullsized":"2024-04-01T02:12:38.604118+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":1916,"log_dups_size":0,"ondisk_log_size":1916,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:06:47.990123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16687772,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1912,"num_write_kb":17167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"23'393","reported_seq":417,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:10:16.229529+0000","last_change":"2024-04-01T01:55:48.217879+0000","last_active":"2024-04-01T02:10:16.229529+0000","last_peered":"2024-04-01T02:10:16.229529+0000","last_clean":"2024-04-01T02:10:16.229529+0000","last_became_active":"2024-04-01T01:55:48.216141+0000","last_became_peered":"2024-04-01T01:55:48.216141+0000","last_unstale":"2024-04-01T02:10:16.229529+0000","last_undegraded":"2024-04-01T02:10:16.229529+0000","last_fullsized":"2024-04-01T02:10:16.229529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:36:42.625449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":392,"num_write_kb":4245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"23'553","reported_seq":575,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.685589+0000","last_change":"2024-04-01T01:55:49.246424+0000","last_active":"2024-04-01T02:12:38.685589+0000","last_peered":"2024-04-01T02:12:38.685589+0000","last_clean":"2024-04-01T02:12:38.685589+0000","last_became_active":"2024-04-01T01:55:49.243823+0000","last_became_peered":"2024-04-01T01:55:49.243823+0000","last_unstale":"2024-04-01T02:12:38.685589+0000","last_undegraded":"2024-04-01T02:12:38.685589+0000","last_fullsized":"2024-04-01T02:12:38.685589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":553,"log_dups_size":0,"ondisk_log_size":553,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:27:45.663474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3965184,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":412,"num_write_kb":14098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"23'1752","reported_seq":1777,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:11:59.821172+0000","last_change":"2024-04-01T01:55:48.222831+0000","last_active":"2024-04-01T02:11:59.821172+0000","last_peered":"2024-04-01T02:11:59.821172+0000","last_clean":"2024-04-01T02:11:59.821172+0000","last_became_active":"2024-04-01T01:55:48.222535+0000","last_became_peered":"2024-04-01T01:55:48.222535+0000","last_unstale":"2024-04-01T02:11:59.821172+0000","last_undegraded":"2024-04-01T02:11:59.821172+0000","last_fullsized":"2024-04-01T02:11:59.821172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":1752,"log_dups_size":0,"ondisk_log_size":1752,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:49:34.960786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1749,"num_write_kb":12993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"23'533","reported_seq":555,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.685623+0000","last_change":"2024-04-01T01:55:49.231967+0000","last_active":"2024-04-01T02:12:38.685623+0000","last_peered":"2024-04-01T02:12:38.685623+0000","last_clean":"2024-04-01T02:12:38.685623+0000","last_became_active":"2024-04-01T01:55:49.230659+0000","last_became_peered":"2024-04-01T01:55:49.230659+0000","last_unstale":"2024-04-01T02:12:38.685623+0000","last_undegraded":"2024-04-01T02:12:38.685623+0000","last_fullsized":"2024-04-01T02:12:38.685623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":533,"log_dups_size":0,"ondisk_log_size":533,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:57:31.843504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3477908,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":407,"num_write_kb":10690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"23'1","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:10:18.221449+0000","last_change":"2024-04-01T01:55:48.216724+0000","last_active":"2024-04-01T02:10:18.221449+0000","last_peered":"2024-04-01T02:10:18.221449+0000","last_clean":"2024-04-01T02:10:18.221449+0000","last_became_active":"2024-04-01T01:55:48.216318+0000","last_became_peered":"2024-04-01T01:55:48.216318+0000","last_unstale":"2024-04-01T02:10:18.221449+0000","last_undegraded":"2024-04-01T02:10:18.221449+0000","last_fullsized":"2024-04-01T02:10:18.221449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:25:51.219789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"23'551","reported_seq":573,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.741076+0000","last_change":"2024-04-01T01:55:49.280230+0000","last_active":"2024-04-01T02:12:38.741076+0000","last_peered":"2024-04-01T02:12:38.741076+0000","last_clean":"2024-04-01T02:12:38.741076+0000","last_became_active":"2024-04-01T01:55:49.279866+0000","last_became_peered":"2024-04-01T01:55:49.279866+0000","last_unstale":"2024-04-01T02:12:38.741076+0000","last_undegraded":"2024-04-01T02:12:38.741076+0000","last_fullsized":"2024-04-01T02:12:38.741076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":551,"log_dups_size":0,"ondisk_log_size":551,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:00:34.607980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2636189,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":401,"num_write_kb":10506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"23'494","reported_seq":519,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:27.512140+0000","last_change":"2024-04-01T01:55:48.213879+0000","last_active":"2024-04-01T02:12:27.512140+0000","last_peered":"2024-04-01T02:12:27.512140+0000","last_clean":"2024-04-01T02:12:27.512140+0000","last_became_active":"2024-04-01T01:55:48.213610+0000","last_became_peered":"2024-04-01T01:55:48.213610+0000","last_unstale":"2024-04-01T02:12:27.512140+0000","last_undegraded":"2024-04-01T02:12:27.512140+0000","last_fullsized":"2024-04-01T02:12:27.512140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":494,"log_dups_size":0,"ondisk_log_size":494,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:33:55.744424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":490,"num_write_kb":4342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"23'507","reported_seq":529,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.704049+0000","last_change":"2024-04-01T01:55:49.261532+0000","last_active":"2024-04-01T02:12:38.704049+0000","last_peered":"2024-04-01T02:12:38.704049+0000","last_clean":"2024-04-01T02:12:38.704049+0000","last_became_active":"2024-04-01T01:55:49.261260+0000","last_became_peered":"2024-04-01T01:55:49.261260+0000","last_unstale":"2024-04-01T02:12:38.704049+0000","last_undegraded":"2024-04-01T02:12:38.704049+0000","last_fullsized":"2024-04-01T02:12:38.704049+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":507,"log_dups_size":0,"ondisk_log_size":507,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:30:02.149564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2169152,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":377,"num_write_kb":10428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"23'1317","reported_seq":1342,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:37.139675+0000","last_change":"2024-04-01T01:55:48.227054+0000","last_active":"2024-04-01T02:12:37.139675+0000","last_peered":"2024-04-01T02:12:37.139675+0000","last_clean":"2024-04-01T02:12:37.139675+0000","last_became_active":"2024-04-01T01:55:48.226061+0000","last_became_peered":"2024-04-01T01:55:48.226061+0000","last_unstale":"2024-04-01T02:12:37.139675+0000","last_undegraded":"2024-04-01T02:12:37.139675+0000","last_fullsized":"2024-04-01T02:12:37.139675+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":1317,"log_dups_size":0,"ondisk_log_size":1317,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:18:27.840431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1316,"num_write_kb":5169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"23'650","reported_seq":673,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.727577+0000","last_change":"2024-04-01T01:55:49.261662+0000","last_active":"2024-04-01T02:12:38.727577+0000","last_peered":"2024-04-01T02:12:38.727577+0000","last_clean":"2024-04-01T02:12:38.727577+0000","last_became_active":"2024-04-01T01:55:49.261286+0000","last_became_peered":"2024-04-01T01:55:49.261286+0000","last_unstale":"2024-04-01T02:12:38.727577+0000","last_undegraded":"2024-04-01T02:12:38.727577+0000","last_fullsized":"2024-04-01T02:12:38.727577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":650,"log_dups_size":0,"ondisk_log_size":650,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:56:11.350186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3031627,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":532,"num_write_kb":22303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"23'1654","reported_seq":1679,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:23.004257+0000","last_change":"2024-04-01T01:55:48.219739+0000","last_active":"2024-04-01T02:12:23.004257+0000","last_peered":"2024-04-01T02:12:23.004257+0000","last_clean":"2024-04-01T02:12:23.004257+0000","last_became_active":"2024-04-01T01:55:48.219107+0000","last_became_peered":"2024-04-01T01:55:48.219107+0000","last_unstale":"2024-04-01T02:12:23.004257+0000","last_undegraded":"2024-04-01T02:12:23.004257+0000","last_fullsized":"2024-04-01T02:12:23.004257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":1654,"log_dups_size":0,"ondisk_log_size":1654,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:14:12.790111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1651,"num_write_kb":13025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"23'479","reported_seq":501,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.717152+0000","last_change":"2024-04-01T01:55:49.255056+0000","last_active":"2024-04-01T02:12:38.717152+0000","last_peered":"2024-04-01T02:12:38.717152+0000","last_clean":"2024-04-01T02:12:38.717152+0000","last_became_active":"2024-04-01T01:55:49.247910+0000","last_became_peered":"2024-04-01T01:55:49.247910+0000","last_unstale":"2024-04-01T02:12:38.717152+0000","last_undegraded":"2024-04-01T02:12:38.717152+0000","last_fullsized":"2024-04-01T02:12:38.717152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":479,"log_dups_size":0,"ondisk_log_size":479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T13:02:55.577616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3214612,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":324,"num_write_kb":15075,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"23'1306","reported_seq":1331,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:09:48.210530+0000","last_change":"2024-04-01T01:55:48.215613+0000","last_active":"2024-04-01T02:09:48.210530+0000","last_peered":"2024-04-01T02:09:48.210530+0000","last_clean":"2024-04-01T02:09:48.210530+0000","last_became_active":"2024-04-01T01:55:48.214669+0000","last_became_peered":"2024-04-01T01:55:48.214669+0000","last_unstale":"2024-04-01T02:09:48.210530+0000","last_undegraded":"2024-04-01T02:09:48.210530+0000","last_fullsized":"2024-04-01T02:09:48.210530+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":1306,"log_dups_size":0,"ondisk_log_size":1306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:25:51.219789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1305,"num_write_kb":8736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"23'502","reported_seq":525,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.703951+0000","last_change":"2024-04-01T01:55:49.270153+0000","last_active":"2024-04-01T02:12:38.703951+0000","last_peered":"2024-04-01T02:12:38.703951+0000","last_clean":"2024-04-01T02:12:38.703951+0000","last_became_active":"2024-04-01T01:55:49.269840+0000","last_became_peered":"2024-04-01T01:55:49.269840+0000","last_unstale":"2024-04-01T02:12:38.703951+0000","last_undegraded":"2024-04-01T02:12:38.703951+0000","last_fullsized":"2024-04-01T02:12:38.703951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":502,"log_dups_size":0,"ondisk_log_size":502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:00:34.607980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2873887,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":372,"num_write_kb":10690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:09:48.231670+0000","last_change":"2024-04-01T01:55:48.214783+0000","last_active":"2024-04-01T02:09:48.231670+0000","last_peered":"2024-04-01T02:09:48.231670+0000","last_clean":"2024-04-01T02:09:48.231670+0000","last_became_active":"2024-04-01T01:55:48.213463+0000","last_became_peered":"2024-04-01T01:55:48.213463+0000","last_unstale":"2024-04-01T02:09:48.231670+0000","last_undegraded":"2024-04-01T02:09:48.231670+0000","last_fullsized":"2024-04-01T02:09:48.231670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:00:33.598198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"23'694","reported_seq":717,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.732478+0000","last_change":"2024-04-01T01:55:49.274841+0000","last_active":"2024-04-01T02:12:38.732478+0000","last_peered":"2024-04-01T02:12:38.732478+0000","last_clean":"2024-04-01T02:12:38.732478+0000","last_became_active":"2024-04-01T01:55:49.274430+0000","last_became_peered":"2024-04-01T01:55:49.274430+0000","last_unstale":"2024-04-01T02:12:38.732478+0000","last_undegraded":"2024-04-01T02:12:38.732478+0000","last_fullsized":"2024-04-01T02:12:38.732478+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":694,"log_dups_size":0,"ondisk_log_size":694,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T13:25:36.254927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1869911,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":559,"num_write_kb":109429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:09:48.233532+0000","last_change":"2024-04-01T01:55:48.210944+0000","last_active":"2024-04-01T02:09:48.233532+0000","last_peered":"2024-04-01T02:09:48.233532+0000","last_clean":"2024-04-01T02:09:48.233532+0000","last_became_active":"2024-04-01T01:55:48.210616+0000","last_became_peered":"2024-04-01T01:55:48.210616+0000","last_unstale":"2024-04-01T02:09:48.233532+0000","last_undegraded":"2024-04-01T02:09:48.233532+0000","last_fullsized":"2024-04-01T02:09:48.233532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:38:32.247471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"23'514","reported_seq":537,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.691443+0000","last_change":"2024-04-01T01:55:49.239528+0000","last_active":"2024-04-01T02:12:38.691443+0000","last_peered":"2024-04-01T02:12:38.691443+0000","last_clean":"2024-04-01T02:12:38.691443+0000","last_became_active":"2024-04-01T01:55:49.238805+0000","last_became_peered":"2024-04-01T01:55:49.238805+0000","last_unstale":"2024-04-01T02:12:38.691443+0000","last_undegraded":"2024-04-01T02:12:38.691443+0000","last_fullsized":"2024-04-01T02:12:38.691443+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":514,"log_dups_size":0,"ondisk_log_size":514,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:37:46.890765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1821215,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":368,"num_write_kb":8386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"23'816","reported_seq":841,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:11:05.530786+0000","last_change":"2024-04-01T01:55:48.211677+0000","last_active":"2024-04-01T02:11:05.530786+0000","last_peered":"2024-04-01T02:11:05.530786+0000","last_clean":"2024-04-01T02:11:05.530786+0000","last_became_active":"2024-04-01T01:55:48.210893+0000","last_became_peered":"2024-04-01T01:55:48.210893+0000","last_unstale":"2024-04-01T02:11:05.530786+0000","last_undegraded":"2024-04-01T02:11:05.530786+0000","last_fullsized":"2024-04-01T02:11:05.530786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:04:19.568533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":818,"num_write_kb":8585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"23'607","reported_seq":630,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.717565+0000","last_change":"2024-04-01T01:55:49.261872+0000","last_active":"2024-04-01T02:12:38.717565+0000","last_peered":"2024-04-01T02:12:38.717565+0000","last_clean":"2024-04-01T02:12:38.717565+0000","last_became_active":"2024-04-01T01:55:49.261517+0000","last_became_peered":"2024-04-01T01:55:49.261517+0000","last_unstale":"2024-04-01T02:12:38.717565+0000","last_undegraded":"2024-04-01T02:12:38.717565+0000","last_fullsized":"2024-04-01T02:12:38.717565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":607,"log_dups_size":0,"ondisk_log_size":607,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T13:02:55.577616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5805184,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":464,"num_write_kb":32813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"23'422","reported_seq":447,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:09:43.759499+0000","last_change":"2024-04-01T01:55:48.198687+0000","last_active":"2024-04-01T02:09:43.759499+0000","last_peered":"2024-04-01T02:09:43.759499+0000","last_clean":"2024-04-01T02:09:43.759499+0000","last_became_active":"2024-04-01T01:55:48.198319+0000","last_became_peered":"2024-04-01T01:55:48.198319+0000","last_unstale":"2024-04-01T02:09:43.759499+0000","last_undegraded":"2024-04-01T02:09:43.759499+0000","last_fullsized":"2024-04-01T02:09:43.759499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:37:45.880984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":421,"num_write_kb":4293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"23'517","reported_seq":540,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.738045+0000","last_change":"2024-04-01T01:55:49.272424+0000","last_active":"2024-04-01T02:12:38.738045+0000","last_peered":"2024-04-01T02:12:38.738045+0000","last_clean":"2024-04-01T02:12:38.738045+0000","last_became_active":"2024-04-01T01:55:49.265670+0000","last_became_peered":"2024-04-01T01:55:49.265670+0000","last_unstale":"2024-04-01T02:12:38.738045+0000","last_undegraded":"2024-04-01T02:12:38.738045+0000","last_fullsized":"2024-04-01T02:12:38.738045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":517,"log_dups_size":0,"ondisk_log_size":517,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:26:09.632757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4958208,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":395,"num_write_kb":11184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"23'500","reported_seq":525,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:09:22.676923+0000","last_change":"2024-04-01T01:55:48.219312+0000","last_active":"2024-04-01T02:09:22.676923+0000","last_peered":"2024-04-01T02:09:22.676923+0000","last_clean":"2024-04-01T02:09:22.676923+0000","last_became_active":"2024-04-01T01:55:48.218562+0000","last_became_peered":"2024-04-01T01:55:48.218562+0000","last_unstale":"2024-04-01T02:09:22.676923+0000","last_undegraded":"2024-04-01T02:09:22.676923+0000","last_fullsized":"2024-04-01T02:09:22.676923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":500,"log_dups_size":0,"ondisk_log_size":500,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:38:32.247471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":500,"num_write_kb":4281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"23'489","reported_seq":512,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.733305+0000","last_change":"2024-04-01T01:55:49.268041+0000","last_active":"2024-04-01T02:12:38.733305+0000","last_peered":"2024-04-01T02:12:38.733305+0000","last_clean":"2024-04-01T02:12:38.733305+0000","last_became_active":"2024-04-01T01:55:49.267502+0000","last_became_peered":"2024-04-01T01:55:49.267502+0000","last_unstale":"2024-04-01T02:12:38.733305+0000","last_undegraded":"2024-04-01T02:12:38.733305+0000","last_fullsized":"2024-04-01T02:12:38.733305+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":489,"log_dups_size":0,"ondisk_log_size":489,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:21:46.367144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2609152,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":355,"num_write_kb":9167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"23'652","reported_seq":677,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:09:21.209057+0000","last_change":"2024-04-01T01:55:48.216662+0000","last_active":"2024-04-01T02:09:21.209057+0000","last_peered":"2024-04-01T02:09:21.209057+0000","last_clean":"2024-04-01T02:09:21.209057+0000","last_became_active":"2024-04-01T01:55:48.215852+0000","last_became_peered":"2024-04-01T01:55:48.215852+0000","last_unstale":"2024-04-01T02:09:21.209057+0000","last_undegraded":"2024-04-01T02:09:21.209057+0000","last_fullsized":"2024-04-01T02:09:21.209057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":652,"log_dups_size":0,"ondisk_log_size":652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:25:39.713293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":651,"num_write_kb":4358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"23'532","reported_seq":555,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.706848+0000","last_change":"2024-04-01T01:55:49.256142+0000","last_active":"2024-04-01T02:12:38.706848+0000","last_peered":"2024-04-01T02:12:38.706848+0000","last_clean":"2024-04-01T02:12:38.706848+0000","last_became_active":"2024-04-01T01:55:49.255781+0000","last_became_peered":"2024-04-01T01:55:49.255781+0000","last_unstale":"2024-04-01T02:12:38.706848+0000","last_undegraded":"2024-04-01T02:12:38.706848+0000","last_fullsized":"2024-04-01T02:12:38.706848+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":532,"log_dups_size":0,"ondisk_log_size":532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:10:23.571126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3486100,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384,"num_write_kb":10452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"23'482","reported_seq":507,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:07.732858+0000","last_change":"2024-04-01T01:55:48.219851+0000","last_active":"2024-04-01T02:12:07.732858+0000","last_peered":"2024-04-01T02:12:07.732858+0000","last_clean":"2024-04-01T02:12:07.732858+0000","last_became_active":"2024-04-01T01:55:48.215898+0000","last_became_peered":"2024-04-01T01:55:48.215898+0000","last_unstale":"2024-04-01T02:12:07.732858+0000","last_undegraded":"2024-04-01T02:12:07.732858+0000","last_fullsized":"2024-04-01T02:12:07.732858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:18:27.840431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":481,"num_write_kb":4326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"23'543","reported_seq":566,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.725313+0000","last_change":"2024-04-01T01:55:49.275452+0000","last_active":"2024-04-01T02:12:38.725313+0000","last_peered":"2024-04-01T02:12:38.725313+0000","last_clean":"2024-04-01T02:12:38.725313+0000","last_became_active":"2024-04-01T01:55:49.274600+0000","last_became_peered":"2024-04-01T01:55:49.274600+0000","last_unstale":"2024-04-01T02:12:38.725313+0000","last_undegraded":"2024-04-01T02:12:38.725313+0000","last_fullsized":"2024-04-01T02:12:38.725313+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":543,"log_dups_size":0,"ondisk_log_size":543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:19:24.052574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3740270,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":421,"num_write_kb":13583,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":182,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:09:43.218713+0000","last_change":"2024-04-01T01:55:43.145201+0000","last_active":"2024-04-01T02:09:43.218713+0000","last_peered":"2024-04-01T02:09:43.218713+0000","last_clean":"2024-04-01T02:09:43.218713+0000","last_became_active":"2024-04-01T01:55:43.144882+0000","last_became_peered":"2024-04-01T01:55:43.144882+0000","last_unstale":"2024-04-01T02:09:43.218713+0000","last_undegraded":"2024-04-01T02:09:43.218713+0000","last_fullsized":"2024-04-01T02:09:43.218713+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:42.134502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:42.134502+0000","last_clean_scrub_stamp":"2024-04-01T01:55:42.134502+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:02:26.589535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"23'539","reported_seq":565,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:11:39.852771+0000","last_change":"2024-04-01T01:55:48.207222+0000","last_active":"2024-04-01T02:11:39.852771+0000","last_peered":"2024-04-01T02:11:39.852771+0000","last_clean":"2024-04-01T02:11:39.852771+0000","last_became_active":"2024-04-01T01:55:48.206293+0000","last_became_peered":"2024-04-01T01:55:48.206293+0000","last_unstale":"2024-04-01T02:11:39.852771+0000","last_undegraded":"2024-04-01T02:11:39.852771+0000","last_fullsized":"2024-04-01T02:11:39.852771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":539,"log_dups_size":0,"ondisk_log_size":539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:37:45.880984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":538,"num_write_kb":4366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"23'475","reported_seq":499,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.699425+0000","last_change":"2024-04-01T01:55:49.273517+0000","last_active":"2024-04-01T02:12:38.699425+0000","last_peered":"2024-04-01T02:12:38.699425+0000","last_clean":"2024-04-01T02:12:38.699425+0000","last_became_active":"2024-04-01T01:55:49.273197+0000","last_became_peered":"2024-04-01T01:55:49.273197+0000","last_unstale":"2024-04-01T02:12:38.699425+0000","last_undegraded":"2024-04-01T02:12:38.699425+0000","last_fullsized":"2024-04-01T02:12:38.699425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:14:32.577522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2100352,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":362,"num_write_kb":7512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"23'1724","reported_seq":1750,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:11:27.553670+0000","last_change":"2024-04-01T01:55:48.214341+0000","last_active":"2024-04-01T02:11:27.553670+0000","last_peered":"2024-04-01T02:11:27.553670+0000","last_clean":"2024-04-01T02:11:27.553670+0000","last_became_active":"2024-04-01T01:55:48.213914+0000","last_became_peered":"2024-04-01T01:55:48.213914+0000","last_unstale":"2024-04-01T02:11:27.553670+0000","last_undegraded":"2024-04-01T02:11:27.553670+0000","last_fullsized":"2024-04-01T02:11:27.553670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":1724,"log_dups_size":0,"ondisk_log_size":1724,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:09:28.276592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1721,"num_write_kb":12994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"23'521","reported_seq":545,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.699651+0000","last_change":"2024-04-01T01:55:49.272106+0000","last_active":"2024-04-01T02:12:38.699651+0000","last_peered":"2024-04-01T02:12:38.699651+0000","last_clean":"2024-04-01T02:12:38.699651+0000","last_became_active":"2024-04-01T01:55:49.271821+0000","last_became_peered":"2024-04-01T01:55:49.271821+0000","last_unstale":"2024-04-01T02:12:38.699651+0000","last_undegraded":"2024-04-01T02:12:38.699651+0000","last_fullsized":"2024-04-01T02:12:38.699651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":521,"log_dups_size":0,"ondisk_log_size":521,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T13:22:31.821166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2398580,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":392,"num_write_kb":9213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"23'1760","reported_seq":3545,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:37.134355+0000","last_change":"2024-04-01T01:55:48.218296+0000","last_active":"2024-04-01T02:12:37.134355+0000","last_peered":"2024-04-01T02:12:37.134355+0000","last_clean":"2024-04-01T02:12:37.134355+0000","last_became_active":"2024-04-01T01:55:48.217516+0000","last_became_peered":"2024-04-01T01:55:48.217516+0000","last_unstale":"2024-04-01T02:12:37.134355+0000","last_undegraded":"2024-04-01T02:12:37.134355+0000","last_fullsized":"2024-04-01T02:12:37.134355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":1760,"log_dups_size":0,"ondisk_log_size":1760,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:36:42.625449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1520757,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1759,"num_read_kb":2743,"num_write":1759,"num_write_kb":2743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"23'578","reported_seq":602,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.683159+0000","last_change":"2024-04-01T01:55:49.246734+0000","last_active":"2024-04-01T02:12:38.683159+0000","last_peered":"2024-04-01T02:12:38.683159+0000","last_clean":"2024-04-01T02:12:38.683159+0000","last_became_active":"2024-04-01T01:55:49.246152+0000","last_became_peered":"2024-04-01T01:55:49.246152+0000","last_unstale":"2024-04-01T02:12:38.683159+0000","last_undegraded":"2024-04-01T02:12:38.683159+0000","last_fullsized":"2024-04-01T02:12:38.683159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":578,"log_dups_size":0,"ondisk_log_size":578,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:52:34.992185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4683946,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":447,"num_write_kb":12840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"23'1294","reported_seq":1320,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:10:23.234493+0000","last_change":"2024-04-01T01:55:48.222956+0000","last_active":"2024-04-01T02:10:23.234493+0000","last_peered":"2024-04-01T02:10:23.234493+0000","last_clean":"2024-04-01T02:10:23.234493+0000","last_became_active":"2024-04-01T01:55:48.222414+0000","last_became_peered":"2024-04-01T01:55:48.222414+0000","last_unstale":"2024-04-01T02:10:23.234493+0000","last_undegraded":"2024-04-01T02:10:23.234493+0000","last_fullsized":"2024-04-01T02:10:23.234493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":1294,"log_dups_size":0,"ondisk_log_size":1294,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:26:08.622975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1292,"num_write_kb":8711,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"23'509","reported_seq":533,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.733441+0000","last_change":"2024-04-01T01:55:49.247633+0000","last_active":"2024-04-01T02:12:38.733441+0000","last_peered":"2024-04-01T02:12:38.733441+0000","last_clean":"2024-04-01T02:12:38.733441+0000","last_became_active":"2024-04-01T01:55:49.247285+0000","last_became_peered":"2024-04-01T01:55:49.247285+0000","last_unstale":"2024-04-01T02:12:38.733441+0000","last_undegraded":"2024-04-01T02:12:38.733441+0000","last_fullsized":"2024-04-01T02:12:38.733441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":509,"log_dups_size":0,"ondisk_log_size":509,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:15:01.912111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1905973,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":374,"num_write_kb":9925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"23'411","reported_seq":437,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:11:49.203845+0000","last_change":"2024-04-01T01:55:48.226323+0000","last_active":"2024-04-01T02:11:49.203845+0000","last_peered":"2024-04-01T02:11:49.203845+0000","last_clean":"2024-04-01T02:11:49.203845+0000","last_became_active":"2024-04-01T01:55:48.225487+0000","last_became_peered":"2024-04-01T01:55:48.225487+0000","last_unstale":"2024-04-01T02:11:49.203845+0000","last_undegraded":"2024-04-01T02:11:49.203845+0000","last_fullsized":"2024-04-01T02:11:49.203845+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:13:17.832963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":410,"num_write_kb":4283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"23'561","reported_seq":585,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.695026+0000","last_change":"2024-04-01T01:55:49.265542+0000","last_active":"2024-04-01T02:12:38.695026+0000","last_peered":"2024-04-01T02:12:38.695026+0000","last_clean":"2024-04-01T02:12:38.695026+0000","last_became_active":"2024-04-01T01:55:49.264914+0000","last_became_peered":"2024-04-01T01:55:49.264914+0000","last_unstale":"2024-04-01T02:12:38.695026+0000","last_undegraded":"2024-04-01T02:12:38.695026+0000","last_fullsized":"2024-04-01T02:12:38.695026+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":561,"log_dups_size":0,"ondisk_log_size":561,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:55:44.175129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3471816,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":416,"num_write_kb":10624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"23'809","reported_seq":835,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:11:54.724715+0000","last_change":"2024-04-01T01:55:48.227292+0000","last_active":"2024-04-01T02:11:54.724715+0000","last_peered":"2024-04-01T02:11:54.724715+0000","last_clean":"2024-04-01T02:11:54.724715+0000","last_became_active":"2024-04-01T01:55:48.226948+0000","last_became_peered":"2024-04-01T01:55:48.226948+0000","last_unstale":"2024-04-01T02:11:54.724715+0000","last_undegraded":"2024-04-01T02:11:54.724715+0000","last_fullsized":"2024-04-01T02:11:54.724715+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":809,"log_dups_size":0,"ondisk_log_size":809,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:55:43.165347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":807,"num_write_kb":8573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"23'580","reported_seq":604,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.666892+0000","last_change":"2024-04-01T01:55:49.244171+0000","last_active":"2024-04-01T02:12:38.666892+0000","last_peered":"2024-04-01T02:12:38.666892+0000","last_clean":"2024-04-01T02:12:38.666892+0000","last_became_active":"2024-04-01T01:55:49.241632+0000","last_became_peered":"2024-04-01T01:55:49.241632+0000","last_unstale":"2024-04-01T02:12:38.666892+0000","last_undegraded":"2024-04-01T02:12:38.666892+0000","last_fullsized":"2024-04-01T02:12:38.666892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":580,"log_dups_size":0,"ondisk_log_size":580,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:24:42.777720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1649698,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":453,"num_write_kb":12096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"23'923","reported_seq":948,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.128694+0000","last_change":"2024-04-01T01:55:48.204432+0000","last_active":"2024-04-01T02:12:38.128694+0000","last_peered":"2024-04-01T02:12:38.128694+0000","last_clean":"2024-04-01T02:12:38.128694+0000","last_became_active":"2024-04-01T01:55:48.203576+0000","last_became_peered":"2024-04-01T01:55:48.203576+0000","last_unstale":"2024-04-01T02:12:38.128694+0000","last_undegraded":"2024-04-01T02:12:38.128694+0000","last_fullsized":"2024-04-01T02:12:38.128694+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":923,"log_dups_size":0,"ondisk_log_size":923,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:49:34.960786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2724,"num_write_kb":1428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"23'518","reported_seq":541,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.675180+0000","last_change":"2024-04-01T01:55:49.244993+0000","last_active":"2024-04-01T02:12:38.675180+0000","last_peered":"2024-04-01T02:12:38.675180+0000","last_clean":"2024-04-01T02:12:38.675180+0000","last_became_active":"2024-04-01T01:55:49.244632+0000","last_became_peered":"2024-04-01T01:55:49.244632+0000","last_unstale":"2024-04-01T02:12:38.675180+0000","last_undegraded":"2024-04-01T02:12:38.675180+0000","last_fullsized":"2024-04-01T02:12:38.675180+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":518,"log_dups_size":0,"ondisk_log_size":518,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:30:26.148968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2231074,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":416,"num_write_kb":11781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"23'451","reported_seq":476,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:11:20.248134+0000","last_change":"2024-04-01T01:55:48.221282+0000","last_active":"2024-04-01T02:11:20.248134+0000","last_peered":"2024-04-01T02:11:20.248134+0000","last_clean":"2024-04-01T02:11:20.248134+0000","last_became_active":"2024-04-01T01:55:48.220889+0000","last_became_peered":"2024-04-01T01:55:48.220889+0000","last_unstale":"2024-04-01T02:11:20.248134+0000","last_undegraded":"2024-04-01T02:11:20.248134+0000","last_fullsized":"2024-04-01T02:11:20.248134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:13:12.104386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":451,"num_write_kb":4303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"23'576","reported_seq":599,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.681858+0000","last_change":"2024-04-01T01:55:49.251927+0000","last_active":"2024-04-01T02:12:38.681858+0000","last_peered":"2024-04-01T02:12:38.681858+0000","last_clean":"2024-04-01T02:12:38.681858+0000","last_became_active":"2024-04-01T01:55:49.251641+0000","last_became_peered":"2024-04-01T01:55:49.251641+0000","last_unstale":"2024-04-01T02:12:38.681858+0000","last_undegraded":"2024-04-01T02:12:38.681858+0000","last_fullsized":"2024-04-01T02:12:38.681858+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T13:22:31.821166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1372160,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":436,"num_write_kb":14438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"23'656","reported_seq":681,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:08:48.226321+0000","last_change":"2024-04-01T01:55:48.204161+0000","last_active":"2024-04-01T02:08:48.226321+0000","last_peered":"2024-04-01T02:08:48.226321+0000","last_clean":"2024-04-01T02:08:48.226321+0000","last_became_active":"2024-04-01T01:55:48.203828+0000","last_became_peered":"2024-04-01T01:55:48.203828+0000","last_unstale":"2024-04-01T02:08:48.226321+0000","last_undegraded":"2024-04-01T02:08:48.226321+0000","last_fullsized":"2024-04-01T02:08:48.226321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":656,"log_dups_size":0,"ondisk_log_size":656,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:04:19.568533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":655,"num_write_kb":4360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"23'536","reported_seq":559,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:35.139930+0000","last_change":"2024-04-01T01:55:49.259699+0000","last_active":"2024-04-01T02:12:35.139930+0000","last_peered":"2024-04-01T02:12:35.139930+0000","last_clean":"2024-04-01T02:12:35.139930+0000","last_became_active":"2024-04-01T01:55:49.259332+0000","last_became_peered":"2024-04-01T01:55:49.259332+0000","last_unstale":"2024-04-01T02:12:35.139930+0000","last_undegraded":"2024-04-01T02:12:35.139930+0000","last_fullsized":"2024-04-01T02:12:35.139930+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":536,"log_dups_size":0,"ondisk_log_size":536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:02:41.829474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2628206,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":12728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"23'521","reported_seq":546,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:11:11.799786+0000","last_change":"2024-04-01T01:55:48.206742+0000","last_active":"2024-04-01T02:11:11.799786+0000","last_peered":"2024-04-01T02:11:11.799786+0000","last_clean":"2024-04-01T02:11:11.799786+0000","last_became_active":"2024-04-01T01:55:48.206027+0000","last_became_peered":"2024-04-01T01:55:48.206027+0000","last_unstale":"2024-04-01T02:11:11.799786+0000","last_undegraded":"2024-04-01T02:11:11.799786+0000","last_fullsized":"2024-04-01T02:11:11.799786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":521,"log_dups_size":0,"ondisk_log_size":521,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:18:27.840431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":520,"num_write_kb":4323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"23'492","reported_seq":515,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.675506+0000","last_change":"2024-04-01T01:55:49.246379+0000","last_active":"2024-04-01T02:12:38.675506+0000","last_peered":"2024-04-01T02:12:38.675506+0000","last_clean":"2024-04-01T02:12:38.675506+0000","last_became_active":"2024-04-01T01:55:49.245774+0000","last_became_peered":"2024-04-01T01:55:49.245774+0000","last_unstale":"2024-04-01T02:12:38.675506+0000","last_undegraded":"2024-04-01T02:12:38.675506+0000","last_fullsized":"2024-04-01T02:12:38.675506+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":492,"log_dups_size":0,"ondisk_log_size":492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:25:48.896071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2457258,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":347,"num_write_kb":7703,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"23'731","reported_seq":756,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:21.550193+0000","last_change":"2024-04-01T01:55:48.222218+0000","last_active":"2024-04-01T02:12:21.550193+0000","last_peered":"2024-04-01T02:12:21.550193+0000","last_clean":"2024-04-01T02:12:21.550193+0000","last_became_active":"2024-04-01T01:55:48.221148+0000","last_became_peered":"2024-04-01T01:55:48.221148+0000","last_unstale":"2024-04-01T02:12:21.550193+0000","last_undegraded":"2024-04-01T02:12:21.550193+0000","last_fullsized":"2024-04-01T02:12:21.550193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":731,"log_dups_size":0,"ondisk_log_size":731,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:25:51.219789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":729,"num_write_kb":8526,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"23'573","reported_seq":596,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.673104+0000","last_change":"2024-04-01T01:55:49.249648+0000","last_active":"2024-04-01T02:12:38.673104+0000","last_peered":"2024-04-01T02:12:38.673104+0000","last_clean":"2024-04-01T02:12:38.673104+0000","last_became_active":"2024-04-01T01:55:49.248925+0000","last_became_peered":"2024-04-01T01:55:49.248925+0000","last_unstale":"2024-04-01T02:12:38.673104+0000","last_undegraded":"2024-04-01T02:12:38.673104+0000","last_fullsized":"2024-04-01T02:12:38.673104+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":573,"log_dups_size":0,"ondisk_log_size":573,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:33:56.754206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4491912,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":426,"num_write_kb":28953,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"23'1469","reported_seq":1494,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:16.455768+0000","last_change":"2024-04-01T01:55:48.207522+0000","last_active":"2024-04-01T02:12:16.455768+0000","last_peered":"2024-04-01T02:12:16.455768+0000","last_clean":"2024-04-01T02:12:16.455768+0000","last_became_active":"2024-04-01T01:55:48.206856+0000","last_became_peered":"2024-04-01T01:55:48.206856+0000","last_unstale":"2024-04-01T02:12:16.455768+0000","last_undegraded":"2024-04-01T02:12:16.455768+0000","last_fullsized":"2024-04-01T02:12:16.455768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":1469,"log_dups_size":0,"ondisk_log_size":1469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:33:55.744424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1465,"num_write_kb":12919,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"23'559","reported_seq":582,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.722571+0000","last_change":"2024-04-01T01:55:49.274489+0000","last_active":"2024-04-01T02:12:38.722571+0000","last_peered":"2024-04-01T02:12:38.722571+0000","last_clean":"2024-04-01T02:12:38.722571+0000","last_became_active":"2024-04-01T01:55:49.270254+0000","last_became_peered":"2024-04-01T01:55:49.270254+0000","last_unstale":"2024-04-01T02:12:38.722571+0000","last_undegraded":"2024-04-01T02:12:38.722571+0000","last_fullsized":"2024-04-01T02:12:38.722571+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":559,"log_dups_size":0,"ondisk_log_size":559,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T13:09:00.491227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5269504,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":425,"num_write_kb":26844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"23'507","reported_seq":529,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.733757+0000","last_change":"2024-04-01T01:55:49.275782+0000","last_active":"2024-04-01T02:12:38.733757+0000","last_peered":"2024-04-01T02:12:38.733757+0000","last_clean":"2024-04-01T02:12:38.733757+0000","last_became_active":"2024-04-01T01:55:49.275050+0000","last_became_peered":"2024-04-01T01:55:49.275050+0000","last_unstale":"2024-04-01T02:12:38.733757+0000","last_undegraded":"2024-04-01T02:12:38.733757+0000","last_fullsized":"2024-04-01T02:12:38.733757+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":507,"log_dups_size":0,"ondisk_log_size":507,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:26:15.406856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1932316,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":383,"num_write_kb":9512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"23'404","reported_seq":428,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:09:28.169392+0000","last_change":"2024-04-01T01:55:48.223704+0000","last_active":"2024-04-01T02:09:28.169392+0000","last_peered":"2024-04-01T02:09:28.169392+0000","last_clean":"2024-04-01T02:09:28.169392+0000","last_became_active":"2024-04-01T01:55:48.223220+0000","last_became_peered":"2024-04-01T01:55:48.223220+0000","last_unstale":"2024-04-01T02:09:28.169392+0000","last_undegraded":"2024-04-01T02:09:28.169392+0000","last_fullsized":"2024-04-01T02:09:28.169392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:49:34.960786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":404,"num_write_kb":4216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"23'478","reported_seq":500,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.712722+0000","last_change":"2024-04-01T01:55:49.264857+0000","last_active":"2024-04-01T02:12:38.712722+0000","last_peered":"2024-04-01T02:12:38.712722+0000","last_clean":"2024-04-01T02:12:38.712722+0000","last_became_active":"2024-04-01T01:55:49.258478+0000","last_became_peered":"2024-04-01T01:55:49.258478+0000","last_unstale":"2024-04-01T02:12:38.712722+0000","last_undegraded":"2024-04-01T02:12:38.712722+0000","last_fullsized":"2024-04-01T02:12:38.712722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":478,"log_dups_size":0,"ondisk_log_size":478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:33:56.754206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2118876,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":354,"num_write_kb":10865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"23'1762","reported_seq":1786,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:10:48.103318+0000","last_change":"2024-04-01T01:55:48.218370+0000","last_active":"2024-04-01T02:10:48.103318+0000","last_peered":"2024-04-01T02:10:48.103318+0000","last_clean":"2024-04-01T02:10:48.103318+0000","last_became_active":"2024-04-01T01:55:48.217755+0000","last_became_peered":"2024-04-01T01:55:48.217755+0000","last_unstale":"2024-04-01T02:10:48.103318+0000","last_undegraded":"2024-04-01T02:10:48.103318+0000","last_fullsized":"2024-04-01T02:10:48.103318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":1762,"log_dups_size":0,"ondisk_log_size":1762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:09:28.276592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1758,"num_write_kb":13032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"23'607","reported_seq":631,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.722636+0000","last_change":"2024-04-01T01:55:49.243377+0000","last_active":"2024-04-01T02:12:38.722636+0000","last_peered":"2024-04-01T02:12:38.722636+0000","last_clean":"2024-04-01T02:12:38.722636+0000","last_became_active":"2024-04-01T01:55:49.242851+0000","last_became_peered":"2024-04-01T01:55:49.242851+0000","last_unstale":"2024-04-01T02:12:38.722636+0000","last_undegraded":"2024-04-01T02:12:38.722636+0000","last_fullsized":"2024-04-01T02:12:38.722636+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":607,"log_dups_size":0,"ondisk_log_size":607,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:48:38.596647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2501666,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":481,"num_write_kb":61542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"23'1142","reported_seq":1168,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:27.519474+0000","last_change":"2024-04-01T01:55:48.213862+0000","last_active":"2024-04-01T02:12:27.519474+0000","last_peered":"2024-04-01T02:12:27.519474+0000","last_clean":"2024-04-01T02:12:27.519474+0000","last_became_active":"2024-04-01T01:55:48.213122+0000","last_became_peered":"2024-04-01T01:55:48.213122+0000","last_unstale":"2024-04-01T02:12:27.519474+0000","last_undegraded":"2024-04-01T02:12:27.519474+0000","last_fullsized":"2024-04-01T02:12:27.519474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":1142,"log_dups_size":0,"ondisk_log_size":1142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:59:23.563864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1140,"num_write_kb":8675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"23'568","reported_seq":592,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.724948+0000","last_change":"2024-04-01T01:55:49.252273+0000","last_active":"2024-04-01T02:12:38.724948+0000","last_peered":"2024-04-01T02:12:38.724948+0000","last_clean":"2024-04-01T02:12:38.724948+0000","last_became_active":"2024-04-01T01:55:49.251963+0000","last_became_peered":"2024-04-01T01:55:49.251963+0000","last_unstale":"2024-04-01T02:12:38.724948+0000","last_undegraded":"2024-04-01T02:12:38.724948+0000","last_fullsized":"2024-04-01T02:12:38.724948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":568,"log_dups_size":0,"ondisk_log_size":568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:56:18.086766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1665465,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":447,"num_write_kb":10082,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"23'994","reported_seq":1020,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:11:32.607321+0000","last_change":"2024-04-01T01:55:48.225858+0000","last_active":"2024-04-01T02:11:32.607321+0000","last_peered":"2024-04-01T02:11:32.607321+0000","last_clean":"2024-04-01T02:11:32.607321+0000","last_became_active":"2024-04-01T01:55:48.224494+0000","last_became_peered":"2024-04-01T01:55:48.224494+0000","last_unstale":"2024-04-01T02:11:32.607321+0000","last_undegraded":"2024-04-01T02:11:32.607321+0000","last_fullsized":"2024-04-01T02:11:32.607321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":994,"log_dups_size":0,"ondisk_log_size":994,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:09:28.276592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389190,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":993,"num_write_kb":8588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":215832773,"num_objects":671,"num_object_clones":0,"num_object_copies":1342,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":671,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26120,"num_write_kb":1144114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":33914880,"data_stored":431659406,"data_compressed":20248526,"data_compressed_allocated":27738112,"data_compressed_original":427758424,"omap_allocated":0,"internal_metadata":0},"log_size":34657,"ondisk_log_size":34657,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":198565071,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":1759,"num_read_kb":2743,"num_write":29695,"num_write_kb":207906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":261308416,"data_stored":397130142,"data_compressed":36932112,"data_compressed_allocated":55713792,"data_compressed_original":191602688,"omap_allocated":0,"internal_metadata":0},"log_size":27939,"ondisk_log_size":27939,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66838,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509648,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":103636,"kb_used_data":23884,"kb_used_omap":1,"kb_used_meta":79742,"kb_avail":94268204,"statfs":{"total":96636764160,"available":96530640896,"internally_reserved":0,"allocated":24457216,"data_stored":69188313,"data_compressed":4487044,"data_compressed_allocated":6590464,"data_compressed_original":51672926,"omap_allocated":1590,"internal_metadata":81656266},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509649,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":119288,"kb_used_data":33968,"kb_used_omap":1,"kb_used_meta":85310,"kb_avail":94252552,"statfs":{"total":96636764160,"available":96514613248,"internally_reserved":0,"allocated":34783232,"data_stored":88936133,"data_compressed":7023647,"data_compressed_allocated":10317824,"data_compressed_original":64849434,"omap_allocated":1595,"internal_metadata":87357893},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509647,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":184280,"kb_used_data":62864,"kb_used_omap":1,"kb_used_meta":121406,"kb_avail":94187560,"statfs":{"total":96636764160,"available":96448061440,"internally_reserved":0,"allocated":64372736,"data_stored":164997377,"data_compressed":11682465,"data_compressed_allocated":17096704,"data_compressed_original":118219990,"omap_allocated":1592,"internal_metadata":124320200},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509648,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":93932,"kb_used_data":26660,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94277908,"statfs":{"total":96636764160,"available":96540577792,"internally_reserved":0,"allocated":27299840,"data_stored":94836675,"data_compressed":5914255,"data_compressed_allocated":8593408,"data_compressed_original":76574396,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509648,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":96400,"kb_used_data":29128,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94275440,"statfs":{"total":96636764160,"available":96538050560,"internally_reserved":0,"allocated":29827072,"data_stored":88082926,"data_compressed":5618475,"data_compressed_allocated":8155136,"data_compressed_original":66844186,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509647,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":161932,"kb_used_data":50244,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":94209908,"statfs":{"total":96636764160,"available":96470945792,"internally_reserved":0,"allocated":51449856,"data_stored":133539293,"data_compressed":9646909,"data_compressed_allocated":14168064,"data_compressed_original":96757598,"omap_allocated":1595,"internal_metadata":114358725},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542351,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":95764,"kb_used_data":24332,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94276076,"statfs":{"total":96636764160,"available":96538701824,"internally_reserved":0,"allocated":24915968,"data_stored":74736278,"data_compressed":5225453,"data_compressed_allocated":7524352,"data_compressed_original":57747294,"omap_allocated":1594,"internal_metadata":73136582},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575056,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":138384,"kb_used_data":39176,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":94233456,"statfs":{"total":96636764160,"available":96495058944,"internally_reserved":0,"allocated":40116224,"data_stored":116325977,"data_compressed":7649228,"data_compressed_allocated":11096064,"data_compressed_original":87842168,"omap_allocated":1595,"internal_metadata":101579205},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33419,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33419,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":46268416,"data_stored":71213780,"data_compressed":6727789,"data_compressed_allocated":10149888,"data_compressed_original":35106816,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":25587712,"data_stored":37748806,"data_compressed":3257537,"data_compressed_allocated":4939776,"data_compressed_original":17104896,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":22360064,"data_stored":33555104,"data_compressed":3040138,"data_compressed_allocated":4640768,"data_compressed_original":15843328,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":58277888,"data_stored":87991522,"data_compressed":8070060,"data_compressed_allocated":12161024,"data_compressed_original":41881600,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":31485952,"data_stored":50332992,"data_compressed":5217803,"data_compressed_allocated":7843840,"data_compressed_original":26705920,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":34701312,"data_stored":51852497,"data_compressed":4625369,"data_compressed_allocated":6967296,"data_compressed_original":24129536,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":21364736,"data_stored":33554432,"data_compressed":3299283,"data_compressed_allocated":4878336,"data_compressed_original":17068032,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":21262336,"data_stored":30881009,"data_compressed":2694133,"data_compressed_allocated":4132864,"data_compressed_original":13762560,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4947968,"data_stored":62241427,"data_compressed":2919120,"data_compressed_allocated":4018176,"data_compressed_original":61650782,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3940352,"data_stored":49659666,"data_compressed":2327519,"data_compressed_allocated":3170304,"data_compressed_original":49165850,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4706304,"data_stored":61197485,"data_compressed":2874117,"data_compressed_allocated":3952640,"data_compressed_original":60731068,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":5861376,"data_stored":76921769,"data_compressed":3612405,"data_compressed_allocated":4935680,"data_compressed_original":76338390,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":3063808,"data_stored":38519055,"data_compressed":1805844,"data_compressed_allocated":2473984,"data_compressed_original":38143514,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":5115904,"data_stored":63799026,"data_compressed":2990440,"data_compressed_allocated":4083712,"data_compressed_original":63139192,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":3317760,"data_stored":41097760,"data_compressed":1926170,"data_compressed_allocated":2646016,"data_compressed_original":40679262,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":2961408,"data_stored":38223218,"data_compressed":1792911,"data_compressed_allocated":2457600,"data_compressed_original":37910366,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-01T02:12:45.588 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-01T02:12:45.588 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-01T02:12:45.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.757+0000 7f1bb8875640 1 Processor -- start 2024-04-01T02:12:45.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.757+0000 7f1bb8875640 1 -- start start 2024-04-01T02:12:45.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.757+0000 7f1bb8875640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1bb40714e0 0x7f1bb40ca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:45.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.757+0000 7f1bb8875640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1bb415d540 0x7f1bb40c3b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:45.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.757+0000 7f1bb8875640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1bb4070b70 con 0x7f1bb4071100 2024-04-01T02:12:45.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.757+0000 7f1bb8875640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f1bb40cb130 con 0x7f1bb415d540 2024-04-01T02:12:45.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.757+0000 7f1bb8875640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f1bb40c8930 con 0x7f1bb40714e0 2024-04-01T02:12:45.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.757+0000 7f1bb2d9d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1bb415d540 0x7f1bb40c3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:45.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.757+0000 7f1bb259c640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f1bb4071100 0x7f1bb40c9990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.50:35940/0 (socket says 172.21.15.50:35940) 2024-04-01T02:12:45.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.757+0000 7f1bb259c640 1 -- 172.21.15.50:0/4094841028 learned_addr learned my addr 172.21.15.50:0/4094841028 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-04-01T02:12:45.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.757+0000 7f1bb1d9b640 1 --2- 172.21.15.50:0/4094841028 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1bb40714e0 0x7f1bb40ca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:45.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.757+0000 7f1bb2d9d640 1 -- 172.21.15.50:0/4094841028 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1bb40714e0 msgr2=0x7f1bb40ca4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T02:12:45.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.757+0000 7f1bb2d9d640 1 --2- 172.21.15.50:0/4094841028 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1bb40714e0 0x7f1bb40ca4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:45.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.757+0000 7f1bb2d9d640 1 -- 172.21.15.50:0/4094841028 >> v1:172.21.15.97:6789/0 conn(0x7f1bb4071100 legacy=0x7f1bb40c9990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:45.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.757+0000 7f1bb2d9d640 1 -- 172.21.15.50:0/4094841028 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bb40cab70 con 0x7f1bb415d540 2024-04-01T02:12:45.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.761+0000 7f1bb2d9d640 1 --2- 172.21.15.50:0/4094841028 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1bb415d540 0x7f1bb40c3b40 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f1bac009d90 tx=0x7f1bac01f150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff1d9fc3675510d5 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:12:45.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.761+0000 7f1bb159a640 1 -- 172.21.15.50:0/4094841028 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bac0b4070 con 0x7f1bb415d540 2024-04-01T02:12:45.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.761+0000 7f1bb159a640 1 -- 172.21.15.50:0/4094841028 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bac0af600 con 0x7f1bb415d540 2024-04-01T02:12:45.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.761+0000 7f1bb159a640 1 -- 172.21.15.50:0/4094841028 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bac0af9d0 con 0x7f1bb415d540 2024-04-01T02:12:45.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.761+0000 7f1bb8875640 1 -- 172.21.15.50:0/4094841028 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1bb415d540 msgr2=0x7f1bb40c3b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:45.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.761+0000 7f1bb8875640 1 --2- 172.21.15.50:0/4094841028 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1bb415d540 0x7f1bb40c3b40 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f1bac009d90 tx=0x7f1bac01f150 comp rx=0 tx=0).stop 2024-04-01T02:12:45.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.761+0000 7f1bb8875640 1 -- 172.21.15.50:0/4094841028 shutdown_connections 2024-04-01T02:12:45.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.761+0000 7f1bb8875640 1 --2- 172.21.15.50:0/4094841028 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1bb415d540 0x7f1bb40c3b40 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:45.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.761+0000 7f1bb8875640 1 --2- 172.21.15.50:0/4094841028 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1bb40714e0 0x7f1bb40ca4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:45.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.761+0000 7f1bb8875640 1 -- 172.21.15.50:0/4094841028 >> 172.21.15.50:0/4094841028 conn(0x7f1bb40675c0 msgr2=0x7f1bb406f5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T02:12:45.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.761+0000 7f1bb8875640 1 -- 172.21.15.50:0/4094841028 shutdown_connections 2024-04-01T02:12:45.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.761+0000 7f1bb8875640 1 -- 172.21.15.50:0/4094841028 wait complete. 2024-04-01T02:12:45.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.761+0000 7f1bb8875640 1 Processor -- start 2024-04-01T02:12:45.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.761+0000 7f1bb8875640 1 -- start start 2024-04-01T02:12:45.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.765+0000 7f1bb8875640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1bb4071100 0x7f1bb40cc470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:45.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.765+0000 7f1bb8875640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1bb40714e0 0x7f1bb41ef550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:45.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.765+0000 7f1bb8875640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1bb415d540 0x7f1bb41e4df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:45.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.765+0000 7f1bb8875640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f1bb40c8eb0 con 0x7f1bb415d540 2024-04-01T02:12:45.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.765+0000 7f1bb8875640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f1bb40c8bd0 con 0x7f1bb40714e0 2024-04-01T02:12:45.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.765+0000 7f1bb8875640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f1bb40c93d0 con 0x7f1bb4071100 2024-04-01T02:12:45.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.765+0000 7f1bb2d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1bb415d540 0x7f1bb41e4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:45.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.765+0000 7f1bb2d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1bb415d540 0x7f1bb41e4df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50838/0 (socket says 172.21.15.50:50838) 2024-04-01T02:12:45.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.765+0000 7f1bb2d9d640 1 -- 172.21.15.50:0/4268601636 learned_addr learned my addr 172.21.15.50:0/4268601636 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T02:12:45.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.765+0000 7f1bb259c640 1 --2- 172.21.15.50:0/4268601636 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1bb4071100 0x7f1bb40cc470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:45.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.765+0000 7f1bb1d9b640 1 --2- 172.21.15.50:0/4268601636 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1bb40714e0 0x7f1bb41ef550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:45.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.765+0000 7f1bb2d9d640 1 -- 172.21.15.50:0/4268601636 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1bb4071100 msgr2=0x7f1bb40cc470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:45.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.765+0000 7f1bb2d9d640 1 --2- 172.21.15.50:0/4268601636 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1bb4071100 0x7f1bb40cc470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:45.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.765+0000 7f1bb2d9d640 1 -- 172.21.15.50:0/4268601636 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1bb40714e0 msgr2=0x7f1bb41ef550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:45.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.765+0000 7f1bb2d9d640 1 --2- 172.21.15.50:0/4268601636 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1bb40714e0 0x7f1bb41ef550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:45.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.765+0000 7f1bb2d9d640 1 -- 172.21.15.50:0/4268601636 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bb41f2b60 con 0x7f1bb415d540 2024-04-01T02:12:45.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.765+0000 7f1bb1d9b640 1 --2- 172.21.15.50:0/4268601636 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1bb40714e0 0x7f1bb41ef550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T02:12:45.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.765+0000 7f1bb259c640 1 --2- 172.21.15.50:0/4268601636 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1bb4071100 0x7f1bb40cc470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T02:12:45.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.765+0000 7f1bb2d9d640 1 --2- 172.21.15.50:0/4268601636 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1bb415d540 0x7f1bb41e4df0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f1bac009d90 tx=0x7f1bac01bef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:12:45.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.765+0000 7f1ba2ffd640 1 -- 172.21.15.50:0/4268601636 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bac0b4040 con 0x7f1bb415d540 2024-04-01T02:12:45.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.765+0000 7f1ba2ffd640 1 -- 172.21.15.50:0/4268601636 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bac0c1070 con 0x7f1bb415d540 2024-04-01T02:12:45.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.765+0000 7f1ba2ffd640 1 -- 172.21.15.50:0/4268601636 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bac009450 con 0x7f1bb415d540 2024-04-01T02:12:45.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.765+0000 7f1bb8875640 1 -- 172.21.15.50:0/4268601636 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bb40c7600 con 0x7f1bb415d540 2024-04-01T02:12:45.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.765+0000 7f1bb8875640 1 -- 172.21.15.50:0/4268601636 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bb41f2dd0 con 0x7f1bb415d540 2024-04-01T02:12:45.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.765+0000 7f1bb8875640 1 -- 172.21.15.50:0/4268601636 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bb4068230 con 0x7f1bb415d540 2024-04-01T02:12:45.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.765+0000 7f1ba2ffd640 1 -- 172.21.15.50:0/4268601636 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 87103+0+0 (secure 0 0 0) 0x7f1bac0ba6b0 con 0x7f1bb415d540 2024-04-01T02:12:45.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.765+0000 7f1ba2ffd640 1 --2- 172.21.15.50:0/4268601636 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f1b94067450 0x7f1b94069910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:45.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.765+0000 7f1ba2ffd640 1 -- 172.21.15.50:0/4268601636 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5738+0+0 (secure 0 0 0) 0x7f1bac123f90 con 0x7f1bb415d540 2024-04-01T02:12:45.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.765+0000 7f1bb259c640 1 --2- 172.21.15.50:0/4268601636 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f1b94067450 0x7f1b94069910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:45.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.769+0000 7f1bb259c640 1 --2- 172.21.15.50:0/4268601636 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f1b94067450 0x7f1b94069910 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1ba4000f70 tx=0x7f1ba4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:12:45.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.769+0000 7f1ba2ffd640 1 -- 172.21.15.50:0/4268601636 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+176632 (secure 0 0 0) 0x7f1bac018cb0 con 0x7f1bb415d540 2024-04-01T02:12:45.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.933+0000 7f1bb8875640 1 -- 172.21.15.50:0/4268601636 --> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1bb40c2880 con 0x7f1b94067450 2024-04-01T02:12:45.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.953+0000 7f1ba2ffd640 1 -- 172.21.15.50:0/4268601636 <== mgr.4103 v2:172.21.15.97:6832/1677467570 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+254883 (secure 0 0 0) 0x7f1bb40c2880 con 0x7f1b94067450 2024-04-01T02:12:45.949 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-01T02:12:45.951 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-04-01T02:12:45.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.953+0000 7f1bb8875640 1 -- 172.21.15.50:0/4268601636 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f1b94067450 msgr2=0x7f1b94069910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:45.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.953+0000 7f1bb8875640 1 --2- 172.21.15.50:0/4268601636 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f1b94067450 0x7f1b94069910 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1ba4000f70 tx=0x7f1ba4009040 comp rx=0 tx=0).stop 2024-04-01T02:12:45.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.953+0000 7f1bb8875640 1 -- 172.21.15.50:0/4268601636 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1bb415d540 msgr2=0x7f1bb41e4df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:45.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.953+0000 7f1bb8875640 1 --2- 172.21.15.50:0/4268601636 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1bb415d540 0x7f1bb41e4df0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f1bac009d90 tx=0x7f1bac01bef0 comp rx=0 tx=0).stop 2024-04-01T02:12:45.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.953+0000 7f1bb8875640 1 -- 172.21.15.50:0/4268601636 shutdown_connections 2024-04-01T02:12:45.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.953+0000 7f1bb8875640 1 --2- 172.21.15.50:0/4268601636 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f1b94067450 0x7f1b94069910 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:45.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.953+0000 7f1bb8875640 1 --2- 172.21.15.50:0/4268601636 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1bb415d540 0x7f1bb41e4df0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:45.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.953+0000 7f1bb8875640 1 --2- 172.21.15.50:0/4268601636 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1bb40714e0 0x7f1bb41ef550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:45.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.953+0000 7f1bb8875640 1 --2- 172.21.15.50:0/4268601636 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1bb4071100 0x7f1bb40cc470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:45.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.953+0000 7f1bb8875640 1 -- 172.21.15.50:0/4268601636 >> 172.21.15.50:0/4268601636 conn(0x7f1bb40675c0 msgr2=0x7f1bb415a800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T02:12:45.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.953+0000 7f1bb8875640 1 -- 172.21.15.50:0/4268601636 shutdown_connections 2024-04-01T02:12:45.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:45.953+0000 7f1bb8875640 1 -- 172.21.15.50:0/4268601636 wait complete. 2024-04-01T02:12:45.968 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":528,"stamp":"2024-04-01T02:12:44.389554+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":414988212,"num_objects":742,"num_object_clones":0,"num_object_copies":1484,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":742,"num_whiteouts":0,"num_read":1875,"num_read_kb":2843,"num_write":55974,"num_write_kb":1354436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":62713,"ondisk_log_size":62713,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":993616,"kb_used_data":290256,"kb_used_omap":12,"kb_used_meta":703283,"kb_avail":753981104,"statfs":{"total":773094113280,"available":772076650496,"internally_reserved":0,"allocated":297222144,"data_stored":830642972,"data_compressed":57247476,"data_compressed_allocated":83542016,"data_compressed_original":620507992,"omap_allocated":12751,"internal_metadata":720162353},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":54,"apply_latency_ms":54,"commit_latency_ns":54000000,"apply_latency_ns":54000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":7294455,"num_objects":-15,"num_object_clones":0,"num_object_copies":-30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-15,"num_whiteouts":0,"num_read":17,"num_read_kb":36,"num_write":1013,"num_write_kb":19068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002985"},"pg_stats":[{"pgid":"3.3f","version":"23'487","reported_seq":511,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.726522+0000","last_change":"2024-04-01T01:55:49.279342+0000","last_active":"2024-04-01T02:12:38.726522+0000","last_peered":"2024-04-01T02:12:38.726522+0000","last_clean":"2024-04-01T02:12:38.726522+0000","last_became_active":"2024-04-01T01:55:49.279011+0000","last_became_peered":"2024-04-01T01:55:49.279011+0000","last_unstale":"2024-04-01T02:12:38.726522+0000","last_undegraded":"2024-04-01T02:12:38.726522+0000","last_fullsized":"2024-04-01T02:12:38.726522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:56:11.350186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4211749,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":345,"num_write_kb":18423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"23'557","reported_seq":581,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.676141+0000","last_change":"2024-04-01T01:55:49.247181+0000","last_active":"2024-04-01T02:12:38.676141+0000","last_peered":"2024-04-01T02:12:38.676141+0000","last_clean":"2024-04-01T02:12:38.676141+0000","last_became_active":"2024-04-01T01:55:49.246660+0000","last_became_peered":"2024-04-01T01:55:49.246660+0000","last_unstale":"2024-04-01T02:12:38.676141+0000","last_undegraded":"2024-04-01T02:12:38.676141+0000","last_fullsized":"2024-04-01T02:12:38.676141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":557,"log_dups_size":0,"ondisk_log_size":557,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:27:12.089520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3694421,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":432,"num_write_kb":10812,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"23'528","reported_seq":552,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.682048+0000","last_change":"2024-04-01T01:55:49.240347+0000","last_active":"2024-04-01T02:12:38.682048+0000","last_peered":"2024-04-01T02:12:38.682048+0000","last_clean":"2024-04-01T02:12:38.682048+0000","last_became_active":"2024-04-01T01:55:49.239904+0000","last_became_peered":"2024-04-01T01:55:49.239904+0000","last_unstale":"2024-04-01T02:12:38.682048+0000","last_undegraded":"2024-04-01T02:12:38.682048+0000","last_fullsized":"2024-04-01T02:12:38.682048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:37:43.280869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5131013,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":399,"num_write_kb":17827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"23'481","reported_seq":505,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.720237+0000","last_change":"2024-04-01T01:55:49.279352+0000","last_active":"2024-04-01T02:12:38.720237+0000","last_peered":"2024-04-01T02:12:38.720237+0000","last_clean":"2024-04-01T02:12:38.720237+0000","last_became_active":"2024-04-01T01:55:49.279041+0000","last_became_peered":"2024-04-01T01:55:49.279041+0000","last_unstale":"2024-04-01T02:12:38.720237+0000","last_undegraded":"2024-04-01T02:12:38.720237+0000","last_fullsized":"2024-04-01T02:12:38.720237+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":481,"log_dups_size":0,"ondisk_log_size":481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:13:13.114168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":658438,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":353,"num_write_kb":8202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"23'578","reported_seq":600,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.731752+0000","last_change":"2024-04-01T01:55:49.246874+0000","last_active":"2024-04-01T02:12:38.731752+0000","last_peered":"2024-04-01T02:12:38.731752+0000","last_clean":"2024-04-01T02:12:38.731752+0000","last_became_active":"2024-04-01T01:55:49.246152+0000","last_became_peered":"2024-04-01T01:55:49.246152+0000","last_unstale":"2024-04-01T02:12:38.731752+0000","last_undegraded":"2024-04-01T02:12:38.731752+0000","last_fullsized":"2024-04-01T02:12:38.731752+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":578,"log_dups_size":0,"ondisk_log_size":578,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:49:04.049108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3987251,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":442,"num_write_kb":11887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"23'477","reported_seq":499,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.714821+0000","last_change":"2024-04-01T01:55:49.254029+0000","last_active":"2024-04-01T02:12:38.714821+0000","last_peered":"2024-04-01T02:12:38.714821+0000","last_clean":"2024-04-01T02:12:38.714821+0000","last_became_active":"2024-04-01T01:55:49.253348+0000","last_became_peered":"2024-04-01T01:55:49.253348+0000","last_unstale":"2024-04-01T02:12:38.714821+0000","last_undegraded":"2024-04-01T02:12:38.714821+0000","last_fullsized":"2024-04-01T02:12:38.714821+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":477,"log_dups_size":0,"ondisk_log_size":477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:33:56.754206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3474466,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":343,"num_write_kb":9649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"23'559","reported_seq":581,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.702161+0000","last_change":"2024-04-01T01:55:49.247604+0000","last_active":"2024-04-01T02:12:38.702161+0000","last_peered":"2024-04-01T02:12:38.702161+0000","last_clean":"2024-04-01T02:12:38.702161+0000","last_became_active":"2024-04-01T01:55:49.247373+0000","last_became_peered":"2024-04-01T01:55:49.247373+0000","last_unstale":"2024-04-01T02:12:38.702161+0000","last_undegraded":"2024-04-01T02:12:38.702161+0000","last_fullsized":"2024-04-01T02:12:38.702161+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":559,"log_dups_size":0,"ondisk_log_size":559,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:13:16.513095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2878976,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":421,"num_write_kb":10504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"23'479","reported_seq":501,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.702730+0000","last_change":"2024-04-01T01:55:49.262994+0000","last_active":"2024-04-01T02:12:38.702730+0000","last_peered":"2024-04-01T02:12:38.702730+0000","last_clean":"2024-04-01T02:12:38.702730+0000","last_became_active":"2024-04-01T01:55:49.262736+0000","last_became_peered":"2024-04-01T01:55:49.262736+0000","last_unstale":"2024-04-01T02:12:38.702730+0000","last_undegraded":"2024-04-01T02:12:38.702730+0000","last_fullsized":"2024-04-01T02:12:38.702730+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":479,"log_dups_size":0,"ondisk_log_size":479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:35:14.625545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3489692,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":346,"num_write_kb":10932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"23'511","reported_seq":533,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.727389+0000","last_change":"2024-04-01T01:55:49.260244+0000","last_active":"2024-04-01T02:12:38.727389+0000","last_peered":"2024-04-01T02:12:38.727389+0000","last_clean":"2024-04-01T02:12:38.727389+0000","last_became_active":"2024-04-01T01:55:49.259745+0000","last_became_peered":"2024-04-01T01:55:49.259745+0000","last_unstale":"2024-04-01T02:12:38.727389+0000","last_undegraded":"2024-04-01T02:12:38.727389+0000","last_fullsized":"2024-04-01T02:12:38.727389+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":511,"log_dups_size":0,"ondisk_log_size":511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:00:34.607980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3721216,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":377,"num_write_kb":13356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"23'490","reported_seq":506,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.726657+0000","last_change":"2024-04-01T01:56:38.229250+0000","last_active":"2024-04-01T02:12:38.726657+0000","last_peered":"2024-04-01T02:12:38.726657+0000","last_clean":"2024-04-01T02:12:38.726657+0000","last_became_active":"2024-04-01T01:56:38.228548+0000","last_became_peered":"2024-04-01T01:56:38.228548+0000","last_unstale":"2024-04-01T02:12:38.726657+0000","last_undegraded":"2024-04-01T02:12:38.726657+0000","last_fullsized":"2024-04-01T02:12:38.726657+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":490,"log_dups_size":0,"ondisk_log_size":490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:15:01.912111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2985236,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":363,"num_write_kb":27800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.35","version":"23'471","reported_seq":493,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.732628+0000","last_change":"2024-04-01T01:55:49.271392+0000","last_active":"2024-04-01T02:12:38.732628+0000","last_peered":"2024-04-01T02:12:38.732628+0000","last_clean":"2024-04-01T02:12:38.732628+0000","last_became_active":"2024-04-01T01:55:49.270877+0000","last_became_peered":"2024-04-01T01:55:49.270877+0000","last_unstale":"2024-04-01T02:12:38.732628+0000","last_undegraded":"2024-04-01T02:12:38.732628+0000","last_fullsized":"2024-04-01T02:12:38.732628+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:44:29.950624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3409567,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":12314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"23'413","reported_seq":435,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.723596+0000","last_change":"2024-04-01T01:55:49.259816+0000","last_active":"2024-04-01T02:12:38.723596+0000","last_peered":"2024-04-01T02:12:38.723596+0000","last_clean":"2024-04-01T02:12:38.723596+0000","last_became_active":"2024-04-01T01:55:49.259193+0000","last_became_peered":"2024-04-01T01:55:49.259193+0000","last_unstale":"2024-04-01T02:12:38.723596+0000","last_undegraded":"2024-04-01T02:12:38.723596+0000","last_fullsized":"2024-04-01T02:12:38.723596+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:48:10.828398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2357039,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":282,"num_write_kb":7635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"23'431","reported_seq":453,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.701034+0000","last_change":"2024-04-01T01:55:49.247878+0000","last_active":"2024-04-01T02:12:38.701034+0000","last_peered":"2024-04-01T02:12:38.701034+0000","last_clean":"2024-04-01T02:12:38.701034+0000","last_became_active":"2024-04-01T01:55:49.247436+0000","last_became_peered":"2024-04-01T01:55:49.247436+0000","last_unstale":"2024-04-01T02:12:38.701034+0000","last_undegraded":"2024-04-01T02:12:38.701034+0000","last_fullsized":"2024-04-01T02:12:38.701034+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:26:09.632757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":608576,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":293,"num_write_kb":6624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"23'521","reported_seq":544,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.672100+0000","last_change":"2024-04-01T01:55:49.246266+0000","last_active":"2024-04-01T02:12:38.672100+0000","last_peered":"2024-04-01T02:12:38.672100+0000","last_clean":"2024-04-01T02:12:38.672100+0000","last_became_active":"2024-04-01T01:55:49.245650+0000","last_became_peered":"2024-04-01T01:55:49.245650+0000","last_unstale":"2024-04-01T02:12:38.672100+0000","last_undegraded":"2024-04-01T02:12:38.672100+0000","last_fullsized":"2024-04-01T02:12:38.672100+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":521,"log_dups_size":0,"ondisk_log_size":521,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:14:32.577522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3014274,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":389,"num_write_kb":12247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"23'508","reported_seq":531,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.702841+0000","last_change":"2024-04-01T01:55:49.248046+0000","last_active":"2024-04-01T02:12:38.702841+0000","last_peered":"2024-04-01T02:12:38.702841+0000","last_clean":"2024-04-01T02:12:38.702841+0000","last_became_active":"2024-04-01T01:55:49.247662+0000","last_became_peered":"2024-04-01T01:55:49.247662+0000","last_unstale":"2024-04-01T02:12:38.702841+0000","last_undegraded":"2024-04-01T02:12:38.702841+0000","last_fullsized":"2024-04-01T02:12:38.702841+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":508,"log_dups_size":0,"ondisk_log_size":508,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:59:26.879090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3985408,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":369,"num_write_kb":15794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"23'682","reported_seq":705,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.721747+0000","last_change":"2024-04-01T01:55:49.269484+0000","last_active":"2024-04-01T02:12:38.721747+0000","last_peered":"2024-04-01T02:12:38.721747+0000","last_clean":"2024-04-01T02:12:38.721747+0000","last_became_active":"2024-04-01T01:55:49.261839+0000","last_became_peered":"2024-04-01T01:55:49.261839+0000","last_unstale":"2024-04-01T02:12:38.721747+0000","last_undegraded":"2024-04-01T02:12:38.721747+0000","last_fullsized":"2024-04-01T02:12:38.721747+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":682,"log_dups_size":0,"ondisk_log_size":682,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:44:29.950624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6390669,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":553,"num_write_kb":46118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"23'595","reported_seq":618,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.734605+0000","last_change":"2024-04-01T01:55:49.276113+0000","last_active":"2024-04-01T02:12:38.734605+0000","last_peered":"2024-04-01T02:12:38.734605+0000","last_clean":"2024-04-01T02:12:38.734605+0000","last_became_active":"2024-04-01T01:55:49.275727+0000","last_became_peered":"2024-04-01T01:55:49.275727+0000","last_unstale":"2024-04-01T02:12:38.734605+0000","last_undegraded":"2024-04-01T02:12:38.734605+0000","last_fullsized":"2024-04-01T02:12:38.734605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":595,"log_dups_size":0,"ondisk_log_size":595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:50:59.209071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1955840,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":457,"num_write_kb":17131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"23'506","reported_seq":529,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.726548+0000","last_change":"2024-04-01T01:55:49.252859+0000","last_active":"2024-04-01T02:12:38.726548+0000","last_peered":"2024-04-01T02:12:38.726548+0000","last_clean":"2024-04-01T02:12:38.726548+0000","last_became_active":"2024-04-01T01:55:49.252553+0000","last_became_peered":"2024-04-01T01:55:49.252553+0000","last_unstale":"2024-04-01T02:12:38.726548+0000","last_undegraded":"2024-04-01T02:12:38.726548+0000","last_fullsized":"2024-04-01T02:12:38.726548+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":506,"log_dups_size":0,"ondisk_log_size":506,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:13:13.114168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5136348,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":357,"num_write_kb":34023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"23'525","reported_seq":548,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.713522+0000","last_change":"2024-04-01T01:55:49.260274+0000","last_active":"2024-04-01T02:12:38.713522+0000","last_peered":"2024-04-01T02:12:38.713522+0000","last_clean":"2024-04-01T02:12:38.713522+0000","last_became_active":"2024-04-01T01:55:49.259935+0000","last_became_peered":"2024-04-01T01:55:49.259935+0000","last_unstale":"2024-04-01T02:12:38.713522+0000","last_undegraded":"2024-04-01T02:12:38.713522+0000","last_fullsized":"2024-04-01T02:12:38.713522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":525,"log_dups_size":0,"ondisk_log_size":525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:24:55.348340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6314527,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":390,"num_write_kb":35275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"23'655","reported_seq":678,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.720819+0000","last_change":"2024-04-01T01:55:49.259523+0000","last_active":"2024-04-01T02:12:38.720819+0000","last_peered":"2024-04-01T02:12:38.720819+0000","last_clean":"2024-04-01T02:12:38.720819+0000","last_became_active":"2024-04-01T01:55:49.258670+0000","last_became_peered":"2024-04-01T01:55:49.258670+0000","last_unstale":"2024-04-01T02:12:38.720819+0000","last_undegraded":"2024-04-01T02:12:38.720819+0000","last_fullsized":"2024-04-01T02:12:38.720819+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":655,"log_dups_size":0,"ondisk_log_size":655,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:08:54.832554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3478562,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":525,"num_write_kb":13686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"23'528","reported_seq":551,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.713062+0000","last_change":"2024-04-01T01:55:49.243824+0000","last_active":"2024-04-01T02:12:38.713062+0000","last_peered":"2024-04-01T02:12:38.713062+0000","last_clean":"2024-04-01T02:12:38.713062+0000","last_became_active":"2024-04-01T01:55:49.243518+0000","last_became_peered":"2024-04-01T01:55:49.243518+0000","last_unstale":"2024-04-01T02:12:38.713062+0000","last_undegraded":"2024-04-01T02:12:38.713062+0000","last_fullsized":"2024-04-01T02:12:38.713062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:24:42.777720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1873749,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":387,"num_write_kb":9989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"23'557","reported_seq":580,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.697153+0000","last_change":"2024-04-01T01:55:49.258207+0000","last_active":"2024-04-01T02:12:38.697153+0000","last_peered":"2024-04-01T02:12:38.697153+0000","last_clean":"2024-04-01T02:12:38.697153+0000","last_became_active":"2024-04-01T01:55:49.257576+0000","last_became_peered":"2024-04-01T01:55:49.257576+0000","last_unstale":"2024-04-01T02:12:38.697153+0000","last_undegraded":"2024-04-01T02:12:38.697153+0000","last_fullsized":"2024-04-01T02:12:38.697153+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":557,"log_dups_size":0,"ondisk_log_size":557,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:13:13.114168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3745621,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":429,"num_write_kb":26683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"23'495","reported_seq":518,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.697781+0000","last_change":"2024-04-01T01:55:49.250832+0000","last_active":"2024-04-01T02:12:38.697781+0000","last_peered":"2024-04-01T02:12:38.697781+0000","last_clean":"2024-04-01T02:12:38.697781+0000","last_became_active":"2024-04-01T01:55:49.250522+0000","last_became_peered":"2024-04-01T01:55:49.250522+0000","last_unstale":"2024-04-01T02:12:38.697781+0000","last_undegraded":"2024-04-01T02:12:38.697781+0000","last_fullsized":"2024-04-01T02:12:38.697781+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:47:04.592262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1694624,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":361,"num_write_kb":9747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"23'519","reported_seq":542,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.712726+0000","last_change":"2024-04-01T01:55:49.270067+0000","last_active":"2024-04-01T02:12:38.712726+0000","last_peered":"2024-04-01T02:12:38.712726+0000","last_clean":"2024-04-01T02:12:38.712726+0000","last_became_active":"2024-04-01T01:55:49.269694+0000","last_became_peered":"2024-04-01T01:55:49.269694+0000","last_unstale":"2024-04-01T02:12:38.712726+0000","last_undegraded":"2024-04-01T02:12:38.712726+0000","last_fullsized":"2024-04-01T02:12:38.712726+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":519,"log_dups_size":0,"ondisk_log_size":519,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:21:46.367144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4783138,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384,"num_write_kb":12273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"23'556","reported_seq":579,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.722272+0000","last_change":"2024-04-01T01:55:49.243460+0000","last_active":"2024-04-01T02:12:38.722272+0000","last_peered":"2024-04-01T02:12:38.722272+0000","last_clean":"2024-04-01T02:12:38.722272+0000","last_became_active":"2024-04-01T01:55:49.243017+0000","last_became_peered":"2024-04-01T01:55:49.243017+0000","last_unstale":"2024-04-01T02:12:38.722272+0000","last_undegraded":"2024-04-01T02:12:38.722272+0000","last_fullsized":"2024-04-01T02:12:38.722272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":556,"log_dups_size":0,"ondisk_log_size":556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:20:18.156798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3977024,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":423,"num_write_kb":11436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"23'580","reported_seq":603,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.740597+0000","last_change":"2024-04-01T01:55:49.280226+0000","last_active":"2024-04-01T02:12:38.740597+0000","last_peered":"2024-04-01T02:12:38.740597+0000","last_clean":"2024-04-01T02:12:38.740597+0000","last_became_active":"2024-04-01T01:55:49.279882+0000","last_became_peered":"2024-04-01T01:55:49.279882+0000","last_unstale":"2024-04-01T02:12:38.740597+0000","last_undegraded":"2024-04-01T02:12:38.740597+0000","last_fullsized":"2024-04-01T02:12:38.740597+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":580,"log_dups_size":0,"ondisk_log_size":580,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:06:48.999905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8142848,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":413,"num_write_kb":37888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"23'766","reported_seq":789,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.659698+0000","last_change":"2024-04-01T01:55:49.249890+0000","last_active":"2024-04-01T02:12:38.659698+0000","last_peered":"2024-04-01T02:12:38.659698+0000","last_clean":"2024-04-01T02:12:38.659698+0000","last_became_active":"2024-04-01T01:55:49.249588+0000","last_became_peered":"2024-04-01T01:55:49.249588+0000","last_unstale":"2024-04-01T02:12:38.659698+0000","last_undegraded":"2024-04-01T02:12:38.659698+0000","last_fullsized":"2024-04-01T02:12:38.659698+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":766,"log_dups_size":0,"ondisk_log_size":766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:02:25.180455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4497408,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":644,"num_write_kb":39031,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"23'440","reported_seq":463,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.674903+0000","last_change":"2024-04-01T01:55:49.254529+0000","last_active":"2024-04-01T02:12:38.674903+0000","last_peered":"2024-04-01T02:12:38.674903+0000","last_clean":"2024-04-01T02:12:38.674903+0000","last_became_active":"2024-04-01T01:55:49.253726+0000","last_became_peered":"2024-04-01T01:55:49.253726+0000","last_unstale":"2024-04-01T02:12:38.674903+0000","last_undegraded":"2024-04-01T02:12:38.674903+0000","last_fullsized":"2024-04-01T02:12:38.674903+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:55:44.175129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2117070,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":308,"num_write_kb":8584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"23'485","reported_seq":509,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.676378+0000","last_change":"2024-04-01T01:55:49.252043+0000","last_active":"2024-04-01T02:12:38.676378+0000","last_peered":"2024-04-01T02:12:38.676378+0000","last_clean":"2024-04-01T02:12:38.676378+0000","last_became_active":"2024-04-01T01:55:49.251760+0000","last_became_peered":"2024-04-01T01:55:49.251760+0000","last_unstale":"2024-04-01T02:12:38.676378+0000","last_undegraded":"2024-04-01T02:12:38.676378+0000","last_fullsized":"2024-04-01T02:12:38.676378+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:12:25.325040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1909794,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":354,"num_write_kb":10727,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"23'882","reported_seq":906,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.722329+0000","last_change":"2024-04-01T01:55:49.270451+0000","last_active":"2024-04-01T02:12:38.722329+0000","last_peered":"2024-04-01T02:12:38.722329+0000","last_clean":"2024-04-01T02:12:38.722329+0000","last_became_active":"2024-04-01T01:55:49.269636+0000","last_became_peered":"2024-04-01T01:55:49.269636+0000","last_unstale":"2024-04-01T02:12:38.722329+0000","last_undegraded":"2024-04-01T02:12:38.722329+0000","last_fullsized":"2024-04-01T02:12:38.722329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":882,"log_dups_size":0,"ondisk_log_size":882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:11:14.234867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6037504,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":748,"num_write_kb":31167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"23'555","reported_seq":579,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.683302+0000","last_change":"2024-04-01T01:55:49.266187+0000","last_active":"2024-04-01T02:12:38.683302+0000","last_peered":"2024-04-01T02:12:38.683302+0000","last_clean":"2024-04-01T02:12:38.683302+0000","last_became_active":"2024-04-01T01:55:49.265946+0000","last_became_peered":"2024-04-01T01:55:49.265946+0000","last_unstale":"2024-04-01T02:12:38.683302+0000","last_undegraded":"2024-04-01T02:12:38.683302+0000","last_fullsized":"2024-04-01T02:12:38.683302+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":555,"log_dups_size":0,"ondisk_log_size":555,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:37:46.890765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4188782,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":415,"num_write_kb":13639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"23'519","reported_seq":543,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.715900+0000","last_change":"2024-04-01T01:55:49.273104+0000","last_active":"2024-04-01T02:12:38.715900+0000","last_peered":"2024-04-01T02:12:38.715900+0000","last_clean":"2024-04-01T02:12:38.715900+0000","last_became_active":"2024-04-01T01:55:49.272742+0000","last_became_peered":"2024-04-01T01:55:49.272742+0000","last_unstale":"2024-04-01T02:12:38.715900+0000","last_undegraded":"2024-04-01T02:12:38.715900+0000","last_fullsized":"2024-04-01T02:12:38.715900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":519,"log_dups_size":0,"ondisk_log_size":519,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:37:46.890765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2869248,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":375,"num_write_kb":19168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"23'536","reported_seq":558,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.691868+0000","last_change":"2024-04-01T01:55:49.241595+0000","last_active":"2024-04-01T02:12:38.691868+0000","last_peered":"2024-04-01T02:12:38.691868+0000","last_clean":"2024-04-01T02:12:38.691868+0000","last_became_active":"2024-04-01T01:55:49.238286+0000","last_became_peered":"2024-04-01T01:55:49.238286+0000","last_unstale":"2024-04-01T02:12:38.691868+0000","last_undegraded":"2024-04-01T02:12:38.691868+0000","last_fullsized":"2024-04-01T02:12:38.691868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":536,"log_dups_size":0,"ondisk_log_size":536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:06:48.999905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6652831,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":403,"num_write_kb":17955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"23'644","reported_seq":668,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:08:21.199984+0000","last_change":"2024-04-01T01:55:48.225145+0000","last_active":"2024-04-01T02:08:21.199984+0000","last_peered":"2024-04-01T02:08:21.199984+0000","last_clean":"2024-04-01T02:08:21.199984+0000","last_became_active":"2024-04-01T01:55:48.224408+0000","last_became_peered":"2024-04-01T01:55:48.224408+0000","last_unstale":"2024-04-01T02:08:21.199984+0000","last_undegraded":"2024-04-01T02:08:21.199984+0000","last_fullsized":"2024-04-01T02:08:21.199984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":644,"log_dups_size":0,"ondisk_log_size":644,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:41:59.465915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":643,"num_write_kb":4346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"23'476","reported_seq":498,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.721153+0000","last_change":"2024-04-01T01:55:49.247771+0000","last_active":"2024-04-01T02:12:38.721153+0000","last_peered":"2024-04-01T02:12:38.721153+0000","last_clean":"2024-04-01T02:12:38.721153+0000","last_became_active":"2024-04-01T01:55:49.247496+0000","last_became_peered":"2024-04-01T01:55:49.247496+0000","last_unstale":"2024-04-01T02:12:38.721153+0000","last_undegraded":"2024-04-01T02:12:38.721153+0000","last_fullsized":"2024-04-01T02:12:38.721153+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":476,"log_dups_size":0,"ondisk_log_size":476,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:02:25.180455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3922463,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":358,"num_write_kb":10126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"23'1916","reported_seq":1940,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.604118+0000","last_change":"2024-04-01T01:55:48.221934+0000","last_active":"2024-04-01T02:12:38.604118+0000","last_peered":"2024-04-01T02:12:38.604118+0000","last_clean":"2024-04-01T02:12:38.604118+0000","last_became_active":"2024-04-01T01:55:48.221614+0000","last_became_peered":"2024-04-01T01:55:48.221614+0000","last_unstale":"2024-04-01T02:12:38.604118+0000","last_undegraded":"2024-04-01T02:12:38.604118+0000","last_fullsized":"2024-04-01T02:12:38.604118+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":1916,"log_dups_size":0,"ondisk_log_size":1916,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:06:47.990123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16687772,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1912,"num_write_kb":17167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"23'393","reported_seq":417,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:10:16.229529+0000","last_change":"2024-04-01T01:55:48.217879+0000","last_active":"2024-04-01T02:10:16.229529+0000","last_peered":"2024-04-01T02:10:16.229529+0000","last_clean":"2024-04-01T02:10:16.229529+0000","last_became_active":"2024-04-01T01:55:48.216141+0000","last_became_peered":"2024-04-01T01:55:48.216141+0000","last_unstale":"2024-04-01T02:10:16.229529+0000","last_undegraded":"2024-04-01T02:10:16.229529+0000","last_fullsized":"2024-04-01T02:10:16.229529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:36:42.625449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":392,"num_write_kb":4245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"23'553","reported_seq":575,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.685589+0000","last_change":"2024-04-01T01:55:49.246424+0000","last_active":"2024-04-01T02:12:38.685589+0000","last_peered":"2024-04-01T02:12:38.685589+0000","last_clean":"2024-04-01T02:12:38.685589+0000","last_became_active":"2024-04-01T01:55:49.243823+0000","last_became_peered":"2024-04-01T01:55:49.243823+0000","last_unstale":"2024-04-01T02:12:38.685589+0000","last_undegraded":"2024-04-01T02:12:38.685589+0000","last_fullsized":"2024-04-01T02:12:38.685589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":553,"log_dups_size":0,"ondisk_log_size":553,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:27:45.663474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3965184,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":412,"num_write_kb":14098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"23'1752","reported_seq":1777,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:11:59.821172+0000","last_change":"2024-04-01T01:55:48.222831+0000","last_active":"2024-04-01T02:11:59.821172+0000","last_peered":"2024-04-01T02:11:59.821172+0000","last_clean":"2024-04-01T02:11:59.821172+0000","last_became_active":"2024-04-01T01:55:48.222535+0000","last_became_peered":"2024-04-01T01:55:48.222535+0000","last_unstale":"2024-04-01T02:11:59.821172+0000","last_undegraded":"2024-04-01T02:11:59.821172+0000","last_fullsized":"2024-04-01T02:11:59.821172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":1752,"log_dups_size":0,"ondisk_log_size":1752,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:49:34.960786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1749,"num_write_kb":12993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"23'533","reported_seq":555,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.685623+0000","last_change":"2024-04-01T01:55:49.231967+0000","last_active":"2024-04-01T02:12:38.685623+0000","last_peered":"2024-04-01T02:12:38.685623+0000","last_clean":"2024-04-01T02:12:38.685623+0000","last_became_active":"2024-04-01T01:55:49.230659+0000","last_became_peered":"2024-04-01T01:55:49.230659+0000","last_unstale":"2024-04-01T02:12:38.685623+0000","last_undegraded":"2024-04-01T02:12:38.685623+0000","last_fullsized":"2024-04-01T02:12:38.685623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":533,"log_dups_size":0,"ondisk_log_size":533,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:57:31.843504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3477908,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":407,"num_write_kb":10690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"23'1","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:10:18.221449+0000","last_change":"2024-04-01T01:55:48.216724+0000","last_active":"2024-04-01T02:10:18.221449+0000","last_peered":"2024-04-01T02:10:18.221449+0000","last_clean":"2024-04-01T02:10:18.221449+0000","last_became_active":"2024-04-01T01:55:48.216318+0000","last_became_peered":"2024-04-01T01:55:48.216318+0000","last_unstale":"2024-04-01T02:10:18.221449+0000","last_undegraded":"2024-04-01T02:10:18.221449+0000","last_fullsized":"2024-04-01T02:10:18.221449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:25:51.219789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"23'551","reported_seq":573,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.741076+0000","last_change":"2024-04-01T01:55:49.280230+0000","last_active":"2024-04-01T02:12:38.741076+0000","last_peered":"2024-04-01T02:12:38.741076+0000","last_clean":"2024-04-01T02:12:38.741076+0000","last_became_active":"2024-04-01T01:55:49.279866+0000","last_became_peered":"2024-04-01T01:55:49.279866+0000","last_unstale":"2024-04-01T02:12:38.741076+0000","last_undegraded":"2024-04-01T02:12:38.741076+0000","last_fullsized":"2024-04-01T02:12:38.741076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":551,"log_dups_size":0,"ondisk_log_size":551,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:00:34.607980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2636189,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":401,"num_write_kb":10506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"23'494","reported_seq":519,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:27.512140+0000","last_change":"2024-04-01T01:55:48.213879+0000","last_active":"2024-04-01T02:12:27.512140+0000","last_peered":"2024-04-01T02:12:27.512140+0000","last_clean":"2024-04-01T02:12:27.512140+0000","last_became_active":"2024-04-01T01:55:48.213610+0000","last_became_peered":"2024-04-01T01:55:48.213610+0000","last_unstale":"2024-04-01T02:12:27.512140+0000","last_undegraded":"2024-04-01T02:12:27.512140+0000","last_fullsized":"2024-04-01T02:12:27.512140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":494,"log_dups_size":0,"ondisk_log_size":494,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:33:55.744424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":490,"num_write_kb":4342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"23'507","reported_seq":529,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.704049+0000","last_change":"2024-04-01T01:55:49.261532+0000","last_active":"2024-04-01T02:12:38.704049+0000","last_peered":"2024-04-01T02:12:38.704049+0000","last_clean":"2024-04-01T02:12:38.704049+0000","last_became_active":"2024-04-01T01:55:49.261260+0000","last_became_peered":"2024-04-01T01:55:49.261260+0000","last_unstale":"2024-04-01T02:12:38.704049+0000","last_undegraded":"2024-04-01T02:12:38.704049+0000","last_fullsized":"2024-04-01T02:12:38.704049+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":507,"log_dups_size":0,"ondisk_log_size":507,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:30:02.149564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2169152,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":377,"num_write_kb":10428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"23'1317","reported_seq":1342,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:37.139675+0000","last_change":"2024-04-01T01:55:48.227054+0000","last_active":"2024-04-01T02:12:37.139675+0000","last_peered":"2024-04-01T02:12:37.139675+0000","last_clean":"2024-04-01T02:12:37.139675+0000","last_became_active":"2024-04-01T01:55:48.226061+0000","last_became_peered":"2024-04-01T01:55:48.226061+0000","last_unstale":"2024-04-01T02:12:37.139675+0000","last_undegraded":"2024-04-01T02:12:37.139675+0000","last_fullsized":"2024-04-01T02:12:37.139675+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":1317,"log_dups_size":0,"ondisk_log_size":1317,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:18:27.840431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1316,"num_write_kb":5169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"23'650","reported_seq":673,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.727577+0000","last_change":"2024-04-01T01:55:49.261662+0000","last_active":"2024-04-01T02:12:38.727577+0000","last_peered":"2024-04-01T02:12:38.727577+0000","last_clean":"2024-04-01T02:12:38.727577+0000","last_became_active":"2024-04-01T01:55:49.261286+0000","last_became_peered":"2024-04-01T01:55:49.261286+0000","last_unstale":"2024-04-01T02:12:38.727577+0000","last_undegraded":"2024-04-01T02:12:38.727577+0000","last_fullsized":"2024-04-01T02:12:38.727577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":650,"log_dups_size":0,"ondisk_log_size":650,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:56:11.350186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3031627,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":532,"num_write_kb":22303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"23'1654","reported_seq":1679,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:23.004257+0000","last_change":"2024-04-01T01:55:48.219739+0000","last_active":"2024-04-01T02:12:23.004257+0000","last_peered":"2024-04-01T02:12:23.004257+0000","last_clean":"2024-04-01T02:12:23.004257+0000","last_became_active":"2024-04-01T01:55:48.219107+0000","last_became_peered":"2024-04-01T01:55:48.219107+0000","last_unstale":"2024-04-01T02:12:23.004257+0000","last_undegraded":"2024-04-01T02:12:23.004257+0000","last_fullsized":"2024-04-01T02:12:23.004257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":1654,"log_dups_size":0,"ondisk_log_size":1654,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:14:12.790111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1651,"num_write_kb":13025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"23'479","reported_seq":501,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.717152+0000","last_change":"2024-04-01T01:55:49.255056+0000","last_active":"2024-04-01T02:12:38.717152+0000","last_peered":"2024-04-01T02:12:38.717152+0000","last_clean":"2024-04-01T02:12:38.717152+0000","last_became_active":"2024-04-01T01:55:49.247910+0000","last_became_peered":"2024-04-01T01:55:49.247910+0000","last_unstale":"2024-04-01T02:12:38.717152+0000","last_undegraded":"2024-04-01T02:12:38.717152+0000","last_fullsized":"2024-04-01T02:12:38.717152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":479,"log_dups_size":0,"ondisk_log_size":479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T13:02:55.577616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3214612,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":324,"num_write_kb":15075,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"23'1306","reported_seq":1331,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:09:48.210530+0000","last_change":"2024-04-01T01:55:48.215613+0000","last_active":"2024-04-01T02:09:48.210530+0000","last_peered":"2024-04-01T02:09:48.210530+0000","last_clean":"2024-04-01T02:09:48.210530+0000","last_became_active":"2024-04-01T01:55:48.214669+0000","last_became_peered":"2024-04-01T01:55:48.214669+0000","last_unstale":"2024-04-01T02:09:48.210530+0000","last_undegraded":"2024-04-01T02:09:48.210530+0000","last_fullsized":"2024-04-01T02:09:48.210530+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":1306,"log_dups_size":0,"ondisk_log_size":1306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:25:51.219789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1305,"num_write_kb":8736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"23'502","reported_seq":525,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.703951+0000","last_change":"2024-04-01T01:55:49.270153+0000","last_active":"2024-04-01T02:12:38.703951+0000","last_peered":"2024-04-01T02:12:38.703951+0000","last_clean":"2024-04-01T02:12:38.703951+0000","last_became_active":"2024-04-01T01:55:49.269840+0000","last_became_peered":"2024-04-01T01:55:49.269840+0000","last_unstale":"2024-04-01T02:12:38.703951+0000","last_undegraded":"2024-04-01T02:12:38.703951+0000","last_fullsized":"2024-04-01T02:12:38.703951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":502,"log_dups_size":0,"ondisk_log_size":502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:00:34.607980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2873887,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":372,"num_write_kb":10690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:09:48.231670+0000","last_change":"2024-04-01T01:55:48.214783+0000","last_active":"2024-04-01T02:09:48.231670+0000","last_peered":"2024-04-01T02:09:48.231670+0000","last_clean":"2024-04-01T02:09:48.231670+0000","last_became_active":"2024-04-01T01:55:48.213463+0000","last_became_peered":"2024-04-01T01:55:48.213463+0000","last_unstale":"2024-04-01T02:09:48.231670+0000","last_undegraded":"2024-04-01T02:09:48.231670+0000","last_fullsized":"2024-04-01T02:09:48.231670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:00:33.598198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"23'694","reported_seq":717,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.732478+0000","last_change":"2024-04-01T01:55:49.274841+0000","last_active":"2024-04-01T02:12:38.732478+0000","last_peered":"2024-04-01T02:12:38.732478+0000","last_clean":"2024-04-01T02:12:38.732478+0000","last_became_active":"2024-04-01T01:55:49.274430+0000","last_became_peered":"2024-04-01T01:55:49.274430+0000","last_unstale":"2024-04-01T02:12:38.732478+0000","last_undegraded":"2024-04-01T02:12:38.732478+0000","last_fullsized":"2024-04-01T02:12:38.732478+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":694,"log_dups_size":0,"ondisk_log_size":694,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T13:25:36.254927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1869911,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":559,"num_write_kb":109429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:09:48.233532+0000","last_change":"2024-04-01T01:55:48.210944+0000","last_active":"2024-04-01T02:09:48.233532+0000","last_peered":"2024-04-01T02:09:48.233532+0000","last_clean":"2024-04-01T02:09:48.233532+0000","last_became_active":"2024-04-01T01:55:48.210616+0000","last_became_peered":"2024-04-01T01:55:48.210616+0000","last_unstale":"2024-04-01T02:09:48.233532+0000","last_undegraded":"2024-04-01T02:09:48.233532+0000","last_fullsized":"2024-04-01T02:09:48.233532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:38:32.247471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"23'514","reported_seq":537,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.691443+0000","last_change":"2024-04-01T01:55:49.239528+0000","last_active":"2024-04-01T02:12:38.691443+0000","last_peered":"2024-04-01T02:12:38.691443+0000","last_clean":"2024-04-01T02:12:38.691443+0000","last_became_active":"2024-04-01T01:55:49.238805+0000","last_became_peered":"2024-04-01T01:55:49.238805+0000","last_unstale":"2024-04-01T02:12:38.691443+0000","last_undegraded":"2024-04-01T02:12:38.691443+0000","last_fullsized":"2024-04-01T02:12:38.691443+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":514,"log_dups_size":0,"ondisk_log_size":514,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:37:46.890765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1821215,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":368,"num_write_kb":8386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"23'816","reported_seq":841,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:11:05.530786+0000","last_change":"2024-04-01T01:55:48.211677+0000","last_active":"2024-04-01T02:11:05.530786+0000","last_peered":"2024-04-01T02:11:05.530786+0000","last_clean":"2024-04-01T02:11:05.530786+0000","last_became_active":"2024-04-01T01:55:48.210893+0000","last_became_peered":"2024-04-01T01:55:48.210893+0000","last_unstale":"2024-04-01T02:11:05.530786+0000","last_undegraded":"2024-04-01T02:11:05.530786+0000","last_fullsized":"2024-04-01T02:11:05.530786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:04:19.568533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":818,"num_write_kb":8585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"23'607","reported_seq":630,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.717565+0000","last_change":"2024-04-01T01:55:49.261872+0000","last_active":"2024-04-01T02:12:38.717565+0000","last_peered":"2024-04-01T02:12:38.717565+0000","last_clean":"2024-04-01T02:12:38.717565+0000","last_became_active":"2024-04-01T01:55:49.261517+0000","last_became_peered":"2024-04-01T01:55:49.261517+0000","last_unstale":"2024-04-01T02:12:38.717565+0000","last_undegraded":"2024-04-01T02:12:38.717565+0000","last_fullsized":"2024-04-01T02:12:38.717565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":607,"log_dups_size":0,"ondisk_log_size":607,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T13:02:55.577616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5805184,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":464,"num_write_kb":32813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"23'422","reported_seq":447,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:09:43.759499+0000","last_change":"2024-04-01T01:55:48.198687+0000","last_active":"2024-04-01T02:09:43.759499+0000","last_peered":"2024-04-01T02:09:43.759499+0000","last_clean":"2024-04-01T02:09:43.759499+0000","last_became_active":"2024-04-01T01:55:48.198319+0000","last_became_peered":"2024-04-01T01:55:48.198319+0000","last_unstale":"2024-04-01T02:09:43.759499+0000","last_undegraded":"2024-04-01T02:09:43.759499+0000","last_fullsized":"2024-04-01T02:09:43.759499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:37:45.880984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":421,"num_write_kb":4293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"23'517","reported_seq":540,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.738045+0000","last_change":"2024-04-01T01:55:49.272424+0000","last_active":"2024-04-01T02:12:38.738045+0000","last_peered":"2024-04-01T02:12:38.738045+0000","last_clean":"2024-04-01T02:12:38.738045+0000","last_became_active":"2024-04-01T01:55:49.265670+0000","last_became_peered":"2024-04-01T01:55:49.265670+0000","last_unstale":"2024-04-01T02:12:38.738045+0000","last_undegraded":"2024-04-01T02:12:38.738045+0000","last_fullsized":"2024-04-01T02:12:38.738045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":517,"log_dups_size":0,"ondisk_log_size":517,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:26:09.632757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4958208,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":395,"num_write_kb":11184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"23'500","reported_seq":525,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:09:22.676923+0000","last_change":"2024-04-01T01:55:48.219312+0000","last_active":"2024-04-01T02:09:22.676923+0000","last_peered":"2024-04-01T02:09:22.676923+0000","last_clean":"2024-04-01T02:09:22.676923+0000","last_became_active":"2024-04-01T01:55:48.218562+0000","last_became_peered":"2024-04-01T01:55:48.218562+0000","last_unstale":"2024-04-01T02:09:22.676923+0000","last_undegraded":"2024-04-01T02:09:22.676923+0000","last_fullsized":"2024-04-01T02:09:22.676923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":500,"log_dups_size":0,"ondisk_log_size":500,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:38:32.247471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":500,"num_write_kb":4281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"23'489","reported_seq":512,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.733305+0000","last_change":"2024-04-01T01:55:49.268041+0000","last_active":"2024-04-01T02:12:38.733305+0000","last_peered":"2024-04-01T02:12:38.733305+0000","last_clean":"2024-04-01T02:12:38.733305+0000","last_became_active":"2024-04-01T01:55:49.267502+0000","last_became_peered":"2024-04-01T01:55:49.267502+0000","last_unstale":"2024-04-01T02:12:38.733305+0000","last_undegraded":"2024-04-01T02:12:38.733305+0000","last_fullsized":"2024-04-01T02:12:38.733305+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":489,"log_dups_size":0,"ondisk_log_size":489,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:21:46.367144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2609152,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":355,"num_write_kb":9167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"23'652","reported_seq":677,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:09:21.209057+0000","last_change":"2024-04-01T01:55:48.216662+0000","last_active":"2024-04-01T02:09:21.209057+0000","last_peered":"2024-04-01T02:09:21.209057+0000","last_clean":"2024-04-01T02:09:21.209057+0000","last_became_active":"2024-04-01T01:55:48.215852+0000","last_became_peered":"2024-04-01T01:55:48.215852+0000","last_unstale":"2024-04-01T02:09:21.209057+0000","last_undegraded":"2024-04-01T02:09:21.209057+0000","last_fullsized":"2024-04-01T02:09:21.209057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":652,"log_dups_size":0,"ondisk_log_size":652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:25:39.713293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":651,"num_write_kb":4358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"23'532","reported_seq":555,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.706848+0000","last_change":"2024-04-01T01:55:49.256142+0000","last_active":"2024-04-01T02:12:38.706848+0000","last_peered":"2024-04-01T02:12:38.706848+0000","last_clean":"2024-04-01T02:12:38.706848+0000","last_became_active":"2024-04-01T01:55:49.255781+0000","last_became_peered":"2024-04-01T01:55:49.255781+0000","last_unstale":"2024-04-01T02:12:38.706848+0000","last_undegraded":"2024-04-01T02:12:38.706848+0000","last_fullsized":"2024-04-01T02:12:38.706848+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":532,"log_dups_size":0,"ondisk_log_size":532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:10:23.571126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3486100,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384,"num_write_kb":10452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"23'482","reported_seq":507,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:07.732858+0000","last_change":"2024-04-01T01:55:48.219851+0000","last_active":"2024-04-01T02:12:07.732858+0000","last_peered":"2024-04-01T02:12:07.732858+0000","last_clean":"2024-04-01T02:12:07.732858+0000","last_became_active":"2024-04-01T01:55:48.215898+0000","last_became_peered":"2024-04-01T01:55:48.215898+0000","last_unstale":"2024-04-01T02:12:07.732858+0000","last_undegraded":"2024-04-01T02:12:07.732858+0000","last_fullsized":"2024-04-01T02:12:07.732858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:18:27.840431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":481,"num_write_kb":4326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"23'543","reported_seq":566,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.725313+0000","last_change":"2024-04-01T01:55:49.275452+0000","last_active":"2024-04-01T02:12:38.725313+0000","last_peered":"2024-04-01T02:12:38.725313+0000","last_clean":"2024-04-01T02:12:38.725313+0000","last_became_active":"2024-04-01T01:55:49.274600+0000","last_became_peered":"2024-04-01T01:55:49.274600+0000","last_unstale":"2024-04-01T02:12:38.725313+0000","last_undegraded":"2024-04-01T02:12:38.725313+0000","last_fullsized":"2024-04-01T02:12:38.725313+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":543,"log_dups_size":0,"ondisk_log_size":543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:19:24.052574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3740270,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":421,"num_write_kb":13583,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":182,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:09:43.218713+0000","last_change":"2024-04-01T01:55:43.145201+0000","last_active":"2024-04-01T02:09:43.218713+0000","last_peered":"2024-04-01T02:09:43.218713+0000","last_clean":"2024-04-01T02:09:43.218713+0000","last_became_active":"2024-04-01T01:55:43.144882+0000","last_became_peered":"2024-04-01T01:55:43.144882+0000","last_unstale":"2024-04-01T02:09:43.218713+0000","last_undegraded":"2024-04-01T02:09:43.218713+0000","last_fullsized":"2024-04-01T02:09:43.218713+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:42.134502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:42.134502+0000","last_clean_scrub_stamp":"2024-04-01T01:55:42.134502+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:02:26.589535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"23'539","reported_seq":565,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:11:39.852771+0000","last_change":"2024-04-01T01:55:48.207222+0000","last_active":"2024-04-01T02:11:39.852771+0000","last_peered":"2024-04-01T02:11:39.852771+0000","last_clean":"2024-04-01T02:11:39.852771+0000","last_became_active":"2024-04-01T01:55:48.206293+0000","last_became_peered":"2024-04-01T01:55:48.206293+0000","last_unstale":"2024-04-01T02:11:39.852771+0000","last_undegraded":"2024-04-01T02:11:39.852771+0000","last_fullsized":"2024-04-01T02:11:39.852771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":539,"log_dups_size":0,"ondisk_log_size":539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:37:45.880984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":538,"num_write_kb":4366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"23'475","reported_seq":499,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.699425+0000","last_change":"2024-04-01T01:55:49.273517+0000","last_active":"2024-04-01T02:12:38.699425+0000","last_peered":"2024-04-01T02:12:38.699425+0000","last_clean":"2024-04-01T02:12:38.699425+0000","last_became_active":"2024-04-01T01:55:49.273197+0000","last_became_peered":"2024-04-01T01:55:49.273197+0000","last_unstale":"2024-04-01T02:12:38.699425+0000","last_undegraded":"2024-04-01T02:12:38.699425+0000","last_fullsized":"2024-04-01T02:12:38.699425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:14:32.577522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2100352,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":362,"num_write_kb":7512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"23'1724","reported_seq":1750,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:11:27.553670+0000","last_change":"2024-04-01T01:55:48.214341+0000","last_active":"2024-04-01T02:11:27.553670+0000","last_peered":"2024-04-01T02:11:27.553670+0000","last_clean":"2024-04-01T02:11:27.553670+0000","last_became_active":"2024-04-01T01:55:48.213914+0000","last_became_peered":"2024-04-01T01:55:48.213914+0000","last_unstale":"2024-04-01T02:11:27.553670+0000","last_undegraded":"2024-04-01T02:11:27.553670+0000","last_fullsized":"2024-04-01T02:11:27.553670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":1724,"log_dups_size":0,"ondisk_log_size":1724,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:09:28.276592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1721,"num_write_kb":12994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"23'521","reported_seq":545,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.699651+0000","last_change":"2024-04-01T01:55:49.272106+0000","last_active":"2024-04-01T02:12:38.699651+0000","last_peered":"2024-04-01T02:12:38.699651+0000","last_clean":"2024-04-01T02:12:38.699651+0000","last_became_active":"2024-04-01T01:55:49.271821+0000","last_became_peered":"2024-04-01T01:55:49.271821+0000","last_unstale":"2024-04-01T02:12:38.699651+0000","last_undegraded":"2024-04-01T02:12:38.699651+0000","last_fullsized":"2024-04-01T02:12:38.699651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":521,"log_dups_size":0,"ondisk_log_size":521,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T13:22:31.821166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2398580,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":392,"num_write_kb":9213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"23'1760","reported_seq":3545,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:37.134355+0000","last_change":"2024-04-01T01:55:48.218296+0000","last_active":"2024-04-01T02:12:37.134355+0000","last_peered":"2024-04-01T02:12:37.134355+0000","last_clean":"2024-04-01T02:12:37.134355+0000","last_became_active":"2024-04-01T01:55:48.217516+0000","last_became_peered":"2024-04-01T01:55:48.217516+0000","last_unstale":"2024-04-01T02:12:37.134355+0000","last_undegraded":"2024-04-01T02:12:37.134355+0000","last_fullsized":"2024-04-01T02:12:37.134355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":1760,"log_dups_size":0,"ondisk_log_size":1760,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:36:42.625449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1520757,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1759,"num_read_kb":2743,"num_write":1759,"num_write_kb":2743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"23'578","reported_seq":602,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.683159+0000","last_change":"2024-04-01T01:55:49.246734+0000","last_active":"2024-04-01T02:12:38.683159+0000","last_peered":"2024-04-01T02:12:38.683159+0000","last_clean":"2024-04-01T02:12:38.683159+0000","last_became_active":"2024-04-01T01:55:49.246152+0000","last_became_peered":"2024-04-01T01:55:49.246152+0000","last_unstale":"2024-04-01T02:12:38.683159+0000","last_undegraded":"2024-04-01T02:12:38.683159+0000","last_fullsized":"2024-04-01T02:12:38.683159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":578,"log_dups_size":0,"ondisk_log_size":578,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:52:34.992185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4683946,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":447,"num_write_kb":12840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"23'1294","reported_seq":1320,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:10:23.234493+0000","last_change":"2024-04-01T01:55:48.222956+0000","last_active":"2024-04-01T02:10:23.234493+0000","last_peered":"2024-04-01T02:10:23.234493+0000","last_clean":"2024-04-01T02:10:23.234493+0000","last_became_active":"2024-04-01T01:55:48.222414+0000","last_became_peered":"2024-04-01T01:55:48.222414+0000","last_unstale":"2024-04-01T02:10:23.234493+0000","last_undegraded":"2024-04-01T02:10:23.234493+0000","last_fullsized":"2024-04-01T02:10:23.234493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":1294,"log_dups_size":0,"ondisk_log_size":1294,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:26:08.622975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1292,"num_write_kb":8711,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"23'509","reported_seq":533,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.733441+0000","last_change":"2024-04-01T01:55:49.247633+0000","last_active":"2024-04-01T02:12:38.733441+0000","last_peered":"2024-04-01T02:12:38.733441+0000","last_clean":"2024-04-01T02:12:38.733441+0000","last_became_active":"2024-04-01T01:55:49.247285+0000","last_became_peered":"2024-04-01T01:55:49.247285+0000","last_unstale":"2024-04-01T02:12:38.733441+0000","last_undegraded":"2024-04-01T02:12:38.733441+0000","last_fullsized":"2024-04-01T02:12:38.733441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":509,"log_dups_size":0,"ondisk_log_size":509,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:15:01.912111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1905973,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":374,"num_write_kb":9925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"23'411","reported_seq":437,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:11:49.203845+0000","last_change":"2024-04-01T01:55:48.226323+0000","last_active":"2024-04-01T02:11:49.203845+0000","last_peered":"2024-04-01T02:11:49.203845+0000","last_clean":"2024-04-01T02:11:49.203845+0000","last_became_active":"2024-04-01T01:55:48.225487+0000","last_became_peered":"2024-04-01T01:55:48.225487+0000","last_unstale":"2024-04-01T02:11:49.203845+0000","last_undegraded":"2024-04-01T02:11:49.203845+0000","last_fullsized":"2024-04-01T02:11:49.203845+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:13:17.832963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":410,"num_write_kb":4283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"23'561","reported_seq":585,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.695026+0000","last_change":"2024-04-01T01:55:49.265542+0000","last_active":"2024-04-01T02:12:38.695026+0000","last_peered":"2024-04-01T02:12:38.695026+0000","last_clean":"2024-04-01T02:12:38.695026+0000","last_became_active":"2024-04-01T01:55:49.264914+0000","last_became_peered":"2024-04-01T01:55:49.264914+0000","last_unstale":"2024-04-01T02:12:38.695026+0000","last_undegraded":"2024-04-01T02:12:38.695026+0000","last_fullsized":"2024-04-01T02:12:38.695026+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":561,"log_dups_size":0,"ondisk_log_size":561,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:55:44.175129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3471816,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":416,"num_write_kb":10624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"23'809","reported_seq":835,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:11:54.724715+0000","last_change":"2024-04-01T01:55:48.227292+0000","last_active":"2024-04-01T02:11:54.724715+0000","last_peered":"2024-04-01T02:11:54.724715+0000","last_clean":"2024-04-01T02:11:54.724715+0000","last_became_active":"2024-04-01T01:55:48.226948+0000","last_became_peered":"2024-04-01T01:55:48.226948+0000","last_unstale":"2024-04-01T02:11:54.724715+0000","last_undegraded":"2024-04-01T02:11:54.724715+0000","last_fullsized":"2024-04-01T02:11:54.724715+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":809,"log_dups_size":0,"ondisk_log_size":809,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:55:43.165347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":807,"num_write_kb":8573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"23'580","reported_seq":604,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.666892+0000","last_change":"2024-04-01T01:55:49.244171+0000","last_active":"2024-04-01T02:12:38.666892+0000","last_peered":"2024-04-01T02:12:38.666892+0000","last_clean":"2024-04-01T02:12:38.666892+0000","last_became_active":"2024-04-01T01:55:49.241632+0000","last_became_peered":"2024-04-01T01:55:49.241632+0000","last_unstale":"2024-04-01T02:12:38.666892+0000","last_undegraded":"2024-04-01T02:12:38.666892+0000","last_fullsized":"2024-04-01T02:12:38.666892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":580,"log_dups_size":0,"ondisk_log_size":580,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:24:42.777720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1649698,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":453,"num_write_kb":12096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"23'923","reported_seq":948,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.128694+0000","last_change":"2024-04-01T01:55:48.204432+0000","last_active":"2024-04-01T02:12:38.128694+0000","last_peered":"2024-04-01T02:12:38.128694+0000","last_clean":"2024-04-01T02:12:38.128694+0000","last_became_active":"2024-04-01T01:55:48.203576+0000","last_became_peered":"2024-04-01T01:55:48.203576+0000","last_unstale":"2024-04-01T02:12:38.128694+0000","last_undegraded":"2024-04-01T02:12:38.128694+0000","last_fullsized":"2024-04-01T02:12:38.128694+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":923,"log_dups_size":0,"ondisk_log_size":923,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:49:34.960786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2724,"num_write_kb":1428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"23'518","reported_seq":541,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.675180+0000","last_change":"2024-04-01T01:55:49.244993+0000","last_active":"2024-04-01T02:12:38.675180+0000","last_peered":"2024-04-01T02:12:38.675180+0000","last_clean":"2024-04-01T02:12:38.675180+0000","last_became_active":"2024-04-01T01:55:49.244632+0000","last_became_peered":"2024-04-01T01:55:49.244632+0000","last_unstale":"2024-04-01T02:12:38.675180+0000","last_undegraded":"2024-04-01T02:12:38.675180+0000","last_fullsized":"2024-04-01T02:12:38.675180+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":518,"log_dups_size":0,"ondisk_log_size":518,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:30:26.148968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2231074,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":416,"num_write_kb":11781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"23'451","reported_seq":476,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:11:20.248134+0000","last_change":"2024-04-01T01:55:48.221282+0000","last_active":"2024-04-01T02:11:20.248134+0000","last_peered":"2024-04-01T02:11:20.248134+0000","last_clean":"2024-04-01T02:11:20.248134+0000","last_became_active":"2024-04-01T01:55:48.220889+0000","last_became_peered":"2024-04-01T01:55:48.220889+0000","last_unstale":"2024-04-01T02:11:20.248134+0000","last_undegraded":"2024-04-01T02:11:20.248134+0000","last_fullsized":"2024-04-01T02:11:20.248134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:13:12.104386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":451,"num_write_kb":4303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"23'576","reported_seq":599,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.681858+0000","last_change":"2024-04-01T01:55:49.251927+0000","last_active":"2024-04-01T02:12:38.681858+0000","last_peered":"2024-04-01T02:12:38.681858+0000","last_clean":"2024-04-01T02:12:38.681858+0000","last_became_active":"2024-04-01T01:55:49.251641+0000","last_became_peered":"2024-04-01T01:55:49.251641+0000","last_unstale":"2024-04-01T02:12:38.681858+0000","last_undegraded":"2024-04-01T02:12:38.681858+0000","last_fullsized":"2024-04-01T02:12:38.681858+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T13:22:31.821166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1372160,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":436,"num_write_kb":14438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"23'656","reported_seq":681,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:08:48.226321+0000","last_change":"2024-04-01T01:55:48.204161+0000","last_active":"2024-04-01T02:08:48.226321+0000","last_peered":"2024-04-01T02:08:48.226321+0000","last_clean":"2024-04-01T02:08:48.226321+0000","last_became_active":"2024-04-01T01:55:48.203828+0000","last_became_peered":"2024-04-01T01:55:48.203828+0000","last_unstale":"2024-04-01T02:08:48.226321+0000","last_undegraded":"2024-04-01T02:08:48.226321+0000","last_fullsized":"2024-04-01T02:08:48.226321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":656,"log_dups_size":0,"ondisk_log_size":656,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:04:19.568533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":655,"num_write_kb":4360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"23'536","reported_seq":559,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:35.139930+0000","last_change":"2024-04-01T01:55:49.259699+0000","last_active":"2024-04-01T02:12:35.139930+0000","last_peered":"2024-04-01T02:12:35.139930+0000","last_clean":"2024-04-01T02:12:35.139930+0000","last_became_active":"2024-04-01T01:55:49.259332+0000","last_became_peered":"2024-04-01T01:55:49.259332+0000","last_unstale":"2024-04-01T02:12:35.139930+0000","last_undegraded":"2024-04-01T02:12:35.139930+0000","last_fullsized":"2024-04-01T02:12:35.139930+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":536,"log_dups_size":0,"ondisk_log_size":536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:02:41.829474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2628206,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":12728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"23'521","reported_seq":546,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:11:11.799786+0000","last_change":"2024-04-01T01:55:48.206742+0000","last_active":"2024-04-01T02:11:11.799786+0000","last_peered":"2024-04-01T02:11:11.799786+0000","last_clean":"2024-04-01T02:11:11.799786+0000","last_became_active":"2024-04-01T01:55:48.206027+0000","last_became_peered":"2024-04-01T01:55:48.206027+0000","last_unstale":"2024-04-01T02:11:11.799786+0000","last_undegraded":"2024-04-01T02:11:11.799786+0000","last_fullsized":"2024-04-01T02:11:11.799786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":521,"log_dups_size":0,"ondisk_log_size":521,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:18:27.840431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":520,"num_write_kb":4323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"23'492","reported_seq":515,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.675506+0000","last_change":"2024-04-01T01:55:49.246379+0000","last_active":"2024-04-01T02:12:38.675506+0000","last_peered":"2024-04-01T02:12:38.675506+0000","last_clean":"2024-04-01T02:12:38.675506+0000","last_became_active":"2024-04-01T01:55:49.245774+0000","last_became_peered":"2024-04-01T01:55:49.245774+0000","last_unstale":"2024-04-01T02:12:38.675506+0000","last_undegraded":"2024-04-01T02:12:38.675506+0000","last_fullsized":"2024-04-01T02:12:38.675506+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":492,"log_dups_size":0,"ondisk_log_size":492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:25:48.896071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2457258,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":347,"num_write_kb":7703,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"23'731","reported_seq":756,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:21.550193+0000","last_change":"2024-04-01T01:55:48.222218+0000","last_active":"2024-04-01T02:12:21.550193+0000","last_peered":"2024-04-01T02:12:21.550193+0000","last_clean":"2024-04-01T02:12:21.550193+0000","last_became_active":"2024-04-01T01:55:48.221148+0000","last_became_peered":"2024-04-01T01:55:48.221148+0000","last_unstale":"2024-04-01T02:12:21.550193+0000","last_undegraded":"2024-04-01T02:12:21.550193+0000","last_fullsized":"2024-04-01T02:12:21.550193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":731,"log_dups_size":0,"ondisk_log_size":731,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:25:51.219789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":729,"num_write_kb":8526,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"23'573","reported_seq":596,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.673104+0000","last_change":"2024-04-01T01:55:49.249648+0000","last_active":"2024-04-01T02:12:38.673104+0000","last_peered":"2024-04-01T02:12:38.673104+0000","last_clean":"2024-04-01T02:12:38.673104+0000","last_became_active":"2024-04-01T01:55:49.248925+0000","last_became_peered":"2024-04-01T01:55:49.248925+0000","last_unstale":"2024-04-01T02:12:38.673104+0000","last_undegraded":"2024-04-01T02:12:38.673104+0000","last_fullsized":"2024-04-01T02:12:38.673104+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":573,"log_dups_size":0,"ondisk_log_size":573,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:33:56.754206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4491912,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":426,"num_write_kb":28953,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"23'1469","reported_seq":1494,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:16.455768+0000","last_change":"2024-04-01T01:55:48.207522+0000","last_active":"2024-04-01T02:12:16.455768+0000","last_peered":"2024-04-01T02:12:16.455768+0000","last_clean":"2024-04-01T02:12:16.455768+0000","last_became_active":"2024-04-01T01:55:48.206856+0000","last_became_peered":"2024-04-01T01:55:48.206856+0000","last_unstale":"2024-04-01T02:12:16.455768+0000","last_undegraded":"2024-04-01T02:12:16.455768+0000","last_fullsized":"2024-04-01T02:12:16.455768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":1469,"log_dups_size":0,"ondisk_log_size":1469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:33:55.744424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1465,"num_write_kb":12919,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"23'559","reported_seq":582,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.722571+0000","last_change":"2024-04-01T01:55:49.274489+0000","last_active":"2024-04-01T02:12:38.722571+0000","last_peered":"2024-04-01T02:12:38.722571+0000","last_clean":"2024-04-01T02:12:38.722571+0000","last_became_active":"2024-04-01T01:55:49.270254+0000","last_became_peered":"2024-04-01T01:55:49.270254+0000","last_unstale":"2024-04-01T02:12:38.722571+0000","last_undegraded":"2024-04-01T02:12:38.722571+0000","last_fullsized":"2024-04-01T02:12:38.722571+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":559,"log_dups_size":0,"ondisk_log_size":559,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T13:09:00.491227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5269504,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":425,"num_write_kb":26844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"23'507","reported_seq":529,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.733757+0000","last_change":"2024-04-01T01:55:49.275782+0000","last_active":"2024-04-01T02:12:38.733757+0000","last_peered":"2024-04-01T02:12:38.733757+0000","last_clean":"2024-04-01T02:12:38.733757+0000","last_became_active":"2024-04-01T01:55:49.275050+0000","last_became_peered":"2024-04-01T01:55:49.275050+0000","last_unstale":"2024-04-01T02:12:38.733757+0000","last_undegraded":"2024-04-01T02:12:38.733757+0000","last_fullsized":"2024-04-01T02:12:38.733757+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":507,"log_dups_size":0,"ondisk_log_size":507,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:26:15.406856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1932316,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":383,"num_write_kb":9512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"23'404","reported_seq":428,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:09:28.169392+0000","last_change":"2024-04-01T01:55:48.223704+0000","last_active":"2024-04-01T02:09:28.169392+0000","last_peered":"2024-04-01T02:09:28.169392+0000","last_clean":"2024-04-01T02:09:28.169392+0000","last_became_active":"2024-04-01T01:55:48.223220+0000","last_became_peered":"2024-04-01T01:55:48.223220+0000","last_unstale":"2024-04-01T02:09:28.169392+0000","last_undegraded":"2024-04-01T02:09:28.169392+0000","last_fullsized":"2024-04-01T02:09:28.169392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:49:34.960786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":404,"num_write_kb":4216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"23'478","reported_seq":500,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.712722+0000","last_change":"2024-04-01T01:55:49.264857+0000","last_active":"2024-04-01T02:12:38.712722+0000","last_peered":"2024-04-01T02:12:38.712722+0000","last_clean":"2024-04-01T02:12:38.712722+0000","last_became_active":"2024-04-01T01:55:49.258478+0000","last_became_peered":"2024-04-01T01:55:49.258478+0000","last_unstale":"2024-04-01T02:12:38.712722+0000","last_undegraded":"2024-04-01T02:12:38.712722+0000","last_fullsized":"2024-04-01T02:12:38.712722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":478,"log_dups_size":0,"ondisk_log_size":478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:33:56.754206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2118876,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":354,"num_write_kb":10865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"23'1762","reported_seq":1786,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:10:48.103318+0000","last_change":"2024-04-01T01:55:48.218370+0000","last_active":"2024-04-01T02:10:48.103318+0000","last_peered":"2024-04-01T02:10:48.103318+0000","last_clean":"2024-04-01T02:10:48.103318+0000","last_became_active":"2024-04-01T01:55:48.217755+0000","last_became_peered":"2024-04-01T01:55:48.217755+0000","last_unstale":"2024-04-01T02:10:48.103318+0000","last_undegraded":"2024-04-01T02:10:48.103318+0000","last_fullsized":"2024-04-01T02:10:48.103318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":1762,"log_dups_size":0,"ondisk_log_size":1762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:09:28.276592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1758,"num_write_kb":13032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"23'607","reported_seq":631,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.722636+0000","last_change":"2024-04-01T01:55:49.243377+0000","last_active":"2024-04-01T02:12:38.722636+0000","last_peered":"2024-04-01T02:12:38.722636+0000","last_clean":"2024-04-01T02:12:38.722636+0000","last_became_active":"2024-04-01T01:55:49.242851+0000","last_became_peered":"2024-04-01T01:55:49.242851+0000","last_unstale":"2024-04-01T02:12:38.722636+0000","last_undegraded":"2024-04-01T02:12:38.722636+0000","last_fullsized":"2024-04-01T02:12:38.722636+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":607,"log_dups_size":0,"ondisk_log_size":607,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:48:38.596647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2501666,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":481,"num_write_kb":61542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"23'1142","reported_seq":1168,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:27.519474+0000","last_change":"2024-04-01T01:55:48.213862+0000","last_active":"2024-04-01T02:12:27.519474+0000","last_peered":"2024-04-01T02:12:27.519474+0000","last_clean":"2024-04-01T02:12:27.519474+0000","last_became_active":"2024-04-01T01:55:48.213122+0000","last_became_peered":"2024-04-01T01:55:48.213122+0000","last_unstale":"2024-04-01T02:12:27.519474+0000","last_undegraded":"2024-04-01T02:12:27.519474+0000","last_fullsized":"2024-04-01T02:12:27.519474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":1142,"log_dups_size":0,"ondisk_log_size":1142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:59:23.563864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1140,"num_write_kb":8675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"23'568","reported_seq":592,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.724948+0000","last_change":"2024-04-01T01:55:49.252273+0000","last_active":"2024-04-01T02:12:38.724948+0000","last_peered":"2024-04-01T02:12:38.724948+0000","last_clean":"2024-04-01T02:12:38.724948+0000","last_became_active":"2024-04-01T01:55:49.251963+0000","last_became_peered":"2024-04-01T01:55:49.251963+0000","last_unstale":"2024-04-01T02:12:38.724948+0000","last_undegraded":"2024-04-01T02:12:38.724948+0000","last_fullsized":"2024-04-01T02:12:38.724948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":568,"log_dups_size":0,"ondisk_log_size":568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:56:18.086766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1665465,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":447,"num_write_kb":10082,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"23'994","reported_seq":1020,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:11:32.607321+0000","last_change":"2024-04-01T01:55:48.225858+0000","last_active":"2024-04-01T02:11:32.607321+0000","last_peered":"2024-04-01T02:11:32.607321+0000","last_clean":"2024-04-01T02:11:32.607321+0000","last_became_active":"2024-04-01T01:55:48.224494+0000","last_became_peered":"2024-04-01T01:55:48.224494+0000","last_unstale":"2024-04-01T02:11:32.607321+0000","last_undegraded":"2024-04-01T02:11:32.607321+0000","last_fullsized":"2024-04-01T02:11:32.607321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":994,"log_dups_size":0,"ondisk_log_size":994,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:09:28.276592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389190,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":993,"num_write_kb":8588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":215832773,"num_objects":671,"num_object_clones":0,"num_object_copies":1342,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":671,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26120,"num_write_kb":1144114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":33914880,"data_stored":431659406,"data_compressed":20248526,"data_compressed_allocated":27738112,"data_compressed_original":427758424,"omap_allocated":0,"internal_metadata":0},"log_size":34657,"ondisk_log_size":34657,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":198565071,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":1759,"num_read_kb":2743,"num_write":29695,"num_write_kb":207906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":261308416,"data_stored":397130142,"data_compressed":36932112,"data_compressed_allocated":55713792,"data_compressed_original":191602688,"omap_allocated":0,"internal_metadata":0},"log_size":27939,"ondisk_log_size":27939,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66838,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509648,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":103636,"kb_used_data":23884,"kb_used_omap":1,"kb_used_meta":79742,"kb_avail":94268204,"statfs":{"total":96636764160,"available":96530640896,"internally_reserved":0,"allocated":24457216,"data_stored":69188313,"data_compressed":4487044,"data_compressed_allocated":6590464,"data_compressed_original":51672926,"omap_allocated":1590,"internal_metadata":81656266},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509649,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":119288,"kb_used_data":33968,"kb_used_omap":1,"kb_used_meta":85310,"kb_avail":94252552,"statfs":{"total":96636764160,"available":96514613248,"internally_reserved":0,"allocated":34783232,"data_stored":88936133,"data_compressed":7023647,"data_compressed_allocated":10317824,"data_compressed_original":64849434,"omap_allocated":1595,"internal_metadata":87357893},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509647,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":184280,"kb_used_data":62864,"kb_used_omap":1,"kb_used_meta":121406,"kb_avail":94187560,"statfs":{"total":96636764160,"available":96448061440,"internally_reserved":0,"allocated":64372736,"data_stored":164997377,"data_compressed":11682465,"data_compressed_allocated":17096704,"data_compressed_original":118219990,"omap_allocated":1592,"internal_metadata":124320200},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509648,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":93932,"kb_used_data":26660,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94277908,"statfs":{"total":96636764160,"available":96540577792,"internally_reserved":0,"allocated":27299840,"data_stored":94836675,"data_compressed":5914255,"data_compressed_allocated":8593408,"data_compressed_original":76574396,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509648,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":96400,"kb_used_data":29128,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94275440,"statfs":{"total":96636764160,"available":96538050560,"internally_reserved":0,"allocated":29827072,"data_stored":88082926,"data_compressed":5618475,"data_compressed_allocated":8155136,"data_compressed_original":66844186,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509647,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":161932,"kb_used_data":50244,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":94209908,"statfs":{"total":96636764160,"available":96470945792,"internally_reserved":0,"allocated":51449856,"data_stored":133539293,"data_compressed":9646909,"data_compressed_allocated":14168064,"data_compressed_original":96757598,"omap_allocated":1595,"internal_metadata":114358725},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542351,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":95764,"kb_used_data":24332,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94276076,"statfs":{"total":96636764160,"available":96538701824,"internally_reserved":0,"allocated":24915968,"data_stored":74736278,"data_compressed":5225453,"data_compressed_allocated":7524352,"data_compressed_original":57747294,"omap_allocated":1594,"internal_metadata":73136582},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575056,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":138384,"kb_used_data":39176,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":94233456,"statfs":{"total":96636764160,"available":96495058944,"internally_reserved":0,"allocated":40116224,"data_stored":116325977,"data_compressed":7649228,"data_compressed_allocated":11096064,"data_compressed_original":87842168,"omap_allocated":1595,"internal_metadata":101579205},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33419,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33419,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":46268416,"data_stored":71213780,"data_compressed":6727789,"data_compressed_allocated":10149888,"data_compressed_original":35106816,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":25587712,"data_stored":37748806,"data_compressed":3257537,"data_compressed_allocated":4939776,"data_compressed_original":17104896,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":22360064,"data_stored":33555104,"data_compressed":3040138,"data_compressed_allocated":4640768,"data_compressed_original":15843328,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":58277888,"data_stored":87991522,"data_compressed":8070060,"data_compressed_allocated":12161024,"data_compressed_original":41881600,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":31485952,"data_stored":50332992,"data_compressed":5217803,"data_compressed_allocated":7843840,"data_compressed_original":26705920,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":34701312,"data_stored":51852497,"data_compressed":4625369,"data_compressed_allocated":6967296,"data_compressed_original":24129536,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":21364736,"data_stored":33554432,"data_compressed":3299283,"data_compressed_allocated":4878336,"data_compressed_original":17068032,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":21262336,"data_stored":30881009,"data_compressed":2694133,"data_compressed_allocated":4132864,"data_compressed_original":13762560,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4947968,"data_stored":62241427,"data_compressed":2919120,"data_compressed_allocated":4018176,"data_compressed_original":61650782,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3940352,"data_stored":49659666,"data_compressed":2327519,"data_compressed_allocated":3170304,"data_compressed_original":49165850,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4706304,"data_stored":61197485,"data_compressed":2874117,"data_compressed_allocated":3952640,"data_compressed_original":60731068,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":5861376,"data_stored":76921769,"data_compressed":3612405,"data_compressed_allocated":4935680,"data_compressed_original":76338390,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":3063808,"data_stored":38519055,"data_compressed":1805844,"data_compressed_allocated":2473984,"data_compressed_original":38143514,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":5115904,"data_stored":63799026,"data_compressed":2990440,"data_compressed_allocated":4083712,"data_compressed_original":63139192,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":3317760,"data_stored":41097760,"data_compressed":1926170,"data_compressed_allocated":2646016,"data_compressed_original":40679262,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":2961408,"data_stored":38223218,"data_compressed":1792911,"data_compressed_allocated":2457600,"data_compressed_original":37910366,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-01T02:12:45.972 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-01T02:12:46.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:46.137+0000 7f51d2d04640 1 Processor -- start 2024-04-01T02:12:46.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:46.137+0000 7f51d2d04640 1 -- start start 2024-04-01T02:12:46.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:46.141+0000 7f51d2d04640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f51cc0c7850 0x7f51cc163570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:46.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:46.141+0000 7f51d2d04640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51cc0c30d0 con 0x7f51cc151de0 2024-04-01T02:12:46.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:46.141+0000 7f51d2d04640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51cc15b370 con 0x7f51cc0c2900 2024-04-01T02:12:46.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:46.141+0000 7f51d2d04640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f51cc15c0f0 con 0x7f51cc0c7850 2024-04-01T02:12:46.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:46.141+0000 7f51d12a1640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f51cc0c7850 0x7f51cc163570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:46.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:46.141+0000 7f51d0aa0640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f51cc151de0 0x7f51cc157be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:33706/0 (socket says 172.21.15.50:33706) 2024-04-01T02:12:46.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:46.141+0000 7f51d0aa0640 1 -- 172.21.15.50:0/3469240076 learned_addr learned my addr 172.21.15.50:0/3469240076 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-04-01T02:12:46.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:46.141+0000 7f51d12a1640 1 -- 172.21.15.50:0/3469240076 >> v1:172.21.15.97:6789/0 conn(0x7f51cc0c2900 legacy=0x7f51cc0c5f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:46.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:46.141+0000 7f51d12a1640 1 -- 172.21.15.50:0/3469240076 >> v1:172.21.15.50:6789/0 conn(0x7f51cc151de0 legacy=0x7f51cc157be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:46.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:46.141+0000 7f51cb7fe640 1 -- 172.21.15.50:0/3469240076 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2428006476 0 0) 0x7f51cc0c30d0 con 0x7f51cc151de0 2024-04-01T02:12:46.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:46.141+0000 7f51d12a1640 1 -- 172.21.15.50:0/3469240076 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51cc0c2df0 con 0x7f51cc0c7850 2024-04-01T02:12:46.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:46.141+0000 7f51d12a1640 1 --2- 172.21.15.50:0/3469240076 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51cc0c7850 0x7f51cc163570 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f51c4009d90 tx=0x7f51c401c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6c64df50f3a549d server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:12:46.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:46.141+0000 7f51cb7fe640 1 -- 172.21.15.50:0/3469240076 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51c40b2070 con 0x7f51cc0c7850 2024-04-01T02:12:46.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:46.141+0000 7f51cb7fe640 1 -- 172.21.15.50:0/3469240076 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51c40a5830 con 0x7f51cc0c7850 2024-04-01T02:12:46.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:46.141+0000 7f51cb7fe640 1 -- 172.21.15.50:0/3469240076 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51c40a5c00 con 0x7f51cc0c7850 2024-04-01T02:12:46.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:46.141+0000 7f51d2d04640 1 -- 172.21.15.50:0/3469240076 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51cc0c7850 msgr2=0x7f51cc163570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:46.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:46.141+0000 7f51d2d04640 1 --2- 172.21.15.50:0/3469240076 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51cc0c7850 0x7f51cc163570 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f51c4009d90 tx=0x7f51c401c970 comp rx=0 tx=0).stop 2024-04-01T02:12:46.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:46.141+0000 7f51d2d04640 1 -- 172.21.15.50:0/3469240076 shutdown_connections 2024-04-01T02:12:46.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:46.141+0000 7f51d2d04640 1 --2- 172.21.15.50:0/3469240076 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51cc0c7850 0x7f51cc163570 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:46.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:46.141+0000 7f51d2d04640 1 -- 172.21.15.50:0/3469240076 >> 172.21.15.50:0/3469240076 conn(0x7f51cc067560 msgr2=0x7f51cc06b220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T02:12:46.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:46.141+0000 7f51d2d04640 1 -- 172.21.15.50:0/3469240076 shutdown_connections 2024-04-01T02:12:46.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:46.141+0000 7f51d2d04640 1 -- 172.21.15.50:0/3469240076 wait complete. 2024-04-01T02:12:46.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:46.145+0000 7f51d2d04640 1 Processor -- start 2024-04-01T02:12:46.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:46.145+0000 7f51d2d04640 1 -- start start 2024-04-01T02:12:46.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:46.145+0000 7f51d2d04640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f51cc0c2900 0x7f51cc1f3620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:46.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:46.145+0000 7f51d2d04640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51cc0c7850 0x7f51cc13ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:46.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:46.145+0000 7f51d2d04640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f51cc151de0 0x7f51cc158da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:46.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:46.145+0000 7f51d2d04640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f51cc0c88a0 con 0x7f51cc0c7850 2024-04-01T02:12:46.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:46.145+0000 7f51d2d04640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f51cc1582f0 con 0x7f51cc0c2900 2024-04-01T02:12:46.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:46.145+0000 7f51d2d04640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f51cc0c8a20 con 0x7f51cc151de0 2024-04-01T02:12:46.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:46.145+0000 7f51cbfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51cc0c7850 0x7f51cc13ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:46.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:46.145+0000 7f51cbfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51cc0c7850 0x7f51cc13ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50854/0 (socket says 172.21.15.50:50854) 2024-04-01T02:12:46.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:46.145+0000 7f51cbfff640 1 -- 172.21.15.50:0/3761022701 learned_addr learned my addr 172.21.15.50:0/3761022701 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T02:12:46.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:46.145+0000 7f51d0aa0640 1 --2- 172.21.15.50:0/3761022701 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f51cc0c2900 0x7f51cc1f3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:46.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:46.145+0000 7f51d12a1640 1 --2- 172.21.15.50:0/3761022701 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f51cc151de0 0x7f51cc158da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:46.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:46.145+0000 7f51cbfff640 1 -- 172.21.15.50:0/3761022701 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f51cc151de0 msgr2=0x7f51cc158da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:46.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:46.145+0000 7f51cbfff640 1 --2- 172.21.15.50:0/3761022701 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f51cc151de0 0x7f51cc158da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:46.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:46.145+0000 7f51cbfff640 1 -- 172.21.15.50:0/3761022701 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f51cc0c2900 msgr2=0x7f51cc1f3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:46.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:46.145+0000 7f51cbfff640 1 --2- 172.21.15.50:0/3761022701 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f51cc0c2900 0x7f51cc1f3620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:46.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:46.145+0000 7f51cbfff640 1 -- 172.21.15.50:0/3761022701 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51cc1592e0 con 0x7f51cc0c7850 2024-04-01T02:12:46.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:46.145+0000 7f51cbfff640 1 --2- 172.21.15.50:0/3761022701 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51cc0c7850 0x7f51cc13ef10 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f51c000c3c0 tx=0x7f51c000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:12:46.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:46.145+0000 7f51c97fa640 1 -- 172.21.15.50:0/3761022701 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51c0017070 con 0x7f51cc0c7850 2024-04-01T02:12:46.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:46.145+0000 7f51c97fa640 1 -- 172.21.15.50:0/3761022701 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51c00052d0 con 0x7f51cc0c7850 2024-04-01T02:12:46.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:46.145+0000 7f51d2d04640 1 -- 172.21.15.50:0/3761022701 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51cc159550 con 0x7f51cc0c7850 2024-04-01T02:12:46.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:46.145+0000 7f51c97fa640 1 -- 172.21.15.50:0/3761022701 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51c0003840 con 0x7f51cc0c7850 2024-04-01T02:12:46.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:46.145+0000 7f51d2d04640 1 -- 172.21.15.50:0/3761022701 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51cc159b10 con 0x7f51cc0c7850 2024-04-01T02:12:46.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:46.145+0000 7f51d2d04640 1 -- 172.21.15.50:0/3761022701 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51cc068230 con 0x7f51cc0c7850 2024-04-01T02:12:46.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:46.145+0000 7f51c97fa640 1 -- 172.21.15.50:0/3761022701 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 87103+0+0 (secure 0 0 0) 0x7f51c001a070 con 0x7f51cc0c7850 2024-04-01T02:12:46.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:46.149+0000 7f51c97fa640 1 --2- 172.21.15.50:0/3761022701 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f51b8067420 0x7f51b80698e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:46.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:46.149+0000 7f51c97fa640 1 -- 172.21.15.50:0/3761022701 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5738+0+0 (secure 0 0 0) 0x7f51c0084b30 con 0x7f51cc0c7850 2024-04-01T02:12:46.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:46.149+0000 7f51d0aa0640 1 --2- 172.21.15.50:0/3761022701 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f51b8067420 0x7f51b80698e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:46.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:46.149+0000 7f51d0aa0640 1 --2- 172.21.15.50:0/3761022701 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f51b8067420 0x7f51b80698e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f51bc007fd0 tx=0x7f51bc007ba0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:12:46.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:46.153+0000 7f51c97fa640 1 -- 172.21.15.50:0/3761022701 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+176632 (secure 0 0 0) 0x7f51c0005480 con 0x7f51cc0c7850 2024-04-01T02:12:46.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:46.309+0000 7f51d2d04640 1 -- 172.21.15.50:0/3761022701 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f51cc157ae0 con 0x7f51cc0c7850 2024-04-01T02:12:46.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:46.309+0000 7f51c97fa640 1 -- 172.21.15.50:0/3761022701 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16574 (secure 0 0 0) 0x7f51c0055780 con 0x7f51cc0c7850 2024-04-01T02:12:46.308 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-01T02:12:46.308 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":23,"fsid":"f67878a9-bc75-426b-962d-fa7bc2517f7d","created":"2024-04-01T01:55:31.562371+0000","modified":"2024-04-01T01:56:37.409424+0000","last_up_change":"2024-04-01T01:55:42.134502+0000","last_in_change":"2024-04-01T01:55:33.849789+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-01T01:55:42.134418+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-01T01:55:47.009880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-01T01:55:47.551516+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"81e8ca4f-bde8-419a-875f-73a1f4a641ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":4170468134},{"type":"v1","addr":"172.21.15.50:6825","nonce":4170468134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":4170468134},{"type":"v1","addr":"172.21.15.50:6827","nonce":4170468134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":4170468134},{"type":"v1","addr":"172.21.15.50:6831","nonce":4170468134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":4170468134},{"type":"v1","addr":"172.21.15.50:6829","nonce":4170468134}]},"public_addr":"172.21.15.50:6825/4170468134","cluster_addr":"172.21.15.50:6827/4170468134","heartbeat_back_addr":"172.21.15.50:6831/4170468134","heartbeat_front_addr":"172.21.15.50:6829/4170468134","state":["exists","up"]},{"osd":1,"uuid":"bd060ca0-7559-4d30-987c-62e59818431d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1794491326},{"type":"v1","addr":"172.21.15.50:6809","nonce":1794491326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1794491326},{"type":"v1","addr":"172.21.15.50:6811","nonce":1794491326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1794491326},{"type":"v1","addr":"172.21.15.50:6815","nonce":1794491326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1794491326},{"type":"v1","addr":"172.21.15.50:6813","nonce":1794491326}]},"public_addr":"172.21.15.50:6809/1794491326","cluster_addr":"172.21.15.50:6811/1794491326","heartbeat_back_addr":"172.21.15.50:6815/1794491326","heartbeat_front_addr":"172.21.15.50:6813/1794491326","state":["exists","up"]},{"osd":2,"uuid":"eac5d816-a281-4acd-aa7d-b96a8e0aa962","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":710247177},{"type":"v1","addr":"172.21.15.50:6801","nonce":710247177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":710247177},{"type":"v1","addr":"172.21.15.50:6803","nonce":710247177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":710247177},{"type":"v1","addr":"172.21.15.50:6807","nonce":710247177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":710247177},{"type":"v1","addr":"172.21.15.50:6805","nonce":710247177}]},"public_addr":"172.21.15.50:6801/710247177","cluster_addr":"172.21.15.50:6803/710247177","heartbeat_back_addr":"172.21.15.50:6807/710247177","heartbeat_front_addr":"172.21.15.50:6805/710247177","state":["exists","up"]},{"osd":3,"uuid":"12b23968-04a7-40b8-98c4-02b16ae28265","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":871680805},{"type":"v1","addr":"172.21.15.50:6817","nonce":871680805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":871680805},{"type":"v1","addr":"172.21.15.50:6819","nonce":871680805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":871680805},{"type":"v1","addr":"172.21.15.50:6823","nonce":871680805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":871680805},{"type":"v1","addr":"172.21.15.50:6821","nonce":871680805}]},"public_addr":"172.21.15.50:6817/871680805","cluster_addr":"172.21.15.50:6819/871680805","heartbeat_back_addr":"172.21.15.50:6823/871680805","heartbeat_front_addr":"172.21.15.50:6821/871680805","state":["exists","up"]},{"osd":4,"uuid":"0e6b1639-23b0-47d9-8b08-40c8ab6df818","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":1095319381},{"type":"v1","addr":"172.21.15.97:6801","nonce":1095319381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":1095319381},{"type":"v1","addr":"172.21.15.97:6803","nonce":1095319381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":1095319381},{"type":"v1","addr":"172.21.15.97:6807","nonce":1095319381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":1095319381},{"type":"v1","addr":"172.21.15.97:6805","nonce":1095319381}]},"public_addr":"172.21.15.97:6801/1095319381","cluster_addr":"172.21.15.97:6803/1095319381","heartbeat_back_addr":"172.21.15.97:6807/1095319381","heartbeat_front_addr":"172.21.15.97:6805/1095319381","state":["exists","up"]},{"osd":5,"uuid":"f0f876ef-0823-46e9-8fe4-9b7a64a94cee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":899031308},{"type":"v1","addr":"172.21.15.97:6817","nonce":899031308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":899031308},{"type":"v1","addr":"172.21.15.97:6819","nonce":899031308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":899031308},{"type":"v1","addr":"172.21.15.97:6823","nonce":899031308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":899031308},{"type":"v1","addr":"172.21.15.97:6821","nonce":899031308}]},"public_addr":"172.21.15.97:6817/899031308","cluster_addr":"172.21.15.97:6819/899031308","heartbeat_back_addr":"172.21.15.97:6823/899031308","heartbeat_front_addr":"172.21.15.97:6821/899031308","state":["exists","up"]},{"osd":6,"uuid":"d29a625e-83bf-40ef-a57e-618220b96b9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2224814961},{"type":"v1","addr":"172.21.15.97:6825","nonce":2224814961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2224814961},{"type":"v1","addr":"172.21.15.97:6827","nonce":2224814961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2224814961},{"type":"v1","addr":"172.21.15.97:6831","nonce":2224814961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2224814961},{"type":"v1","addr":"172.21.15.97:6829","nonce":2224814961}]},"public_addr":"172.21.15.97:6825/2224814961","cluster_addr":"172.21.15.97:6827/2224814961","heartbeat_back_addr":"172.21.15.97:6831/2224814961","heartbeat_front_addr":"172.21.15.97:6829/2224814961","state":["exists","up"]},{"osd":7,"uuid":"7bcfd8f1-7dc0-4013-af17-16da5a8d931d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":284968823},{"type":"v1","addr":"172.21.15.97:6809","nonce":284968823}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":284968823},{"type":"v1","addr":"172.21.15.97:6811","nonce":284968823}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6814","nonce":284968823},{"type":"v1","addr":"172.21.15.97:6815","nonce":284968823}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":284968823},{"type":"v1","addr":"172.21.15.97:6813","nonce":284968823}]},"public_addr":"172.21.15.97:6809/284968823","cluster_addr":"172.21.15.97:6811/284968823","heartbeat_back_addr":"172.21.15.97:6815/284968823","heartbeat_front_addr":"172.21.15.97:6813/284968823","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T01:55:39.369550+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T01:55:39.367285+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T01:55:39.458393+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T01:55:39.456179+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T01:55:39.463649+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T01:55:38.728924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T01:55:39.522411+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T01:55:39.432081+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.36","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-01T02:12:46.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:46.313+0000 7f51d2d04640 1 -- 172.21.15.50:0/3761022701 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f51b8067420 msgr2=0x7f51b80698e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:46.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:46.313+0000 7f51d2d04640 1 --2- 172.21.15.50:0/3761022701 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f51b8067420 0x7f51b80698e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f51bc007fd0 tx=0x7f51bc007ba0 comp rx=0 tx=0).stop 2024-04-01T02:12:46.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:46.313+0000 7f51d2d04640 1 -- 172.21.15.50:0/3761022701 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51cc0c7850 msgr2=0x7f51cc13ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:46.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:46.313+0000 7f51d2d04640 1 --2- 172.21.15.50:0/3761022701 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51cc0c7850 0x7f51cc13ef10 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f51c000c3c0 tx=0x7f51c000c880 comp rx=0 tx=0).stop 2024-04-01T02:12:46.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:46.313+0000 7f51d2d04640 1 -- 172.21.15.50:0/3761022701 shutdown_connections 2024-04-01T02:12:46.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:46.313+0000 7f51d2d04640 1 --2- 172.21.15.50:0/3761022701 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f51b8067420 0x7f51b80698e0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:46.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:46.313+0000 7f51d2d04640 1 --2- 172.21.15.50:0/3761022701 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f51cc151de0 0x7f51cc158da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:46.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:46.313+0000 7f51d2d04640 1 --2- 172.21.15.50:0/3761022701 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51cc0c7850 0x7f51cc13ef10 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:46.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:46.313+0000 7f51d2d04640 1 --2- 172.21.15.50:0/3761022701 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f51cc0c2900 0x7f51cc1f3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:46.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:46.313+0000 7f51d2d04640 1 -- 172.21.15.50:0/3761022701 >> 172.21.15.50:0/3761022701 conn(0x7f51cc067560 msgr2=0x7f51cc14eba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T02:12:46.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:46.313+0000 7f51d2d04640 1 -- 172.21.15.50:0/3761022701 shutdown_connections 2024-04-01T02:12:46.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:46.313+0000 7f51d2d04640 1 -- 172.21.15.50:0/3761022701 wait complete. 2024-04-01T02:12:47.327 INFO:tasks.ceph:Scrubbing osd.0 2024-04-01T02:12:47.327 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-01T02:12:47.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.469+0000 7f22576b3640 1 Processor -- start 2024-04-01T02:12:47.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.469+0000 7f22576b3640 1 -- start start 2024-04-01T02:12:47.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.473+0000 7f22576b3640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f22500c54b0 0x7f225006c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:47.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.473+0000 7f22576b3640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f22500c9fd0 0x7f225006b540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:47.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.473+0000 7f22576b3640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f225015ab20 con 0x7f2250154070 2024-04-01T02:12:47.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.473+0000 7f22576b3640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f2250067c70 con 0x7f22500c9fd0 2024-04-01T02:12:47.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.473+0000 7f22576b3640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f22500ca480 con 0x7f22500c54b0 2024-04-01T02:12:47.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.473+0000 7f2255c50640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f22500c9fd0 0x7f225006b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:47.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.473+0000 7f225544f640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f2250154070 0x7f22500cae40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.50:35962/0 (socket says 172.21.15.50:35962) 2024-04-01T02:12:47.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.473+0000 7f225544f640 1 -- 172.21.15.50:0/1214878094 learned_addr learned my addr 172.21.15.50:0/1214878094 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-04-01T02:12:47.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.473+0000 7f2254c4e640 1 --2- 172.21.15.50:0/1214878094 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f22500c54b0 0x7f225006c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:47.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.473+0000 7f2255c50640 1 -- 172.21.15.50:0/1214878094 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f22500c54b0 msgr2=0x7f225006c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T02:12:47.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.473+0000 7f2255c50640 1 --2- 172.21.15.50:0/1214878094 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f22500c54b0 0x7f225006c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:47.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.473+0000 7f2255c50640 1 -- 172.21.15.50:0/1214878094 >> v1:172.21.15.97:6789/0 conn(0x7f2250154070 legacy=0x7f22500cae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:47.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.473+0000 7f2255c50640 1 -- 172.21.15.50:0/1214878094 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2250154450 con 0x7f22500c9fd0 2024-04-01T02:12:47.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.473+0000 7f2255c50640 1 --2- 172.21.15.50:0/1214878094 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22500c9fd0 0x7f225006b540 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f2248009d90 tx=0x7f224801f150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87a7d75b99ba69a4 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:12:47.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.473+0000 7f2247fff640 1 -- 172.21.15.50:0/1214878094 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22480b4070 con 0x7f22500c9fd0 2024-04-01T02:12:47.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.473+0000 7f2247fff640 1 -- 172.21.15.50:0/1214878094 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22480af600 con 0x7f22500c9fd0 2024-04-01T02:12:47.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.473+0000 7f2247fff640 1 -- 172.21.15.50:0/1214878094 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22480af9d0 con 0x7f22500c9fd0 2024-04-01T02:12:47.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.477+0000 7f22576b3640 1 -- 172.21.15.50:0/1214878094 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22500c9fd0 msgr2=0x7f225006b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:47.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.477+0000 7f22576b3640 1 --2- 172.21.15.50:0/1214878094 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22500c9fd0 0x7f225006b540 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f2248009d90 tx=0x7f224801f150 comp rx=0 tx=0).stop 2024-04-01T02:12:47.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.477+0000 7f22576b3640 1 -- 172.21.15.50:0/1214878094 shutdown_connections 2024-04-01T02:12:47.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.477+0000 7f22576b3640 1 --2- 172.21.15.50:0/1214878094 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22500c9fd0 0x7f225006b540 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:47.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.477+0000 7f22576b3640 1 --2- 172.21.15.50:0/1214878094 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f22500c54b0 0x7f225006c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:47.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.477+0000 7f22576b3640 1 -- 172.21.15.50:0/1214878094 >> 172.21.15.50:0/1214878094 conn(0x7f2250072d50 msgr2=0x7f2250066f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T02:12:47.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.477+0000 7f22576b3640 1 -- 172.21.15.50:0/1214878094 shutdown_connections 2024-04-01T02:12:47.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.477+0000 7f22576b3640 1 -- 172.21.15.50:0/1214878094 wait complete. 2024-04-01T02:12:47.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.477+0000 7f22576b3640 1 Processor -- start 2024-04-01T02:12:47.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.477+0000 7f22576b3640 1 -- start start 2024-04-01T02:12:47.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.477+0000 7f22576b3640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f22500c54b0 0x7f2250156aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:47.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.477+0000 7f22576b3640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22500c9fd0 0x7f225014ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:47.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.477+0000 7f22576b3640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2250154070 0x7f22500c8d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:47.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.477+0000 7f22576b3640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f22500c4cb0 con 0x7f22500c9fd0 2024-04-01T02:12:47.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.477+0000 7f22576b3640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f22500c49d0 con 0x7f22500c54b0 2024-04-01T02:12:47.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.477+0000 7f22576b3640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f22500c4f90 con 0x7f2250154070 2024-04-01T02:12:47.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.477+0000 7f2254c4e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22500c9fd0 0x7f225014ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:47.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.477+0000 7f2254c4e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22500c9fd0 0x7f225014ada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50882/0 (socket says 172.21.15.50:50882) 2024-04-01T02:12:47.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.477+0000 7f2254c4e640 1 -- 172.21.15.50:0/763045202 learned_addr learned my addr 172.21.15.50:0/763045202 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T02:12:47.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.477+0000 7f225544f640 1 --2- 172.21.15.50:0/763045202 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f22500c54b0 0x7f2250156aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:47.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.477+0000 7f2255c50640 1 --2- 172.21.15.50:0/763045202 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2250154070 0x7f22500c8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:47.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.477+0000 7f2254c4e640 1 -- 172.21.15.50:0/763045202 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2250154070 msgr2=0x7f22500c8d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:47.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.477+0000 7f2254c4e640 1 --2- 172.21.15.50:0/763045202 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2250154070 0x7f22500c8d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:47.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.477+0000 7f2254c4e640 1 -- 172.21.15.50:0/763045202 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f22500c54b0 msgr2=0x7f2250156aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:47.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.477+0000 7f2254c4e640 1 --2- 172.21.15.50:0/763045202 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f22500c54b0 0x7f2250156aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:47.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.477+0000 7f2254c4e640 1 -- 172.21.15.50:0/763045202 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f225014d230 con 0x7f22500c9fd0 2024-04-01T02:12:47.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.477+0000 7f2254c4e640 1 --2- 172.21.15.50:0/763045202 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22500c9fd0 0x7f225014ada0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f224000e930 tx=0x7f224000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:12:47.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.477+0000 7f2245ffb640 1 -- 172.21.15.50:0/763045202 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2240017070 con 0x7f22500c9fd0 2024-04-01T02:12:47.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.477+0000 7f2245ffb640 1 -- 172.21.15.50:0/763045202 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f224000ca00 con 0x7f22500c9fd0 2024-04-01T02:12:47.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.477+0000 7f2245ffb640 1 -- 172.21.15.50:0/763045202 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f224000cdb0 con 0x7f22500c9fd0 2024-04-01T02:12:47.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.481+0000 7f22576b3640 1 -- 172.21.15.50:0/763045202 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f225014b6c0 con 0x7f22500c9fd0 2024-04-01T02:12:47.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.481+0000 7f22576b3640 1 -- 172.21.15.50:0/763045202 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f225014bc80 con 0x7f22500c9fd0 2024-04-01T02:12:47.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.481+0000 7f22576b3640 1 -- 172.21.15.50:0/763045202 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2250068230 con 0x7f22500c9fd0 2024-04-01T02:12:47.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.481+0000 7f2245ffb640 1 -- 172.21.15.50:0/763045202 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 87103+0+0 (secure 0 0 0) 0x7f224001a070 con 0x7f22500c9fd0 2024-04-01T02:12:47.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.481+0000 7f2245ffb640 1 --2- 172.21.15.50:0/763045202 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f2234067420 0x7f22340698e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:47.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.481+0000 7f2245ffb640 1 -- 172.21.15.50:0/763045202 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5738+0+0 (secure 0 0 0) 0x7f2240085aa0 con 0x7f22500c9fd0 2024-04-01T02:12:47.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.481+0000 7f2245ffb640 1 --2- 172.21.15.50:0/763045202 >> [v2:172.21.15.50:6824/4170468134,v1:172.21.15.50:6825/4170468134] conn(0x7f223406f680 0x7f2234071aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:47.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.481+0000 7f2245ffb640 1 -- 172.21.15.50:0/763045202 --> [v2:172.21.15.50:6824/4170468134,v1:172.21.15.50:6825/4170468134] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2234072170 con 0x7f223406f680 2024-04-01T02:12:47.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.481+0000 7f2245ffb640 1 -- 172.21.15.50:0/763045202 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f224008a2c0 con 0x7f22500c9fd0 2024-04-01T02:12:47.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.481+0000 7f225544f640 1 --2- 172.21.15.50:0/763045202 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f2234067420 0x7f22340698e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:47.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.481+0000 7f2255c50640 1 --2- 172.21.15.50:0/763045202 >> [v2:172.21.15.50:6824/4170468134,v1:172.21.15.50:6825/4170468134] conn(0x7f223406f680 0x7f2234071aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:47.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.481+0000 7f2255c50640 1 --2- 172.21.15.50:0/763045202 >> [v2:172.21.15.50:6824/4170468134,v1:172.21.15.50:6825/4170468134] conn(0x7f223406f680 0x7f2234071aa0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:12:47.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.481+0000 7f225544f640 1 --2- 172.21.15.50:0/763045202 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f2234067420 0x7f22340698e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f224c000f70 tx=0x7f224c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:12:47.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.481+0000 7f2245ffb640 1 -- 172.21.15.50:0/763045202 <== osd.0 v2:172.21.15.50:6824/4170468134 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2234072170 con 0x7f223406f680 2024-04-01T02:12:47.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.497+0000 7f22576b3640 1 -- 172.21.15.50:0/763045202 --> [v2:172.21.15.50:6824/4170468134,v1:172.21.15.50:6825/4170468134] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f22500cb840 con 0x7f223406f680 2024-04-01T02:12:47.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.497+0000 7f2245ffb640 1 -- 172.21.15.50:0/763045202 <== osd.0 v2:172.21.15.50:6824/4170468134 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f22500cb840 con 0x7f223406f680 2024-04-01T02:12:47.495 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-04-01T02:12:47.495 INFO:teuthology.orchestra.run.smithi050.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-01T02:12:47.495 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-04-01T02:12:47.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.497+0000 7f22576b3640 1 -- 172.21.15.50:0/763045202 >> [v2:172.21.15.50:6824/4170468134,v1:172.21.15.50:6825/4170468134] conn(0x7f223406f680 msgr2=0x7f2234071aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:47.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.497+0000 7f22576b3640 1 --2- 172.21.15.50:0/763045202 >> [v2:172.21.15.50:6824/4170468134,v1:172.21.15.50:6825/4170468134] conn(0x7f223406f680 0x7f2234071aa0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:47.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.497+0000 7f22576b3640 1 -- 172.21.15.50:0/763045202 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f2234067420 msgr2=0x7f22340698e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:47.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.497+0000 7f22576b3640 1 --2- 172.21.15.50:0/763045202 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f2234067420 0x7f22340698e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f224c000f70 tx=0x7f224c009040 comp rx=0 tx=0).stop 2024-04-01T02:12:47.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.497+0000 7f22576b3640 1 -- 172.21.15.50:0/763045202 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22500c9fd0 msgr2=0x7f225014ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:47.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.497+0000 7f22576b3640 1 --2- 172.21.15.50:0/763045202 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22500c9fd0 0x7f225014ada0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f224000e930 tx=0x7f224000edf0 comp rx=0 tx=0).stop 2024-04-01T02:12:47.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.497+0000 7f2255c50640 1 -- 172.21.15.50:0/763045202 reap_dead start 2024-04-01T02:12:47.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.497+0000 7f22576b3640 1 -- 172.21.15.50:0/763045202 shutdown_connections 2024-04-01T02:12:47.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.497+0000 7f22576b3640 1 -- 172.21.15.50:0/763045202 >> 172.21.15.50:0/763045202 conn(0x7f2250072d50 msgr2=0x7f2250066f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T02:12:47.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.497+0000 7f22576b3640 1 -- 172.21.15.50:0/763045202 shutdown_connections 2024-04-01T02:12:47.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.497+0000 7f22576b3640 1 -- 172.21.15.50:0/763045202 wait complete. 2024-04-01T02:12:47.517 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-01T02:12:47.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.633+0000 7f11f7534640 1 Processor -- start 2024-04-01T02:12:47.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.633+0000 7f11f7534640 1 -- start start 2024-04-01T02:12:47.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.633+0000 7f11f7534640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f11f00c2900 0x7f11f00c5f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:47.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.633+0000 7f11f7534640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f11f00c7850 0x7f11f00c6460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:47.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.633+0000 7f11f7534640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11f00c30d0 con 0x7f11f0151de0 2024-04-01T02:12:47.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.633+0000 7f11f7534640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f11f015b370 con 0x7f11f00c7850 2024-04-01T02:12:47.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.633+0000 7f11f7534640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f11f015c0f0 con 0x7f11f00c2900 2024-04-01T02:12:47.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.633+0000 7f11f5ad1640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f11f00c7850 0x7f11f00c6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:47.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.633+0000 7f11f52d0640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f11f0151de0 0x7f11f0157be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39184/0 (socket says 172.21.15.50:39184) 2024-04-01T02:12:47.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.633+0000 7f11f52d0640 1 -- 172.21.15.50:0/416361500 learned_addr learned my addr 172.21.15.50:0/416361500 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-04-01T02:12:47.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.633+0000 7f11f4acf640 1 --2- 172.21.15.50:0/416361500 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f11f00c2900 0x7f11f00c5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:47.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.633+0000 7f11f5ad1640 1 -- 172.21.15.50:0/416361500 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f11f00c2900 msgr2=0x7f11f00c5f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T02:12:47.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.633+0000 7f11f5ad1640 1 --2- 172.21.15.50:0/416361500 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f11f00c2900 0x7f11f00c5f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:47.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.633+0000 7f11f5ad1640 1 -- 172.21.15.50:0/416361500 >> v1:172.21.15.50:6789/0 conn(0x7f11f0151de0 legacy=0x7f11f0157be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:47.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.633+0000 7f11e7fff640 1 -- 172.21.15.50:0/416361500 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3731434394 0 0) 0x7f11f00c30d0 con 0x7f11f0151de0 2024-04-01T02:12:47.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.637+0000 7f11f5ad1640 1 -- 172.21.15.50:0/416361500 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11f00c2df0 con 0x7f11f00c7850 2024-04-01T02:12:47.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.637+0000 7f11f5ad1640 1 --2- 172.21.15.50:0/416361500 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f11f00c7850 0x7f11f00c6460 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f11e8009d90 tx=0x7f11e801f150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2715520b35260391 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:12:47.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.637+0000 7f11e7fff640 1 -- 172.21.15.50:0/416361500 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11e80b4070 con 0x7f11f00c7850 2024-04-01T02:12:47.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.637+0000 7f11e7fff640 1 -- 172.21.15.50:0/416361500 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11e80af600 con 0x7f11f00c7850 2024-04-01T02:12:47.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.637+0000 7f11e7fff640 1 -- 172.21.15.50:0/416361500 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11e80af9d0 con 0x7f11f00c7850 2024-04-01T02:12:47.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.637+0000 7f11f7534640 1 -- 172.21.15.50:0/416361500 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f11f00c7850 msgr2=0x7f11f00c6460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:47.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.637+0000 7f11f7534640 1 --2- 172.21.15.50:0/416361500 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f11f00c7850 0x7f11f00c6460 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f11e8009d90 tx=0x7f11e801f150 comp rx=0 tx=0).stop 2024-04-01T02:12:47.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.637+0000 7f11f7534640 1 -- 172.21.15.50:0/416361500 shutdown_connections 2024-04-01T02:12:47.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.637+0000 7f11f7534640 1 --2- 172.21.15.50:0/416361500 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f11f00c7850 0x7f11f00c6460 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:47.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.637+0000 7f11f7534640 1 --2- 172.21.15.50:0/416361500 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f11f00c2900 0x7f11f00c5f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:47.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.637+0000 7f11f7534640 1 -- 172.21.15.50:0/416361500 >> 172.21.15.50:0/416361500 conn(0x7f11f0067560 msgr2=0x7f11f006b220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T02:12:47.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.637+0000 7f11f7534640 1 -- 172.21.15.50:0/416361500 shutdown_connections 2024-04-01T02:12:47.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.637+0000 7f11f7534640 1 -- 172.21.15.50:0/416361500 wait complete. 2024-04-01T02:12:47.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.637+0000 7f11f7534640 1 Processor -- start 2024-04-01T02:12:47.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.641+0000 7f11f7534640 1 -- start start 2024-04-01T02:12:47.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.641+0000 7f11f7534640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f11f00c2900 0x7f11f0072ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:47.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.641+0000 7f11f7534640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f11f00c7850 0x7f11f0156bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:47.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.641+0000 7f11f7534640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f11f0151de0 0x7f11f0071250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:47.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.641+0000 7f11f7534640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f11f015bbd0 con 0x7f11f0151de0 2024-04-01T02:12:47.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.641+0000 7f11f7534640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f11f015b8f0 con 0x7f11f00c2900 2024-04-01T02:12:47.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.641+0000 7f11f7534640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f11f01582f0 con 0x7f11f00c7850 2024-04-01T02:12:47.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.641+0000 7f11f5ad1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f11f0151de0 0x7f11f0071250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:47.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.641+0000 7f11f5ad1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f11f0151de0 0x7f11f0071250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59370/0 (socket says 172.21.15.50:59370) 2024-04-01T02:12:47.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.641+0000 7f11f5ad1640 1 -- 172.21.15.50:0/3964032951 learned_addr learned my addr 172.21.15.50:0/3964032951 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T02:12:47.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.641+0000 7f11f52d0640 1 --2- 172.21.15.50:0/3964032951 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f11f00c2900 0x7f11f0072ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:47.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.641+0000 7f11f4acf640 1 --2- 172.21.15.50:0/3964032951 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f11f00c7850 0x7f11f0156bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:47.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.641+0000 7f11f5ad1640 1 -- 172.21.15.50:0/3964032951 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f11f00c7850 msgr2=0x7f11f0156bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:47.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.641+0000 7f11f5ad1640 1 --2- 172.21.15.50:0/3964032951 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f11f00c7850 0x7f11f0156bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:47.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.641+0000 7f11f5ad1640 1 -- 172.21.15.50:0/3964032951 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f11f00c2900 msgr2=0x7f11f0072ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:47.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.641+0000 7f11f5ad1640 1 --2- 172.21.15.50:0/3964032951 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f11f00c2900 0x7f11f0072ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:47.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.641+0000 7f11f5ad1640 1 -- 172.21.15.50:0/3964032951 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11f015adb0 con 0x7f11f0151de0 2024-04-01T02:12:47.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.641+0000 7f11f5ad1640 1 --2- 172.21.15.50:0/3964032951 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f11f0151de0 0x7f11f0071250 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f11e801d800 tx=0x7f11e801bef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:12:47.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.641+0000 7f11e5ffb640 1 -- 172.21.15.50:0/3964032951 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11e80b4040 con 0x7f11f0151de0 2024-04-01T02:12:47.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.641+0000 7f11e5ffb640 1 -- 172.21.15.50:0/3964032951 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11e80c1070 con 0x7f11f0151de0 2024-04-01T02:12:47.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.641+0000 7f11f7534640 1 -- 172.21.15.50:0/3964032951 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11f014f9a0 con 0x7f11f0151de0 2024-04-01T02:12:47.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.641+0000 7f11e5ffb640 1 -- 172.21.15.50:0/3964032951 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11e8009450 con 0x7f11f0151de0 2024-04-01T02:12:47.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.641+0000 7f11f7534640 1 -- 172.21.15.50:0/3964032951 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11f0159ff0 con 0x7f11f0151de0 2024-04-01T02:12:47.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.641+0000 7f11f7534640 1 -- 172.21.15.50:0/3964032951 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11f0068230 con 0x7f11f0151de0 2024-04-01T02:12:47.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.641+0000 7f11e5ffb640 1 -- 172.21.15.50:0/3964032951 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 87103+0+0 (secure 0 0 0) 0x7f11e80ba690 con 0x7f11f0151de0 2024-04-01T02:12:47.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.641+0000 7f11e5ffb640 1 --2- 172.21.15.50:0/3964032951 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f11d4067420 0x7f11d40698e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:47.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.641+0000 7f11e5ffb640 1 -- 172.21.15.50:0/3964032951 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5738+0+0 (secure 0 0 0) 0x7f11e8124200 con 0x7f11f0151de0 2024-04-01T02:12:47.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.641+0000 7f11f52d0640 1 --2- 172.21.15.50:0/3964032951 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f11d4067420 0x7f11d40698e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:47.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.645+0000 7f11f52d0640 1 --2- 172.21.15.50:0/3964032951 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f11d4067420 0x7f11d40698e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f11ec000f70 tx=0x7f11ec007c10 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:12:47.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.645+0000 7f11e5ffb640 1 -- 172.21.15.50:0/3964032951 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+176632 (secure 0 0 0) 0x7f11e8018cb0 con 0x7f11f0151de0 2024-04-01T02:12:47.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.809+0000 7f11f7534640 1 -- 172.21.15.50:0/3964032951 --> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f11f00c7280 con 0x7f11d4067420 2024-04-01T02:12:47.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.809+0000 7f11e5ffb640 1 -- 172.21.15.50:0/3964032951 <== mgr.4103 v2:172.21.15.97:6832/1677467570 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f11f00c7280 con 0x7f11d4067420 2024-04-01T02:12:47.807 INFO:teuthology.orchestra.run.smithi050.stderr:instructed osd(s) 0 to deep-scrub 2024-04-01T02:12:47.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.809+0000 7f11f7534640 1 -- 172.21.15.50:0/3964032951 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f11d4067420 msgr2=0x7f11d40698e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:47.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.809+0000 7f11f7534640 1 --2- 172.21.15.50:0/3964032951 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f11d4067420 0x7f11d40698e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f11ec000f70 tx=0x7f11ec007c10 comp rx=0 tx=0).stop 2024-04-01T02:12:47.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.809+0000 7f11f7534640 1 -- 172.21.15.50:0/3964032951 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f11f0151de0 msgr2=0x7f11f0071250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:47.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.809+0000 7f11f7534640 1 --2- 172.21.15.50:0/3964032951 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f11f0151de0 0x7f11f0071250 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f11e801d800 tx=0x7f11e801bef0 comp rx=0 tx=0).stop 2024-04-01T02:12:47.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.809+0000 7f11f7534640 1 -- 172.21.15.50:0/3964032951 shutdown_connections 2024-04-01T02:12:47.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.809+0000 7f11f7534640 1 --2- 172.21.15.50:0/3964032951 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f11d4067420 0x7f11d40698e0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:47.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.809+0000 7f11f7534640 1 --2- 172.21.15.50:0/3964032951 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f11f0151de0 0x7f11f0071250 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:47.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.809+0000 7f11f7534640 1 --2- 172.21.15.50:0/3964032951 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f11f00c7850 0x7f11f0156bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:47.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.809+0000 7f11f7534640 1 --2- 172.21.15.50:0/3964032951 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f11f00c2900 0x7f11f0072ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:47.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.809+0000 7f11f7534640 1 -- 172.21.15.50:0/3964032951 >> 172.21.15.50:0/3964032951 conn(0x7f11f0067560 msgr2=0x7f11f0150390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T02:12:47.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.809+0000 7f11f7534640 1 -- 172.21.15.50:0/3964032951 shutdown_connections 2024-04-01T02:12:47.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.809+0000 7f11f7534640 1 -- 172.21.15.50:0/3964032951 wait complete. 2024-04-01T02:12:47.828 INFO:tasks.ceph:Scrubbing osd.1 2024-04-01T02:12:47.828 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-01T02:12:47.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.949+0000 7f8ff685f640 1 Processor -- start 2024-04-01T02:12:47.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.949+0000 7f8ff685f640 1 -- start start 2024-04-01T02:12:47.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.949+0000 7f8ff685f640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f8ff01540c0 0x7f8ff006c830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:47.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.949+0000 7f8ff685f640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ff01544a0 con 0x7f8ff00ca3d0 2024-04-01T02:12:47.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.949+0000 7f8ff685f640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ff015a350 con 0x7f8ff0159d80 2024-04-01T02:12:47.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.949+0000 7f8ff685f640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f8ff006c3a0 con 0x7f8ff01540c0 2024-04-01T02:12:47.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.949+0000 7f8ff4dfc640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f8ff00ca3d0 0x7f8ff0164700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39194/0 (socket says 172.21.15.50:39194) 2024-04-01T02:12:47.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.949+0000 7f8ff4dfc640 1 -- 172.21.15.50:0/985230734 learned_addr learned my addr 172.21.15.50:0/985230734 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-04-01T02:12:47.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.949+0000 7f8feffff640 1 --2- 172.21.15.50:0/985230734 >> v2:172.21.15.97:3300/0 conn(0x7f8ff01540c0 0x7f8ff006c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:47.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.949+0000 7f8fef7fe640 1 -- 172.21.15.50:0/985230734 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2481610138 0 0) 0x7f8ff01544a0 con 0x7f8ff00ca3d0 2024-04-01T02:12:47.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.949+0000 7f8fef7fe640 1 -- 172.21.15.50:0/985230734 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8fdc003530 con 0x7f8ff00ca3d0 2024-04-01T02:12:47.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.949+0000 7f8fef7fe640 1 -- 172.21.15.50:0/985230734 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1233337803 0 0) 0x7f8fdc003530 con 0x7f8ff00ca3d0 2024-04-01T02:12:47.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.949+0000 7f8fef7fe640 1 -- 172.21.15.50:0/985230734 >> v2:172.21.15.97:3300/0 conn(0x7f8ff01540c0 msgr2=0x7f8ff006c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T02:12:47.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.949+0000 7f8fef7fe640 1 --2- 172.21.15.50:0/985230734 >> v2:172.21.15.97:3300/0 conn(0x7f8ff01540c0 0x7f8ff006c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:47.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.949+0000 7f8fef7fe640 1 -- 172.21.15.50:0/985230734 >> v1:172.21.15.97:6789/0 conn(0x7f8ff0159d80 legacy=0x7f8ff00cb130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:47.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.949+0000 7f8fef7fe640 1 -- 172.21.15.50:0/985230734 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ff015a630 con 0x7f8ff00ca3d0 2024-04-01T02:12:47.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.949+0000 7f8fef7fe640 1 -- 172.21.15.50:0/985230734 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2779672543 0 0) 0x7f8fe8001a00 con 0x7f8ff00ca3d0 2024-04-01T02:12:47.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.949+0000 7f8fef7fe640 1 -- 172.21.15.50:0/985230734 >> v1:172.21.15.50:6789/0 conn(0x7f8ff00ca3d0 legacy=0x7f8ff0164700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:47.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.949+0000 7f8fef7fe640 1 --2- 172.21.15.50:0/985230734 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8fdc0039c0 0x7f8fdc003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:47.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.949+0000 7f8fef7fe640 1 --2- 172.21.15.50:0/985230734 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8fdc004810 0x7f8fdc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:47.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.949+0000 7f8fef7fe640 1 --2- 172.21.15.50:0/985230734 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8fdc0051d0 0x7f8fdc00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:47.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.949+0000 7f8fef7fe640 1 -- 172.21.15.50:0/985230734 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff006c3a0 con 0x7f8fdc004810 2024-04-01T02:12:47.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.949+0000 7f8fef7fe640 1 -- 172.21.15.50:0/985230734 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f8fdc00c070 con 0x7f8fdc0039c0 2024-04-01T02:12:47.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.949+0000 7f8fef7fe640 1 -- 172.21.15.50:0/985230734 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f8fdc00c270 con 0x7f8fdc0051d0 2024-04-01T02:12:47.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.949+0000 7f8fe77fe640 1 --2- 172.21.15.50:0/985230734 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8fdc004810 0x7f8fdc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:47.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.949+0000 7f8feffff640 1 --2- 172.21.15.50:0/985230734 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8fdc0039c0 0x7f8fdc003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:47.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.949+0000 7f8fe77fe640 1 -- 172.21.15.50:0/985230734 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8fdc0051d0 msgr2=0x7f8fdc00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T02:12:47.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.949+0000 7f8ff4dfc640 1 --2- 172.21.15.50:0/985230734 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8fdc0051d0 0x7f8fdc00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:47.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.949+0000 7f8fe77fe640 1 --2- 172.21.15.50:0/985230734 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8fdc0051d0 0x7f8fdc00b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:47.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.949+0000 7f8fe77fe640 1 -- 172.21.15.50:0/985230734 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8fdc0039c0 msgr2=0x7f8fdc003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T02:12:47.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.949+0000 7f8fe77fe640 1 --2- 172.21.15.50:0/985230734 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8fdc0039c0 0x7f8fdc003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:47.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.949+0000 7f8ff4dfc640 1 -- 172.21.15.50:0/985230734 reap_dead start 2024-04-01T02:12:47.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.949+0000 7f8fe77fe640 1 -- 172.21.15.50:0/985230734 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fdc003530 con 0x7f8fdc004810 2024-04-01T02:12:47.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.949+0000 7f8feffff640 1 --2- 172.21.15.50:0/985230734 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8fdc0039c0 0x7f8fdc003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T02:12:47.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.953+0000 7f8fe77fe640 1 --2- 172.21.15.50:0/985230734 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8fdc004810 0x7f8fdc004c90 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f8fd8001780 tx=0x7f8fd801c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bb3b52837a7de57 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:12:47.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.953+0000 7f8fef7fe640 1 -- 172.21.15.50:0/985230734 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fd80013a0 con 0x7f8fdc004810 2024-04-01T02:12:47.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.953+0000 7f8fef7fe640 1 -- 172.21.15.50:0/985230734 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fd80a9070 con 0x7f8fdc004810 2024-04-01T02:12:47.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.953+0000 7f8fef7fe640 1 -- 172.21.15.50:0/985230734 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fd8003600 con 0x7f8fdc004810 2024-04-01T02:12:47.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.953+0000 7f8ff685f640 1 -- 172.21.15.50:0/985230734 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8fdc004810 msgr2=0x7f8fdc004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:47.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.953+0000 7f8ff685f640 1 --2- 172.21.15.50:0/985230734 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8fdc004810 0x7f8fdc004c90 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f8fd8001780 tx=0x7f8fd801c420 comp rx=0 tx=0).stop 2024-04-01T02:12:47.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.953+0000 7f8ff685f640 1 -- 172.21.15.50:0/985230734 shutdown_connections 2024-04-01T02:12:47.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.953+0000 7f8ff685f640 1 --2- 172.21.15.50:0/985230734 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8fdc004810 0x7f8fdc004c90 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:47.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.953+0000 7f8ff685f640 1 -- 172.21.15.50:0/985230734 >> 172.21.15.50:0/985230734 conn(0x7f8ff0066f60 msgr2=0x7f8ff0067370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T02:12:47.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.953+0000 7f8ff685f640 1 -- 172.21.15.50:0/985230734 shutdown_connections 2024-04-01T02:12:47.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.953+0000 7f8ff685f640 1 -- 172.21.15.50:0/985230734 wait complete. 2024-04-01T02:12:47.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.953+0000 7f8ff685f640 1 Processor -- start 2024-04-01T02:12:47.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.953+0000 7f8ff685f640 1 -- start start 2024-04-01T02:12:47.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.957+0000 7f8ff685f640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8fdc004810 0x7f8ff00c90c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:47.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.957+0000 7f8ff685f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ff014bd90 0x7f8ff00c9600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:47.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.957+0000 7f8ff685f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8ff00c6dc0 0x7f8ff00ce1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:47.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.957+0000 7f8ff685f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff006c030 con 0x7f8ff014bd90 2024-04-01T02:12:47.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.957+0000 7f8ff685f640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff015abf0 con 0x7f8ff00c6dc0 2024-04-01T02:12:47.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.957+0000 7f8ff685f640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f8ff00c4920 con 0x7f8fdc004810 2024-04-01T02:12:47.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.957+0000 7f8fe77fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ff014bd90 0x7f8ff00c9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:47.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.957+0000 7f8fe77fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ff014bd90 0x7f8ff00c9600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59388/0 (socket says 172.21.15.50:59388) 2024-04-01T02:12:47.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.957+0000 7f8fe77fe640 1 -- 172.21.15.50:0/859146326 learned_addr learned my addr 172.21.15.50:0/859146326 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T02:12:47.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.957+0000 7f8ff4dfc640 1 --2- 172.21.15.50:0/859146326 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8ff00c6dc0 0x7f8ff00ce1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:47.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.957+0000 7f8feffff640 1 --2- 172.21.15.50:0/859146326 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8fdc004810 0x7f8ff00c90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:47.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.957+0000 7f8fe77fe640 1 -- 172.21.15.50:0/859146326 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8fdc004810 msgr2=0x7f8ff00c90c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:47.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.957+0000 7f8fe77fe640 1 --2- 172.21.15.50:0/859146326 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8fdc004810 0x7f8ff00c90c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:47.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.957+0000 7f8fe77fe640 1 -- 172.21.15.50:0/859146326 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8ff00c6dc0 msgr2=0x7f8ff00ce1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:47.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.957+0000 7f8fe77fe640 1 --2- 172.21.15.50:0/859146326 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8ff00c6dc0 0x7f8ff00ce1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:47.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.957+0000 7f8fe77fe640 1 -- 172.21.15.50:0/859146326 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ff00c7ad0 con 0x7f8ff014bd90 2024-04-01T02:12:47.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.957+0000 7f8feffff640 1 --2- 172.21.15.50:0/859146326 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8fdc004810 0x7f8ff00c90c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T02:12:47.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.957+0000 7f8fe77fe640 1 --2- 172.21.15.50:0/859146326 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ff014bd90 0x7f8ff00c9600 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f8fd8005040 tx=0x7f8fdc005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:12:47.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.957+0000 7f8fed7fa640 1 -- 172.21.15.50:0/859146326 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fd80bb070 con 0x7f8ff014bd90 2024-04-01T02:12:47.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.957+0000 7f8fed7fa640 1 -- 172.21.15.50:0/859146326 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fd8007250 con 0x7f8ff014bd90 2024-04-01T02:12:47.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.957+0000 7f8ff685f640 1 -- 172.21.15.50:0/859146326 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ff00c7d70 con 0x7f8ff014bd90 2024-04-01T02:12:47.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.957+0000 7f8fed7fa640 1 -- 172.21.15.50:0/859146326 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fd8007640 con 0x7f8ff014bd90 2024-04-01T02:12:47.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.957+0000 7f8ff685f640 1 -- 172.21.15.50:0/859146326 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ff00cf6c0 con 0x7f8ff014bd90 2024-04-01T02:12:47.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.957+0000 7f8ff685f640 1 -- 172.21.15.50:0/859146326 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8ff0068230 con 0x7f8ff014bd90 2024-04-01T02:12:47.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.957+0000 7f8fed7fa640 1 -- 172.21.15.50:0/859146326 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 87103+0+0 (secure 0 0 0) 0x7f8fd80be070 con 0x7f8ff014bd90 2024-04-01T02:12:47.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.957+0000 7f8fed7fa640 1 --2- 172.21.15.50:0/859146326 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f8fd0067450 0x7f8fd0069910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:47.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.957+0000 7f8fed7fa640 1 -- 172.21.15.50:0/859146326 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5738+0+0 (secure 0 0 0) 0x7f8fd811eb20 con 0x7f8ff014bd90 2024-04-01T02:12:47.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.957+0000 7f8fed7fa640 1 --2- 172.21.15.50:0/859146326 >> [v2:172.21.15.50:6808/1794491326,v1:172.21.15.50:6809/1794491326] conn(0x7f8fd006f650 0x7f8fd0071a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:47.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.957+0000 7f8fed7fa640 1 -- 172.21.15.50:0/859146326 --> [v2:172.21.15.50:6808/1794491326,v1:172.21.15.50:6809/1794491326] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8fd0072140 con 0x7f8fd006f650 2024-04-01T02:12:47.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.957+0000 7f8fed7fa640 1 -- 172.21.15.50:0/859146326 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f8fd811efb0 con 0x7f8ff014bd90 2024-04-01T02:12:47.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.957+0000 7f8feffff640 1 --2- 172.21.15.50:0/859146326 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f8fd0067450 0x7f8fd0069910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:47.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.957+0000 7f8ff4dfc640 1 --2- 172.21.15.50:0/859146326 >> [v2:172.21.15.50:6808/1794491326,v1:172.21.15.50:6809/1794491326] conn(0x7f8fd006f650 0x7f8fd0071a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:47.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.957+0000 7f8ff4dfc640 1 --2- 172.21.15.50:0/859146326 >> [v2:172.21.15.50:6808/1794491326,v1:172.21.15.50:6809/1794491326] conn(0x7f8fd006f650 0x7f8fd0071a70 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:12:47.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.957+0000 7f8feffff640 1 --2- 172.21.15.50:0/859146326 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f8fd0067450 0x7f8fd0069910 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8ff00507d0 tx=0x7f8fe0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:12:47.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.961+0000 7f8fed7fa640 1 -- 172.21.15.50:0/859146326 <== osd.1 v2:172.21.15.50:6808/1794491326 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8fd0072140 con 0x7f8fd006f650 2024-04-01T02:12:47.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.973+0000 7f8ff685f640 1 -- 172.21.15.50:0/859146326 --> [v2:172.21.15.50:6808/1794491326,v1:172.21.15.50:6809/1794491326] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f8ff0152680 con 0x7f8fd006f650 2024-04-01T02:12:47.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.973+0000 7f8fed7fa640 1 -- 172.21.15.50:0/859146326 <== osd.1 v2:172.21.15.50:6808/1794491326 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f8ff0152680 con 0x7f8fd006f650 2024-04-01T02:12:47.971 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-04-01T02:12:47.971 INFO:teuthology.orchestra.run.smithi050.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-01T02:12:47.971 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-04-01T02:12:47.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.973+0000 7f8ff685f640 1 -- 172.21.15.50:0/859146326 >> [v2:172.21.15.50:6808/1794491326,v1:172.21.15.50:6809/1794491326] conn(0x7f8fd006f650 msgr2=0x7f8fd0071a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:47.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.973+0000 7f8ff685f640 1 --2- 172.21.15.50:0/859146326 >> [v2:172.21.15.50:6808/1794491326,v1:172.21.15.50:6809/1794491326] conn(0x7f8fd006f650 0x7f8fd0071a70 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:47.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.973+0000 7f8ff685f640 1 -- 172.21.15.50:0/859146326 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f8fd0067450 msgr2=0x7f8fd0069910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:47.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.973+0000 7f8ff685f640 1 --2- 172.21.15.50:0/859146326 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f8fd0067450 0x7f8fd0069910 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8ff00507d0 tx=0x7f8fe0008040 comp rx=0 tx=0).stop 2024-04-01T02:12:47.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.973+0000 7f8ff685f640 1 -- 172.21.15.50:0/859146326 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ff014bd90 msgr2=0x7f8ff00c9600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:47.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.973+0000 7f8ff685f640 1 --2- 172.21.15.50:0/859146326 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ff014bd90 0x7f8ff00c9600 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f8fd8005040 tx=0x7f8fdc005840 comp rx=0 tx=0).stop 2024-04-01T02:12:47.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.973+0000 7f8ff4dfc640 1 -- 172.21.15.50:0/859146326 reap_dead start 2024-04-01T02:12:47.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.973+0000 7f8ff685f640 1 -- 172.21.15.50:0/859146326 shutdown_connections 2024-04-01T02:12:47.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.973+0000 7f8ff685f640 1 -- 172.21.15.50:0/859146326 >> 172.21.15.50:0/859146326 conn(0x7f8ff0066f60 msgr2=0x7f8ff0146460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T02:12:47.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.973+0000 7f8ff685f640 1 -- 172.21.15.50:0/859146326 shutdown_connections 2024-04-01T02:12:47.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:47.973+0000 7f8ff685f640 1 -- 172.21.15.50:0/859146326 wait complete. 2024-04-01T02:12:47.986 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-01T02:12:48.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.101+0000 7f43df8e6640 1 Processor -- start 2024-04-01T02:12:48.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.101+0000 7f43df8e6640 1 -- start start 2024-04-01T02:12:48.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.105+0000 7f43df8e6640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f43d8066f60 0x7f43d80c2b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:48.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.105+0000 7f43df8e6640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f43d815a2c0 0x7f43d815a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:48.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.105+0000 7f43df8e6640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43d8151460 con 0x7f43d8151080 2024-04-01T02:12:48.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.105+0000 7f43df8e6640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f43d815ac70 con 0x7f43d815a2c0 2024-04-01T02:12:48.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.105+0000 7f43df8e6640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f43d806ed40 con 0x7f43d8066f60 2024-04-01T02:12:48.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.105+0000 7f43dde83640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f43d815a2c0 0x7f43d815a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:48.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.105+0000 7f43dde83640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f43d815a2c0 0x7f43d815a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59404/0 (socket says 172.21.15.50:59404) 2024-04-01T02:12:48.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.105+0000 7f43dd682640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f43d8151080 0x7f43d806c330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39202/0 (socket says 172.21.15.50:39202) 2024-04-01T02:12:48.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.105+0000 7f43dde83640 1 -- 172.21.15.50:0/3343510792 learned_addr learned my addr 172.21.15.50:0/3343510792 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T02:12:48.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.105+0000 7f43dce81640 1 --2- 172.21.15.50:0/3343510792 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f43d8066f60 0x7f43d80c2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:48.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.105+0000 7f43dde83640 1 -- 172.21.15.50:0/3343510792 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f43d8066f60 msgr2=0x7f43d80c2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T02:12:48.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.105+0000 7f43dde83640 1 --2- 172.21.15.50:0/3343510792 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f43d8066f60 0x7f43d80c2b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:48.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.105+0000 7f43dde83640 1 -- 172.21.15.50:0/3343510792 >> v1:172.21.15.50:6789/0 conn(0x7f43d8151080 legacy=0x7f43d806c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:48.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.105+0000 7f43dde83640 1 -- 172.21.15.50:0/3343510792 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43d80c86e0 con 0x7f43d815a2c0 2024-04-01T02:12:48.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.105+0000 7f43dde83640 1 --2- 172.21.15.50:0/3343510792 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43d815a2c0 0x7f43d815a730 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f43d0009e50 tx=0x7f43d001ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db731cef57185d52 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:12:48.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.105+0000 7f43cffff640 1 -- 172.21.15.50:0/3343510792 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43d00a5900 con 0x7f43d815a2c0 2024-04-01T02:12:48.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.105+0000 7f43cffff640 1 -- 172.21.15.50:0/3343510792 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43d00a5aa0 con 0x7f43d815a2c0 2024-04-01T02:12:48.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.105+0000 7f43cffff640 1 -- 172.21.15.50:0/3343510792 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43d00ad3f0 con 0x7f43d815a2c0 2024-04-01T02:12:48.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.105+0000 7f43df8e6640 1 -- 172.21.15.50:0/3343510792 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43d815a2c0 msgr2=0x7f43d815a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:48.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.105+0000 7f43df8e6640 1 --2- 172.21.15.50:0/3343510792 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43d815a2c0 0x7f43d815a730 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f43d0009e50 tx=0x7f43d001ca30 comp rx=0 tx=0).stop 2024-04-01T02:12:48.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.105+0000 7f43df8e6640 1 -- 172.21.15.50:0/3343510792 shutdown_connections 2024-04-01T02:12:48.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.105+0000 7f43df8e6640 1 --2- 172.21.15.50:0/3343510792 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43d815a2c0 0x7f43d815a730 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:48.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.105+0000 7f43df8e6640 1 --2- 172.21.15.50:0/3343510792 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f43d8066f60 0x7f43d80c2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:48.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.105+0000 7f43df8e6640 1 -- 172.21.15.50:0/3343510792 >> 172.21.15.50:0/3343510792 conn(0x7f43d806d9a0 msgr2=0x7f43d806ddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T02:12:48.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.105+0000 7f43df8e6640 1 -- 172.21.15.50:0/3343510792 shutdown_connections 2024-04-01T02:12:48.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.105+0000 7f43df8e6640 1 -- 172.21.15.50:0/3343510792 wait complete. 2024-04-01T02:12:48.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.109+0000 7f43df8e6640 1 Processor -- start 2024-04-01T02:12:48.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.109+0000 7f43df8e6640 1 -- start start 2024-04-01T02:12:48.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.109+0000 7f43df8e6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43d8066f60 0x7f43d80ca810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:48.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.109+0000 7f43df8e6640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f43d8151080 0x7f43d81f3050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:48.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.109+0000 7f43df8e6640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f43d815a2c0 0x7f43d8148a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:48.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.109+0000 7f43df8e6640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f43d806e6f0 con 0x7f43d8066f60 2024-04-01T02:12:48.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.109+0000 7f43df8e6640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f43d80c12c0 con 0x7f43d8151080 2024-04-01T02:12:48.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.109+0000 7f43df8e6640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f43d806e9d0 con 0x7f43d815a2c0 2024-04-01T02:12:48.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.109+0000 7f43dd682640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43d8066f60 0x7f43d80ca810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:48.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.109+0000 7f43dd682640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43d8066f60 0x7f43d80ca810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59420/0 (socket says 172.21.15.50:59420) 2024-04-01T02:12:48.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.109+0000 7f43dd682640 1 -- 172.21.15.50:0/347990218 learned_addr learned my addr 172.21.15.50:0/347990218 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T02:12:48.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.109+0000 7f43dde83640 1 --2- 172.21.15.50:0/347990218 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f43d815a2c0 0x7f43d8148a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:48.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.109+0000 7f43dce81640 1 --2- 172.21.15.50:0/347990218 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f43d8151080 0x7f43d81f3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:48.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.109+0000 7f43dd682640 1 -- 172.21.15.50:0/347990218 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f43d815a2c0 msgr2=0x7f43d8148a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:48.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.109+0000 7f43dd682640 1 --2- 172.21.15.50:0/347990218 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f43d815a2c0 0x7f43d8148a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:48.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.109+0000 7f43dd682640 1 -- 172.21.15.50:0/347990218 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f43d8151080 msgr2=0x7f43d81f3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:48.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.109+0000 7f43dd682640 1 --2- 172.21.15.50:0/347990218 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f43d8151080 0x7f43d81f3050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:48.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.109+0000 7f43dd682640 1 -- 172.21.15.50:0/347990218 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43d8160d20 con 0x7f43d8066f60 2024-04-01T02:12:48.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.109+0000 7f43dd682640 1 --2- 172.21.15.50:0/347990218 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43d8066f60 0x7f43d80ca810 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f43d400c420 tx=0x7f43d400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:12:48.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.109+0000 7f43cdffb640 1 -- 172.21.15.50:0/347990218 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43d40074e0 con 0x7f43d8066f60 2024-04-01T02:12:48.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.109+0000 7f43cdffb640 1 -- 172.21.15.50:0/347990218 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43d4007680 con 0x7f43d8066f60 2024-04-01T02:12:48.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.109+0000 7f43df8e6640 1 -- 172.21.15.50:0/347990218 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43d8160a40 con 0x7f43d8066f60 2024-04-01T02:12:48.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.109+0000 7f43cdffb640 1 -- 172.21.15.50:0/347990218 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43d4004a30 con 0x7f43d8066f60 2024-04-01T02:12:48.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.109+0000 7f43df8e6640 1 -- 172.21.15.50:0/347990218 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43d8144c80 con 0x7f43d8066f60 2024-04-01T02:12:48.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.109+0000 7f43df8e6640 1 -- 172.21.15.50:0/347990218 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43d8068940 con 0x7f43d8066f60 2024-04-01T02:12:48.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.113+0000 7f43cdffb640 1 -- 172.21.15.50:0/347990218 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 87103+0+0 (secure 0 0 0) 0x7f43d401a020 con 0x7f43d8066f60 2024-04-01T02:12:48.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.113+0000 7f43cdffb640 1 --2- 172.21.15.50:0/347990218 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f43bc067420 0x7f43bc0698e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:48.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.113+0000 7f43cdffb640 1 -- 172.21.15.50:0/347990218 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5738+0+0 (secure 0 0 0) 0x7f43d4084f80 con 0x7f43d8066f60 2024-04-01T02:12:48.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.113+0000 7f43dce81640 1 --2- 172.21.15.50:0/347990218 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f43bc067420 0x7f43bc0698e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:48.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.113+0000 7f43dce81640 1 --2- 172.21.15.50:0/347990218 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f43bc067420 0x7f43bc0698e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f43d806bea0 tx=0x7f43c8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:12:48.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.117+0000 7f43cdffb640 1 -- 172.21.15.50:0/347990218 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+176632 (secure 0 0 0) 0x7f43d4055c70 con 0x7f43d8066f60 2024-04-01T02:12:48.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.277+0000 7f43df8e6640 1 -- 172.21.15.50:0/347990218 --> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f43d8067540 con 0x7f43bc067420 2024-04-01T02:12:48.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.277+0000 7f43cdffb640 1 -- 172.21.15.50:0/347990218 <== mgr.4103 v2:172.21.15.97:6832/1677467570 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f43d8067540 con 0x7f43bc067420 2024-04-01T02:12:48.276 INFO:teuthology.orchestra.run.smithi050.stderr:instructed osd(s) 1 to deep-scrub 2024-04-01T02:12:48.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.281+0000 7f43df8e6640 1 -- 172.21.15.50:0/347990218 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f43bc067420 msgr2=0x7f43bc0698e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:48.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.281+0000 7f43df8e6640 1 --2- 172.21.15.50:0/347990218 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f43bc067420 0x7f43bc0698e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f43d806bea0 tx=0x7f43c8008040 comp rx=0 tx=0).stop 2024-04-01T02:12:48.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.281+0000 7f43df8e6640 1 -- 172.21.15.50:0/347990218 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43d8066f60 msgr2=0x7f43d80ca810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:48.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.281+0000 7f43df8e6640 1 --2- 172.21.15.50:0/347990218 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43d8066f60 0x7f43d80ca810 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f43d400c420 tx=0x7f43d400c8e0 comp rx=0 tx=0).stop 2024-04-01T02:12:48.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.281+0000 7f43df8e6640 1 -- 172.21.15.50:0/347990218 shutdown_connections 2024-04-01T02:12:48.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.281+0000 7f43df8e6640 1 --2- 172.21.15.50:0/347990218 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f43bc067420 0x7f43bc0698e0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:48.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.281+0000 7f43df8e6640 1 --2- 172.21.15.50:0/347990218 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f43d815a2c0 0x7f43d8148a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:48.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.281+0000 7f43df8e6640 1 --2- 172.21.15.50:0/347990218 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f43d8151080 0x7f43d81f3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:48.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.281+0000 7f43df8e6640 1 --2- 172.21.15.50:0/347990218 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43d8066f60 0x7f43d80ca810 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:48.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.281+0000 7f43df8e6640 1 -- 172.21.15.50:0/347990218 >> 172.21.15.50:0/347990218 conn(0x7f43d806d9a0 msgr2=0x7f43d814a930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T02:12:48.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.281+0000 7f43df8e6640 1 -- 172.21.15.50:0/347990218 shutdown_connections 2024-04-01T02:12:48.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.281+0000 7f43df8e6640 1 -- 172.21.15.50:0/347990218 wait complete. 2024-04-01T02:12:48.296 INFO:tasks.ceph:Scrubbing osd.2 2024-04-01T02:12:48.296 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-01T02:12:48.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.413+0000 7fb0fea4b640 1 Processor -- start 2024-04-01T02:12:48.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.413+0000 7fb0fea4b640 1 -- start start 2024-04-01T02:12:48.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.413+0000 7fb0fea4b640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb0f806b480 0x7fb0f80c5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:48.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.413+0000 7fb0fea4b640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0f815ab00 con 0x7fb0f80c2900 2024-04-01T02:12:48.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.413+0000 7fb0fea4b640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0f80c46a0 con 0x7fb0f806b860 2024-04-01T02:12:48.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.413+0000 7fb0fea4b640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fb0f815ade0 con 0x7fb0f806b480 2024-04-01T02:12:48.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.413+0000 7fb0fcfe8640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fb0f80c2900 0x7fb0f8159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39206/0 (socket says 172.21.15.50:39206) 2024-04-01T02:12:48.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.413+0000 7fb0fcfe8640 1 -- 172.21.15.50:0/2167469518 learned_addr learned my addr 172.21.15.50:0/2167469518 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-04-01T02:12:48.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.413+0000 7fb0f7fff640 1 --2- 172.21.15.50:0/2167469518 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb0f806b480 0x7fb0f80c5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:48.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.417+0000 7fb0f77fe640 1 -- 172.21.15.50:0/2167469518 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1443579239 0 0) 0x7fb0f815ab00 con 0x7fb0f80c2900 2024-04-01T02:12:48.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.417+0000 7fb0f77fe640 1 -- 172.21.15.50:0/2167469518 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb0e4003530 con 0x7fb0f80c2900 2024-04-01T02:12:48.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.417+0000 7fb0f77fe640 1 -- 172.21.15.50:0/2167469518 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3423125835 0 0) 0x7fb0e4003530 con 0x7fb0f80c2900 2024-04-01T02:12:48.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.417+0000 7fb0f77fe640 1 -- 172.21.15.50:0/2167469518 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb0f806b480 msgr2=0x7fb0f80c5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T02:12:48.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.417+0000 7fb0f77fe640 1 --2- 172.21.15.50:0/2167469518 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb0f806b480 0x7fb0f80c5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:48.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.417+0000 7fb0f77fe640 1 -- 172.21.15.50:0/2167469518 >> v1:172.21.15.97:6789/0 conn(0x7fb0f806b860 legacy=0x7fb0f81507d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:48.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.417+0000 7fb0f77fe640 1 -- 172.21.15.50:0/2167469518 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0f80c4980 con 0x7fb0f80c2900 2024-04-01T02:12:48.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.417+0000 7fb0f77fe640 1 -- 172.21.15.50:0/2167469518 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2779672543 0 0) 0x7fb0f0001a20 con 0x7fb0f80c2900 2024-04-01T02:12:48.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.417+0000 7fb0f77fe640 1 -- 172.21.15.50:0/2167469518 >> v1:172.21.15.50:6789/0 conn(0x7fb0f80c2900 legacy=0x7fb0f8159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:48.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.417+0000 7fb0f77fe640 1 --2- 172.21.15.50:0/2167469518 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0e40039f0 0x7fb0e4003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:48.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.417+0000 7fb0f77fe640 1 --2- 172.21.15.50:0/2167469518 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb0f806b480 0x7fb0e4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:48.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.417+0000 7fb0f77fe640 1 --2- 172.21.15.50:0/2167469518 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb0e4004d50 0x7fb0e40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:48.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.417+0000 7fb0f77fe640 1 -- 172.21.15.50:0/2167469518 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb0f815ade0 con 0x7fb0e40039f0 2024-04-01T02:12:48.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.417+0000 7fb0f77fe640 1 -- 172.21.15.50:0/2167469518 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fb0e400bb10 con 0x7fb0e4004d50 2024-04-01T02:12:48.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.417+0000 7fb0f77fe640 1 -- 172.21.15.50:0/2167469518 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fb0e400bd10 con 0x7fb0f806b480 2024-04-01T02:12:48.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.417+0000 7fb0f7fff640 1 --2- 172.21.15.50:0/2167469518 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0e40039f0 0x7fb0e4003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:48.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.417+0000 7fb0ef7fe640 1 --2- 172.21.15.50:0/2167469518 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb0f806b480 0x7fb0e4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:48.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.417+0000 7fb0fcfe8640 1 --2- 172.21.15.50:0/2167469518 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb0e4004d50 0x7fb0e40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:48.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.417+0000 7fb0f7fff640 1 -- 172.21.15.50:0/2167469518 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb0f806b480 msgr2=0x7fb0e4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T02:12:48.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.417+0000 7fb0f7fff640 1 --2- 172.21.15.50:0/2167469518 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb0f806b480 0x7fb0e4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:48.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.417+0000 7fb0f7fff640 1 -- 172.21.15.50:0/2167469518 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb0e4004d50 msgr2=0x7fb0e40051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T02:12:48.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.417+0000 7fb0f7fff640 1 --2- 172.21.15.50:0/2167469518 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb0e4004d50 0x7fb0e40051d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:48.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.417+0000 7fb0f7fff640 1 -- 172.21.15.50:0/2167469518 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0e4003530 con 0x7fb0e40039f0 2024-04-01T02:12:48.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.417+0000 7fb0ef7fe640 1 --2- 172.21.15.50:0/2167469518 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb0f806b480 0x7fb0e4004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T02:12:48.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.417+0000 7fb0f7fff640 1 --2- 172.21.15.50:0/2167469518 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0e40039f0 0x7fb0e4003e10 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fb0e8009ab0 tx=0x7fb0e801ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2aacf75a58937ebc server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:12:48.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.417+0000 7fb0f77fe640 1 -- 172.21.15.50:0/2167469518 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0e80b2070 con 0x7fb0e40039f0 2024-04-01T02:12:48.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.417+0000 7fb0f77fe640 1 -- 172.21.15.50:0/2167469518 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0e80a5640 con 0x7fb0e40039f0 2024-04-01T02:12:48.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.417+0000 7fb0f77fe640 1 -- 172.21.15.50:0/2167469518 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0e80096b0 con 0x7fb0e40039f0 2024-04-01T02:12:48.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.417+0000 7fb0fea4b640 1 -- 172.21.15.50:0/2167469518 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0e40039f0 msgr2=0x7fb0e4003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:48.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.417+0000 7fb0fea4b640 1 --2- 172.21.15.50:0/2167469518 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0e40039f0 0x7fb0e4003e10 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fb0e8009ab0 tx=0x7fb0e801ca50 comp rx=0 tx=0).stop 2024-04-01T02:12:48.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.417+0000 7fb0fcfe8640 1 -- 172.21.15.50:0/2167469518 reap_dead start 2024-04-01T02:12:48.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.417+0000 7fb0fea4b640 1 -- 172.21.15.50:0/2167469518 shutdown_connections 2024-04-01T02:12:48.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.417+0000 7fb0fea4b640 1 -- 172.21.15.50:0/2167469518 >> 172.21.15.50:0/2167469518 conn(0x7fb0f80cb560 msgr2=0x7fb0f80cb970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T02:12:48.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.417+0000 7fb0fea4b640 1 -- 172.21.15.50:0/2167469518 shutdown_connections 2024-04-01T02:12:48.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.417+0000 7fb0fea4b640 1 -- 172.21.15.50:0/2167469518 wait complete. 2024-04-01T02:12:48.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.421+0000 7fb0fea4b640 1 Processor -- start 2024-04-01T02:12:48.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.421+0000 7fb0fea4b640 1 -- start start 2024-04-01T02:12:48.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.421+0000 7fb0fea4b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0e40039f0 0x7fb0f81f3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:48.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.421+0000 7fb0fea4b640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb0f814b290 0x7fb0f8156ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:48.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.421+0000 7fb0fea4b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb0f814b6d0 0x7fb0f8157420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:48.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.421+0000 7fb0fea4b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb0f80c5460 con 0x7fb0e40039f0 2024-04-01T02:12:48.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.421+0000 7fb0fea4b640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fb0f80c4fd0 con 0x7fb0f814b6d0 2024-04-01T02:12:48.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.421+0000 7fb0fea4b640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fb0f8150ee0 con 0x7fb0f814b290 2024-04-01T02:12:48.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.421+0000 7fb0f7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0e40039f0 0x7fb0f81f3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:48.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.421+0000 7fb0f7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0e40039f0 0x7fb0f81f3bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59430/0 (socket says 172.21.15.50:59430) 2024-04-01T02:12:48.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.421+0000 7fb0f7fff640 1 -- 172.21.15.50:0/2544005399 learned_addr learned my addr 172.21.15.50:0/2544005399 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T02:12:48.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.421+0000 7fb0fcfe8640 1 --2- 172.21.15.50:0/2544005399 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb0f814b6d0 0x7fb0f8157420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:48.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.421+0000 7fb0f7fff640 1 -- 172.21.15.50:0/2544005399 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb0f814b290 msgr2=0x7fb0f8156ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:48.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.421+0000 7fb0ef7fe640 1 --2- 172.21.15.50:0/2544005399 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb0f814b290 0x7fb0f8156ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:48.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.421+0000 7fb0f7fff640 1 --2- 172.21.15.50:0/2544005399 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb0f814b290 0x7fb0f8156ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:48.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.421+0000 7fb0f7fff640 1 -- 172.21.15.50:0/2544005399 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb0f814b6d0 msgr2=0x7fb0f8157420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:48.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.421+0000 7fb0f7fff640 1 --2- 172.21.15.50:0/2544005399 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb0f814b6d0 0x7fb0f8157420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:48.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.421+0000 7fb0f7fff640 1 -- 172.21.15.50:0/2544005399 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0f81efbd0 con 0x7fb0e40039f0 2024-04-01T02:12:48.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.421+0000 7fb0ef7fe640 1 --2- 172.21.15.50:0/2544005399 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb0f814b290 0x7fb0f8156ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T02:12:48.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.421+0000 7fb0f7fff640 1 --2- 172.21.15.50:0/2544005399 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0e40039f0 0x7fb0f81f3bd0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb0e8009ab0 tx=0x7fb0e4005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:12:48.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.421+0000 7fb0f57fa640 1 -- 172.21.15.50:0/2544005399 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0e80b2040 con 0x7fb0e40039f0 2024-04-01T02:12:48.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.421+0000 7fb0f57fa640 1 -- 172.21.15.50:0/2544005399 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0e800f000 con 0x7fb0e40039f0 2024-04-01T02:12:48.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.421+0000 7fb0fea4b640 1 -- 172.21.15.50:0/2544005399 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0f81efeb0 con 0x7fb0e40039f0 2024-04-01T02:12:48.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.421+0000 7fb0f57fa640 1 -- 172.21.15.50:0/2544005399 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0e80096b0 con 0x7fb0e40039f0 2024-04-01T02:12:48.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.421+0000 7fb0fea4b640 1 -- 172.21.15.50:0/2544005399 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0f81f0470 con 0x7fb0e40039f0 2024-04-01T02:12:48.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.421+0000 7fb0fea4b640 1 -- 172.21.15.50:0/2544005399 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb0f8068230 con 0x7fb0e40039f0 2024-04-01T02:12:48.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.425+0000 7fb0f57fa640 1 -- 172.21.15.50:0/2544005399 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 87103+0+0 (secure 0 0 0) 0x7fb0e80c0020 con 0x7fb0e40039f0 2024-04-01T02:12:48.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.425+0000 7fb0f57fa640 1 --2- 172.21.15.50:0/2544005399 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fb0d8067420 0x7fb0d80698e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:48.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.425+0000 7fb0f57fa640 1 -- 172.21.15.50:0/2544005399 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5738+0+0 (secure 0 0 0) 0x7fb0e811f660 con 0x7fb0e40039f0 2024-04-01T02:12:48.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.425+0000 7fb0f57fa640 1 --2- 172.21.15.50:0/2544005399 >> [v2:172.21.15.50:6800/710247177,v1:172.21.15.50:6801/710247177] conn(0x7fb0d806f680 0x7fb0d8071aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:48.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.425+0000 7fb0f57fa640 1 -- 172.21.15.50:0/2544005399 --> [v2:172.21.15.50:6800/710247177,v1:172.21.15.50:6801/710247177] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb0e80a6ea0 con 0x7fb0d806f680 2024-04-01T02:12:48.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.425+0000 7fb0f57fa640 1 -- 172.21.15.50:0/2544005399 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fb0e8126050 con 0x7fb0e40039f0 2024-04-01T02:12:48.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.425+0000 7fb0fcfe8640 1 --2- 172.21.15.50:0/2544005399 >> [v2:172.21.15.50:6800/710247177,v1:172.21.15.50:6801/710247177] conn(0x7fb0d806f680 0x7fb0d8071aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:48.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.425+0000 7fb0ef7fe640 1 --2- 172.21.15.50:0/2544005399 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fb0d8067420 0x7fb0d80698e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:48.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.425+0000 7fb0fcfe8640 1 --2- 172.21.15.50:0/2544005399 >> [v2:172.21.15.50:6800/710247177,v1:172.21.15.50:6801/710247177] conn(0x7fb0d806f680 0x7fb0d8071aa0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:12:48.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.425+0000 7fb0ef7fe640 1 --2- 172.21.15.50:0/2544005399 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fb0d8067420 0x7fb0d80698e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb0f8158e10 tx=0x7fb0e0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:12:48.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.425+0000 7fb0f57fa640 1 -- 172.21.15.50:0/2544005399 <== osd.2 v2:172.21.15.50:6800/710247177 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb0e80a6ea0 con 0x7fb0d806f680 2024-04-01T02:12:48.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.437+0000 7fb0fea4b640 1 -- 172.21.15.50:0/2544005399 --> [v2:172.21.15.50:6800/710247177,v1:172.21.15.50:6801/710247177] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fb0f806f480 con 0x7fb0d806f680 2024-04-01T02:12:48.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.437+0000 7fb0f57fa640 1 -- 172.21.15.50:0/2544005399 <== osd.2 v2:172.21.15.50:6800/710247177 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fb0f806f480 con 0x7fb0d806f680 2024-04-01T02:12:48.437 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-04-01T02:12:48.437 INFO:teuthology.orchestra.run.smithi050.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-01T02:12:48.437 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-04-01T02:12:48.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.437+0000 7fb0fea4b640 1 -- 172.21.15.50:0/2544005399 >> [v2:172.21.15.50:6800/710247177,v1:172.21.15.50:6801/710247177] conn(0x7fb0d806f680 msgr2=0x7fb0d8071aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:48.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.437+0000 7fb0fea4b640 1 --2- 172.21.15.50:0/2544005399 >> [v2:172.21.15.50:6800/710247177,v1:172.21.15.50:6801/710247177] conn(0x7fb0d806f680 0x7fb0d8071aa0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:48.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.437+0000 7fb0fea4b640 1 -- 172.21.15.50:0/2544005399 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fb0d8067420 msgr2=0x7fb0d80698e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:48.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.437+0000 7fb0fea4b640 1 --2- 172.21.15.50:0/2544005399 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fb0d8067420 0x7fb0d80698e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb0f8158e10 tx=0x7fb0e0009040 comp rx=0 tx=0).stop 2024-04-01T02:12:48.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.437+0000 7fb0fea4b640 1 -- 172.21.15.50:0/2544005399 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0e40039f0 msgr2=0x7fb0f81f3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:48.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.437+0000 7fb0fea4b640 1 --2- 172.21.15.50:0/2544005399 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0e40039f0 0x7fb0f81f3bd0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb0e8009ab0 tx=0x7fb0e4005840 comp rx=0 tx=0).stop 2024-04-01T02:12:48.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.437+0000 7fb0fcfe8640 1 -- 172.21.15.50:0/2544005399 reap_dead start 2024-04-01T02:12:48.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.437+0000 7fb0fea4b640 1 -- 172.21.15.50:0/2544005399 shutdown_connections 2024-04-01T02:12:48.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.437+0000 7fb0fea4b640 1 -- 172.21.15.50:0/2544005399 >> 172.21.15.50:0/2544005399 conn(0x7fb0f80cb560 msgr2=0x7fb0f80c64e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T02:12:48.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.437+0000 7fb0fea4b640 1 -- 172.21.15.50:0/2544005399 shutdown_connections 2024-04-01T02:12:48.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.437+0000 7fb0fea4b640 1 -- 172.21.15.50:0/2544005399 wait complete. 2024-04-01T02:12:48.452 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-01T02:12:48.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.565+0000 7f26059d2640 1 Processor -- start 2024-04-01T02:12:48.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.565+0000 7f26059d2640 1 -- start start 2024-04-01T02:12:48.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.565+0000 7f26059d2640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f2600154200 0x7f26000cb780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:48.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.565+0000 7f26059d2640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f26000c4ab0 0x7f26000cc180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:48.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.565+0000 7f26059d2640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26001545e0 con 0x7f26000cc6c0 2024-04-01T02:12:48.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.565+0000 7f26059d2640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f260015dd70 con 0x7f26000c4ab0 2024-04-01T02:12:48.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.565+0000 7f26059d2640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f26000caae0 con 0x7f2600154200 2024-04-01T02:12:48.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.565+0000 7f25fe7fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f26000c4ab0 0x7f26000cc180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:48.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.565+0000 7f25ff7fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f26000cc6c0 0x7f260006c480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39210/0 (socket says 172.21.15.50:39210) 2024-04-01T02:12:48.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.565+0000 7f25ff7fe640 1 -- 172.21.15.50:0/1153885578 learned_addr learned my addr 172.21.15.50:0/1153885578 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-04-01T02:12:48.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.565+0000 7f25fe7fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f26000c4ab0 0x7f26000cc180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59440/0 (socket says 172.21.15.50:59440) 2024-04-01T02:12:48.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.565+0000 7f25feffd640 1 --2- 172.21.15.50:0/1153885578 >> v2:172.21.15.97:3300/0 conn(0x7f2600154200 0x7f26000cb780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:48.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.565+0000 7f25fdffb640 1 -- 172.21.15.50:0/1153885578 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1388907945 0 0) 0x7f26001545e0 con 0x7f26000cc6c0 2024-04-01T02:12:48.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.565+0000 7f25fdffb640 1 -- 172.21.15.50:0/1153885578 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f25e8003530 con 0x7f26000cc6c0 2024-04-01T02:12:48.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.565+0000 7f25fe7fc640 1 -- 172.21.15.50:0/1153885578 >> v2:172.21.15.97:3300/0 conn(0x7f2600154200 msgr2=0x7f26000cb780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T02:12:48.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.565+0000 7f25fe7fc640 1 --2- 172.21.15.50:0/1153885578 >> v2:172.21.15.97:3300/0 conn(0x7f2600154200 0x7f26000cb780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:48.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.565+0000 7f25fe7fc640 1 -- 172.21.15.50:0/1153885578 >> v1:172.21.15.50:6789/0 conn(0x7f26000cc6c0 legacy=0x7f260006c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:48.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.565+0000 7f25fe7fc640 1 -- 172.21.15.50:0/1153885578 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f260015e290 con 0x7f26000c4ab0 2024-04-01T02:12:48.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.565+0000 7f25feffd640 1 --2- 172.21.15.50:0/1153885578 >> v2:172.21.15.97:3300/0 conn(0x7f2600154200 0x7f26000cb780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T02:12:48.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.565+0000 7f25fe7fc640 1 --2- 172.21.15.50:0/1153885578 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26000c4ab0 0x7f26000cc180 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f26000cce80 tx=0x7f25f401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d789a9a9bfc1cd1 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:12:48.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.569+0000 7f25fdffb640 1 -- 172.21.15.50:0/1153885578 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25f40b2070 con 0x7f26000c4ab0 2024-04-01T02:12:48.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.569+0000 7f25fdffb640 1 -- 172.21.15.50:0/1153885578 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25f40a9070 con 0x7f26000c4ab0 2024-04-01T02:12:48.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.569+0000 7f25fdffb640 1 -- 172.21.15.50:0/1153885578 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25f40ad880 con 0x7f26000c4ab0 2024-04-01T02:12:48.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.569+0000 7f26059d2640 1 -- 172.21.15.50:0/1153885578 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26000c4ab0 msgr2=0x7f26000cc180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:48.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.569+0000 7f26059d2640 1 --2- 172.21.15.50:0/1153885578 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26000c4ab0 0x7f26000cc180 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f26000cce80 tx=0x7f25f401c450 comp rx=0 tx=0).stop 2024-04-01T02:12:48.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.569+0000 7f26059d2640 1 -- 172.21.15.50:0/1153885578 shutdown_connections 2024-04-01T02:12:48.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.569+0000 7f26059d2640 1 --2- 172.21.15.50:0/1153885578 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26000c4ab0 0x7f26000cc180 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:48.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.569+0000 7f26059d2640 1 --2- 172.21.15.50:0/1153885578 >> v2:172.21.15.97:3300/0 conn(0x7f2600154200 0x7f26000cb780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:48.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.569+0000 7f26059d2640 1 -- 172.21.15.50:0/1153885578 >> 172.21.15.50:0/1153885578 conn(0x7f2600066f60 msgr2=0x7f2600067370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T02:12:48.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.569+0000 7f26059d2640 1 -- 172.21.15.50:0/1153885578 shutdown_connections 2024-04-01T02:12:48.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.569+0000 7f26059d2640 1 -- 172.21.15.50:0/1153885578 wait complete. 2024-04-01T02:12:48.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.569+0000 7f26059d2640 1 Processor -- start 2024-04-01T02:12:48.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.569+0000 7f26059d2640 1 -- start start 2024-04-01T02:12:48.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.569+0000 7f26059d2640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f26000c4ab0 0x7f26000cfc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:48.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.569+0000 7f26059d2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26000cc6c0 0x7f26000c8980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:48.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.569+0000 7f26059d2640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2600154200 0x7f26000c8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:48.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.569+0000 7f26059d2640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f26000cbf50 con 0x7f26000cc6c0 2024-04-01T02:12:48.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.569+0000 7f26059d2640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f26000cbdd0 con 0x7f2600154200 2024-04-01T02:12:48.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.569+0000 7f26059d2640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f26000cb200 con 0x7f26000c4ab0 2024-04-01T02:12:48.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.569+0000 7f25fe7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26000cc6c0 0x7f26000c8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:48.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.569+0000 7f25fe7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26000cc6c0 0x7f26000c8980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59450/0 (socket says 172.21.15.50:59450) 2024-04-01T02:12:48.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.569+0000 7f25fe7fc640 1 -- 172.21.15.50:0/2497234730 learned_addr learned my addr 172.21.15.50:0/2497234730 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T02:12:48.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.569+0000 7f25ff7fe640 1 --2- 172.21.15.50:0/2497234730 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2600154200 0x7f26000c8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:48.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.569+0000 7f25feffd640 1 --2- 172.21.15.50:0/2497234730 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f26000c4ab0 0x7f26000cfc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:48.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.569+0000 7f25fe7fc640 1 -- 172.21.15.50:0/2497234730 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f26000c4ab0 msgr2=0x7f26000cfc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:48.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.569+0000 7f25fe7fc640 1 --2- 172.21.15.50:0/2497234730 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f26000c4ab0 0x7f26000cfc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:48.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.569+0000 7f25fe7fc640 1 -- 172.21.15.50:0/2497234730 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2600154200 msgr2=0x7f26000c8ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:48.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.569+0000 7f25fe7fc640 1 --2- 172.21.15.50:0/2497234730 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2600154200 0x7f26000c8ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:48.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.569+0000 7f25fe7fc640 1 -- 172.21.15.50:0/2497234730 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f260015d460 con 0x7f26000cc6c0 2024-04-01T02:12:48.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.569+0000 7f25fe7fc640 1 --2- 172.21.15.50:0/2497234730 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26000cc6c0 0x7f26000c8980 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f25f401a080 tx=0x7f25f40191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:12:48.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.569+0000 7f25e7fff640 1 -- 172.21.15.50:0/2497234730 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25f40bc070 con 0x7f26000cc6c0 2024-04-01T02:12:48.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.569+0000 7f25e7fff640 1 -- 172.21.15.50:0/2497234730 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25f40add00 con 0x7f26000cc6c0 2024-04-01T02:12:48.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.569+0000 7f26059d2640 1 -- 172.21.15.50:0/2497234730 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26000cd630 con 0x7f26000cc6c0 2024-04-01T02:12:48.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.569+0000 7f25e7fff640 1 -- 172.21.15.50:0/2497234730 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25f40b2040 con 0x7f26000cc6c0 2024-04-01T02:12:48.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.569+0000 7f26059d2640 1 -- 172.21.15.50:0/2497234730 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26000cdbf0 con 0x7f26000cc6c0 2024-04-01T02:12:48.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.573+0000 7f26059d2640 1 -- 172.21.15.50:0/2497234730 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2600068230 con 0x7f26000cc6c0 2024-04-01T02:12:48.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.573+0000 7f25e7fff640 1 -- 172.21.15.50:0/2497234730 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 87103+0+0 (secure 0 0 0) 0x7f25f40bf070 con 0x7f26000cc6c0 2024-04-01T02:12:48.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.573+0000 7f25e7fff640 1 --2- 172.21.15.50:0/2497234730 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f25ec067450 0x7f25ec069910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:48.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.573+0000 7f25e7fff640 1 -- 172.21.15.50:0/2497234730 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5738+0+0 (secure 0 0 0) 0x7f25f411e6b0 con 0x7f26000cc6c0 2024-04-01T02:12:48.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.573+0000 7f25feffd640 1 --2- 172.21.15.50:0/2497234730 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f25ec067450 0x7f25ec069910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:48.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.573+0000 7f25feffd640 1 --2- 172.21.15.50:0/2497234730 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f25ec067450 0x7f25ec069910 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f25f0009ed0 tx=0x7f25f000b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:12:48.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.577+0000 7f25e7fff640 1 -- 172.21.15.50:0/2497234730 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+176632 (secure 0 0 0) 0x7f25f4016070 con 0x7f26000cc6c0 2024-04-01T02:12:48.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.737+0000 7f26059d2640 1 -- 172.21.15.50:0/2497234730 --> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f26000d05b0 con 0x7f25ec067450 2024-04-01T02:12:48.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.737+0000 7f25e7fff640 1 -- 172.21.15.50:0/2497234730 <== mgr.4103 v2:172.21.15.97:6832/1677467570 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f26000d05b0 con 0x7f25ec067450 2024-04-01T02:12:48.736 INFO:teuthology.orchestra.run.smithi050.stderr:instructed osd(s) 2 to deep-scrub 2024-04-01T02:12:48.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.741+0000 7f26059d2640 1 -- 172.21.15.50:0/2497234730 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f25ec067450 msgr2=0x7f25ec069910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:48.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.741+0000 7f26059d2640 1 --2- 172.21.15.50:0/2497234730 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f25ec067450 0x7f25ec069910 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f25f0009ed0 tx=0x7f25f000b040 comp rx=0 tx=0).stop 2024-04-01T02:12:48.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.741+0000 7f26059d2640 1 -- 172.21.15.50:0/2497234730 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26000cc6c0 msgr2=0x7f26000c8980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:48.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.741+0000 7f26059d2640 1 --2- 172.21.15.50:0/2497234730 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26000cc6c0 0x7f26000c8980 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f25f401a080 tx=0x7f25f40191f0 comp rx=0 tx=0).stop 2024-04-01T02:12:48.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.741+0000 7f26059d2640 1 -- 172.21.15.50:0/2497234730 shutdown_connections 2024-04-01T02:12:48.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.741+0000 7f26059d2640 1 --2- 172.21.15.50:0/2497234730 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f25ec067450 0x7f25ec069910 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:48.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.741+0000 7f26059d2640 1 --2- 172.21.15.50:0/2497234730 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2600154200 0x7f26000c8ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:48.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.741+0000 7f26059d2640 1 --2- 172.21.15.50:0/2497234730 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26000cc6c0 0x7f26000c8980 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:48.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.741+0000 7f26059d2640 1 --2- 172.21.15.50:0/2497234730 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f26000c4ab0 0x7f26000cfc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:48.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.741+0000 7f26059d2640 1 -- 172.21.15.50:0/2497234730 >> 172.21.15.50:0/2497234730 conn(0x7f2600066f60 msgr2=0x7f2600153390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T02:12:48.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.741+0000 7f26059d2640 1 -- 172.21.15.50:0/2497234730 shutdown_connections 2024-04-01T02:12:48.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.741+0000 7f26059d2640 1 -- 172.21.15.50:0/2497234730 wait complete. 2024-04-01T02:12:48.756 INFO:tasks.ceph:Scrubbing osd.3 2024-04-01T02:12:48.756 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-01T02:12:48.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.889+0000 7efd2be6b640 1 Processor -- start 2024-04-01T02:12:48.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.889+0000 7efd2be6b640 1 -- start start 2024-04-01T02:12:48.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.889+0000 7efd2be6b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7efd24150350 0x7efd2406e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:48.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.889+0000 7efd2be6b640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efd240c6d00 0x7efd2406eba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:48.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.889+0000 7efd2be6b640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd240c5e30 con 0x7efd24071a80 2024-04-01T02:12:48.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.889+0000 7efd2be6b640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7efd240c7700 con 0x7efd24150350 2024-04-01T02:12:48.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.889+0000 7efd2be6b640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7efd24156f30 con 0x7efd240c6d00 2024-04-01T02:12:48.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.889+0000 7efd29c07640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7efd24150350 0x7efd2406e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:48.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.889+0000 7efd29c07640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7efd24150350 0x7efd2406e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59458/0 (socket says 172.21.15.50:59458) 2024-04-01T02:12:48.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.889+0000 7efd29c07640 1 -- 172.21.15.50:0/2999199608 learned_addr learned my addr 172.21.15.50:0/2999199608 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T02:12:48.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.889+0000 7efd2a408640 1 --2- 172.21.15.50:0/2999199608 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efd240c6d00 0x7efd2406eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:48.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.889+0000 7efd29c07640 1 -- 172.21.15.50:0/2999199608 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efd240c6d00 msgr2=0x7efd2406eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T02:12:48.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.889+0000 7efd29c07640 1 --2- 172.21.15.50:0/2999199608 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efd240c6d00 0x7efd2406eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:48.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.889+0000 7efd29c07640 1 -- 172.21.15.50:0/2999199608 >> v1:172.21.15.97:6789/0 conn(0x7efd24071a80 legacy=0x7efd240c65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T02:12:48.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.889+0000 7efd29c07640 1 -- 172.21.15.50:0/2999199608 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd240c7950 con 0x7efd24150350 2024-04-01T02:12:48.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.893+0000 7efd29c07640 1 --2- 172.21.15.50:0/2999199608 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd24150350 0x7efd2406e660 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7efd2406bf40 tx=0x7efd2001c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6679b852e883725a server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:12:48.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.893+0000 7efd28c05640 1 -- 172.21.15.50:0/2999199608 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd200aa5f0 con 0x7efd24150350 2024-04-01T02:12:48.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.893+0000 7efd28c05640 1 -- 172.21.15.50:0/2999199608 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd200af070 con 0x7efd24150350 2024-04-01T02:12:48.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.893+0000 7efd28c05640 1 -- 172.21.15.50:0/2999199608 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd200aa9b0 con 0x7efd24150350 2024-04-01T02:12:48.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.893+0000 7efd2be6b640 1 -- 172.21.15.50:0/2999199608 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd24150350 msgr2=0x7efd2406e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:48.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.893+0000 7efd2be6b640 1 --2- 172.21.15.50:0/2999199608 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd24150350 0x7efd2406e660 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7efd2406bf40 tx=0x7efd2001c4b0 comp rx=0 tx=0).stop 2024-04-01T02:12:48.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.893+0000 7efd2be6b640 1 -- 172.21.15.50:0/2999199608 shutdown_connections 2024-04-01T02:12:48.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.893+0000 7efd2be6b640 1 --2- 172.21.15.50:0/2999199608 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efd240c6d00 0x7efd2406eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:48.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.893+0000 7efd2be6b640 1 --2- 172.21.15.50:0/2999199608 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd24150350 0x7efd2406e660 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:48.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.893+0000 7efd2be6b640 1 -- 172.21.15.50:0/2999199608 >> 172.21.15.50:0/2999199608 conn(0x7efd240cb560 msgr2=0x7efd240cb970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T02:12:48.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.893+0000 7efd2be6b640 1 -- 172.21.15.50:0/2999199608 shutdown_connections 2024-04-01T02:12:48.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.893+0000 7efd2be6b640 1 -- 172.21.15.50:0/2999199608 wait complete. 2024-04-01T02:12:48.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.893+0000 7efd2be6b640 1 Processor -- start 2024-04-01T02:12:48.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.893+0000 7efd2be6b640 1 -- start start 2024-04-01T02:12:48.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.897+0000 7efd2be6b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd24071a80 0x7efd241f3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:48.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.897+0000 7efd2be6b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efd240c6d00 0x7efd240c4570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:48.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.897+0000 7efd2be6b640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efd24150350 0x7efd240c9190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:48.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.897+0000 7efd2be6b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7efd24156b30 con 0x7efd24071a80 2024-04-01T02:12:48.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.897+0000 7efd2be6b640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7efd2406fa40 con 0x7efd240c6d00 2024-04-01T02:12:48.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.897+0000 7efd2be6b640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7efd24156cb0 con 0x7efd24150350 2024-04-01T02:12:48.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.897+0000 7efd29c07640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd24071a80 0x7efd241f3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:48.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.897+0000 7efd29c07640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd24071a80 0x7efd241f3ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59466/0 (socket says 172.21.15.50:59466) 2024-04-01T02:12:48.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.897+0000 7efd29c07640 1 -- 172.21.15.50:0/3953131067 learned_addr learned my addr 172.21.15.50:0/3953131067 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T02:12:48.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.897+0000 7efd29406640 1 --2- 172.21.15.50:0/3953131067 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efd240c6d00 0x7efd240c4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:48.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.897+0000 7efd2a408640 1 --2- 172.21.15.50:0/3953131067 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efd24150350 0x7efd240c9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:48.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.897+0000 7efd29c07640 1 -- 172.21.15.50:0/3953131067 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efd24150350 msgr2=0x7efd240c9190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:48.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.897+0000 7efd29c07640 1 --2- 172.21.15.50:0/3953131067 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efd24150350 0x7efd240c9190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:48.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.897+0000 7efd29c07640 1 -- 172.21.15.50:0/3953131067 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efd240c6d00 msgr2=0x7efd240c4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:48.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.897+0000 7efd29c07640 1 --2- 172.21.15.50:0/3953131067 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efd240c6d00 0x7efd240c4570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:48.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.897+0000 7efd29c07640 1 -- 172.21.15.50:0/3953131067 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd241470e0 con 0x7efd24071a80 2024-04-01T02:12:48.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.897+0000 7efd29406640 1 --2- 172.21.15.50:0/3953131067 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efd240c6d00 0x7efd240c4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T02:12:48.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.897+0000 7efd29c07640 1 --2- 172.21.15.50:0/3953131067 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd24071a80 0x7efd241f3ba0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7efd200ac040 tx=0x7efd2001acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:12:48.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.897+0000 7efd1a7fc640 1 -- 172.21.15.50:0/3953131067 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd200bd5f0 con 0x7efd24071a80 2024-04-01T02:12:48.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.897+0000 7efd1a7fc640 1 -- 172.21.15.50:0/3953131067 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd200bd7b0 con 0x7efd24071a80 2024-04-01T02:12:48.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.897+0000 7efd2be6b640 1 -- 172.21.15.50:0/3953131067 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd24147380 con 0x7efd24071a80 2024-04-01T02:12:48.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.897+0000 7efd1a7fc640 1 -- 172.21.15.50:0/3953131067 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd200bdba0 con 0x7efd24071a80 2024-04-01T02:12:48.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.897+0000 7efd2be6b640 1 -- 172.21.15.50:0/3953131067 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd24147940 con 0x7efd24071a80 2024-04-01T02:12:48.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.897+0000 7efd2be6b640 1 -- 172.21.15.50:0/3953131067 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7efd24068230 con 0x7efd24071a80 2024-04-01T02:12:48.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.897+0000 7efd1a7fc640 1 -- 172.21.15.50:0/3953131067 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 87103+0+0 (secure 0 0 0) 0x7efd200b33f0 con 0x7efd24071a80 2024-04-01T02:12:48.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.897+0000 7efd1a7fc640 1 --2- 172.21.15.50:0/3953131067 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7efd08067420 0x7efd080698e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:48.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.897+0000 7efd1a7fc640 1 -- 172.21.15.50:0/3953131067 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5738+0+0 (secure 0 0 0) 0x7efd20120250 con 0x7efd24071a80 2024-04-01T02:12:48.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.897+0000 7efd1a7fc640 1 --2- 172.21.15.50:0/3953131067 >> [v2:172.21.15.50:6816/871680805,v1:172.21.15.50:6817/871680805] conn(0x7efd0806f620 0x7efd08071a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:48.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.897+0000 7efd1a7fc640 1 -- 172.21.15.50:0/3953131067 --> [v2:172.21.15.50:6816/871680805,v1:172.21.15.50:6817/871680805] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efd200c4e50 con 0x7efd0806f620 2024-04-01T02:12:48.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.897+0000 7efd1a7fc640 1 -- 172.21.15.50:0/3953131067 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7efd201206e0 con 0x7efd24071a80 2024-04-01T02:12:48.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.897+0000 7efd2a408640 1 --2- 172.21.15.50:0/3953131067 >> [v2:172.21.15.50:6816/871680805,v1:172.21.15.50:6817/871680805] conn(0x7efd0806f620 0x7efd08071a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:48.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.897+0000 7efd29406640 1 --2- 172.21.15.50:0/3953131067 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7efd08067420 0x7efd080698e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:48.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.901+0000 7efd2a408640 1 --2- 172.21.15.50:0/3953131067 >> [v2:172.21.15.50:6816/871680805,v1:172.21.15.50:6817/871680805] conn(0x7efd0806f620 0x7efd08071a40 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:12:48.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.901+0000 7efd29406640 1 --2- 172.21.15.50:0/3953131067 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7efd08067420 0x7efd080698e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7efd24156020 tx=0x7efd14008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:12:48.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.901+0000 7efd1a7fc640 1 -- 172.21.15.50:0/3953131067 <== osd.3 v2:172.21.15.50:6816/871680805 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7efd200c4e50 con 0x7efd0806f620 2024-04-01T02:12:48.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.913+0000 7efd2be6b640 1 -- 172.21.15.50:0/3953131067 --> [v2:172.21.15.50:6816/871680805,v1:172.21.15.50:6817/871680805] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7efd2414fb80 con 0x7efd0806f620 2024-04-01T02:12:48.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.913+0000 7efd1a7fc640 1 -- 172.21.15.50:0/3953131067 <== osd.3 v2:172.21.15.50:6816/871680805 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7efd2414fb80 con 0x7efd0806f620 2024-04-01T02:12:48.912 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-04-01T02:12:48.912 INFO:teuthology.orchestra.run.smithi050.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-01T02:12:48.913 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-04-01T02:12:48.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.913+0000 7efd2be6b640 1 -- 172.21.15.50:0/3953131067 >> [v2:172.21.15.50:6816/871680805,v1:172.21.15.50:6817/871680805] conn(0x7efd0806f620 msgr2=0x7efd08071a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:48.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.913+0000 7efd2be6b640 1 --2- 172.21.15.50:0/3953131067 >> [v2:172.21.15.50:6816/871680805,v1:172.21.15.50:6817/871680805] conn(0x7efd0806f620 0x7efd08071a40 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:48.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.913+0000 7efd2be6b640 1 -- 172.21.15.50:0/3953131067 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7efd08067420 msgr2=0x7efd080698e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:48.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.913+0000 7efd2be6b640 1 --2- 172.21.15.50:0/3953131067 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7efd08067420 0x7efd080698e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7efd24156020 tx=0x7efd14008040 comp rx=0 tx=0).stop 2024-04-01T02:12:48.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.913+0000 7efd2be6b640 1 -- 172.21.15.50:0/3953131067 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd24071a80 msgr2=0x7efd241f3ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:48.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.913+0000 7efd2be6b640 1 --2- 172.21.15.50:0/3953131067 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd24071a80 0x7efd241f3ba0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7efd200ac040 tx=0x7efd2001acf0 comp rx=0 tx=0).stop 2024-04-01T02:12:48.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.913+0000 7efd2a408640 1 -- 172.21.15.50:0/3953131067 reap_dead start 2024-04-01T02:12:48.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.913+0000 7efd2be6b640 1 -- 172.21.15.50:0/3953131067 shutdown_connections 2024-04-01T02:12:48.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.913+0000 7efd2be6b640 1 -- 172.21.15.50:0/3953131067 >> 172.21.15.50:0/3953131067 conn(0x7efd240cb560 msgr2=0x7efd24160180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T02:12:48.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.913+0000 7efd2be6b640 1 -- 172.21.15.50:0/3953131067 shutdown_connections 2024-04-01T02:12:48.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:48.913+0000 7efd2be6b640 1 -- 172.21.15.50:0/3953131067 wait complete. 2024-04-01T02:12:48.929 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-04-01T02:12:49.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.049+0000 7f7a3801b640 1 Processor -- start 2024-04-01T02:12:49.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.049+0000 7f7a3801b640 1 -- start start 2024-04-01T02:12:49.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.049+0000 7f7a3801b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7a3015a980 0x7f7a301657b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:49.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.049+0000 7f7a3801b640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a3006b610 con 0x7f7a3006cea0 2024-04-01T02:12:49.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.049+0000 7f7a3801b640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a3006be00 con 0x7f7a300c2ac0 2024-04-01T02:12:49.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.049+0000 7f7a3801b640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f7a3006b8d0 con 0x7f7a3015a980 2024-04-01T02:12:49.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.049+0000 7f7a355b6640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f7a3006cea0 0x7f7a300c7110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39222/0 (socket says 172.21.15.50:39222) 2024-04-01T02:12:49.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.049+0000 7f7a355b6640 1 -- 172.21.15.50:0/1469113768 learned_addr learned my addr 172.21.15.50:0/1469113768 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-04-01T02:12:49.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.049+0000 7f7a365b8640 1 --2- 172.21.15.50:0/1469113768 >> v2:172.21.15.50:3300/0 conn(0x7f7a3015a980 0x7f7a301657b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:49.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.049+0000 7f7a34db5640 1 -- 172.21.15.50:0/1469113768 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 602872575 0 0) 0x7f7a3006b610 con 0x7f7a3006cea0 2024-04-01T02:12:49.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.049+0000 7f7a34db5640 1 -- 172.21.15.50:0/1469113768 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a1c003530 con 0x7f7a3006cea0 2024-04-01T02:12:49.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.049+0000 7f7a365b8640 1 -- 172.21.15.50:0/1469113768 >> v1:172.21.15.97:6789/0 conn(0x7f7a300c2ac0 legacy=0x7f7a300c1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:49.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.049+0000 7f7a365b8640 1 -- 172.21.15.50:0/1469113768 >> v1:172.21.15.50:6789/0 conn(0x7f7a3006cea0 legacy=0x7f7a300c7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:49.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.049+0000 7f7a365b8640 1 -- 172.21.15.50:0/1469113768 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a3006c0e0 con 0x7f7a3015a980 2024-04-01T02:12:49.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.053+0000 7f7a365b8640 1 --2- 172.21.15.50:0/1469113768 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a3015a980 0x7f7a301657b0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f7a2c0097c0 tx=0x7f7a2c01c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a68d588c79437f0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:12:49.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.053+0000 7f7a34db5640 1 -- 172.21.15.50:0/1469113768 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a2c0b0070 con 0x7f7a3015a980 2024-04-01T02:12:49.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.053+0000 7f7a34db5640 1 -- 172.21.15.50:0/1469113768 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a2c0ab600 con 0x7f7a3015a980 2024-04-01T02:12:49.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.053+0000 7f7a34db5640 1 -- 172.21.15.50:0/1469113768 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a2c0ab9d0 con 0x7f7a3015a980 2024-04-01T02:12:49.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.053+0000 7f7a3801b640 1 -- 172.21.15.50:0/1469113768 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a3015a980 msgr2=0x7f7a301657b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:49.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.053+0000 7f7a3801b640 1 --2- 172.21.15.50:0/1469113768 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a3015a980 0x7f7a301657b0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f7a2c0097c0 tx=0x7f7a2c01c410 comp rx=0 tx=0).stop 2024-04-01T02:12:49.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.053+0000 7f7a3801b640 1 -- 172.21.15.50:0/1469113768 shutdown_connections 2024-04-01T02:12:49.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.053+0000 7f7a3801b640 1 --2- 172.21.15.50:0/1469113768 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a3015a980 0x7f7a301657b0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:49.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.053+0000 7f7a3801b640 1 -- 172.21.15.50:0/1469113768 >> 172.21.15.50:0/1469113768 conn(0x7f7a3006f4d0 msgr2=0x7f7a3006f8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T02:12:49.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.053+0000 7f7a3801b640 1 -- 172.21.15.50:0/1469113768 shutdown_connections 2024-04-01T02:12:49.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.053+0000 7f7a3801b640 1 -- 172.21.15.50:0/1469113768 wait complete. 2024-04-01T02:12:49.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.053+0000 7f7a3801b640 1 Processor -- start 2024-04-01T02:12:49.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.053+0000 7f7a3801b640 1 -- start start 2024-04-01T02:12:49.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.053+0000 7f7a3801b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7a3006cea0 0x7f7a300c3880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:49.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.053+0000 7f7a3801b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a300c2ac0 0x7f7a300c7160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:49.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.053+0000 7f7a3801b640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7a3015a980 0x7f7a301f6420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:49.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.053+0000 7f7a3801b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7a300c7ee0 con 0x7f7a300c2ac0 2024-04-01T02:12:49.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.053+0000 7f7a3801b640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f7a300c7d60 con 0x7f7a3006cea0 2024-04-01T02:12:49.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.053+0000 7f7a3801b640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f7a3006b220 con 0x7f7a3015a980 2024-04-01T02:12:49.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.057+0000 7f7a355b6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a300c2ac0 0x7f7a300c7160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:49.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.057+0000 7f7a355b6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a300c2ac0 0x7f7a300c7160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59492/0 (socket says 172.21.15.50:59492) 2024-04-01T02:12:49.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.057+0000 7f7a355b6640 1 -- 172.21.15.50:0/976559771 learned_addr learned my addr 172.21.15.50:0/976559771 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T02:12:49.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.057+0000 7f7a35db7640 1 --2- 172.21.15.50:0/976559771 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7a3006cea0 0x7f7a300c3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:49.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.057+0000 7f7a365b8640 1 --2- 172.21.15.50:0/976559771 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7a3015a980 0x7f7a301f6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:49.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.057+0000 7f7a355b6640 1 -- 172.21.15.50:0/976559771 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7a3015a980 msgr2=0x7f7a301f6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:49.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.057+0000 7f7a355b6640 1 --2- 172.21.15.50:0/976559771 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7a3015a980 0x7f7a301f6420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:49.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.057+0000 7f7a355b6640 1 -- 172.21.15.50:0/976559771 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7a3006cea0 msgr2=0x7f7a300c3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:49.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.057+0000 7f7a355b6640 1 --2- 172.21.15.50:0/976559771 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7a3006cea0 0x7f7a300c3880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:49.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.057+0000 7f7a355b6640 1 -- 172.21.15.50:0/976559771 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a300c5240 con 0x7f7a300c2ac0 2024-04-01T02:12:49.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.057+0000 7f7a355b6640 1 --2- 172.21.15.50:0/976559771 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a300c2ac0 0x7f7a300c7160 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f7a2000c450 tx=0x7f7a2000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:12:49.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.057+0000 7f7a267fc640 1 -- 172.21.15.50:0/976559771 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a20017070 con 0x7f7a300c2ac0 2024-04-01T02:12:49.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.057+0000 7f7a267fc640 1 -- 172.21.15.50:0/976559771 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a20005cf0 con 0x7f7a300c2ac0 2024-04-01T02:12:49.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.057+0000 7f7a3801b640 1 -- 172.21.15.50:0/976559771 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a3014f7f0 con 0x7f7a300c2ac0 2024-04-01T02:12:49.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.057+0000 7f7a267fc640 1 -- 172.21.15.50:0/976559771 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a20007270 con 0x7f7a300c2ac0 2024-04-01T02:12:49.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.057+0000 7f7a3801b640 1 -- 172.21.15.50:0/976559771 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a300c54e0 con 0x7f7a300c2ac0 2024-04-01T02:12:49.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.057+0000 7f7a3801b640 1 -- 172.21.15.50:0/976559771 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a30068940 con 0x7f7a300c2ac0 2024-04-01T02:12:49.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.057+0000 7f7a267fc640 1 -- 172.21.15.50:0/976559771 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 87103+0+0 (secure 0 0 0) 0x7f7a2001a070 con 0x7f7a300c2ac0 2024-04-01T02:12:49.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.057+0000 7f7a267fc640 1 --2- 172.21.15.50:0/976559771 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f7a14067420 0x7f7a140698e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:49.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.057+0000 7f7a267fc640 1 -- 172.21.15.50:0/976559771 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5738+0+0 (secure 0 0 0) 0x7f7a20084950 con 0x7f7a300c2ac0 2024-04-01T02:12:49.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.057+0000 7f7a35db7640 1 --2- 172.21.15.50:0/976559771 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f7a14067420 0x7f7a140698e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:49.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.057+0000 7f7a35db7640 1 --2- 172.21.15.50:0/976559771 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f7a14067420 0x7f7a140698e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7a28001cb0 tx=0x7f7a28009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:12:49.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.061+0000 7f7a267fc640 1 -- 172.21.15.50:0/976559771 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+176632 (secure 0 0 0) 0x7f7a20054ff0 con 0x7f7a300c2ac0 2024-04-01T02:12:49.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.225+0000 7f7a3801b640 1 -- 172.21.15.50:0/976559771 --> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f7a300c4ac0 con 0x7f7a14067420 2024-04-01T02:12:49.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.225+0000 7f7a267fc640 1 -- 172.21.15.50:0/976559771 <== mgr.4103 v2:172.21.15.97:6832/1677467570 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f7a28003980 con 0x7f7a14067420 2024-04-01T02:12:49.223 INFO:teuthology.orchestra.run.smithi050.stderr:instructed osd(s) 3 to deep-scrub 2024-04-01T02:12:49.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.229+0000 7f7a3801b640 1 -- 172.21.15.50:0/976559771 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f7a14067420 msgr2=0x7f7a140698e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:49.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.229+0000 7f7a3801b640 1 --2- 172.21.15.50:0/976559771 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f7a14067420 0x7f7a140698e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7a28001cb0 tx=0x7f7a28009040 comp rx=0 tx=0).stop 2024-04-01T02:12:49.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.229+0000 7f7a3801b640 1 -- 172.21.15.50:0/976559771 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a300c2ac0 msgr2=0x7f7a300c7160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:49.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.229+0000 7f7a3801b640 1 --2- 172.21.15.50:0/976559771 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a300c2ac0 0x7f7a300c7160 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f7a2000c450 tx=0x7f7a2000c910 comp rx=0 tx=0).stop 2024-04-01T02:12:49.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.229+0000 7f7a3801b640 1 -- 172.21.15.50:0/976559771 shutdown_connections 2024-04-01T02:12:49.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.229+0000 7f7a3801b640 1 --2- 172.21.15.50:0/976559771 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f7a14067420 0x7f7a140698e0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:49.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.229+0000 7f7a3801b640 1 --2- 172.21.15.50:0/976559771 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7a3015a980 0x7f7a301f6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:49.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.229+0000 7f7a3801b640 1 --2- 172.21.15.50:0/976559771 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a300c2ac0 0x7f7a300c7160 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:49.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.229+0000 7f7a3801b640 1 --2- 172.21.15.50:0/976559771 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7a3006cea0 0x7f7a300c3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:49.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.229+0000 7f7a3801b640 1 -- 172.21.15.50:0/976559771 >> 172.21.15.50:0/976559771 conn(0x7f7a3006f4d0 msgr2=0x7f7a300cb670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T02:12:49.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.229+0000 7f7a3801b640 1 -- 172.21.15.50:0/976559771 shutdown_connections 2024-04-01T02:12:49.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.229+0000 7f7a3801b640 1 -- 172.21.15.50:0/976559771 wait complete. 2024-04-01T02:12:49.247 INFO:tasks.ceph:Scrubbing osd.4 2024-04-01T02:12:49.248 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-04-01T02:12:49.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.377+0000 7fda6b3e6640 1 Processor -- start 2024-04-01T02:12:49.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.377+0000 7fda6b3e6640 1 -- start start 2024-04-01T02:12:49.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.381+0000 7fda6b3e6640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fda641540c0 0x7fda6406c830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:49.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.381+0000 7fda6b3e6640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda641544a0 con 0x7fda64159d80 2024-04-01T02:12:49.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.381+0000 7fda6b3e6640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda6415a350 con 0x7fda640ca3d0 2024-04-01T02:12:49.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.381+0000 7fda6b3e6640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fda6406c3a0 con 0x7fda641540c0 2024-04-01T02:12:49.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.381+0000 7fda69182640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fda641540c0 0x7fda6406c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:49.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.381+0000 7fda69182640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fda641540c0 0x7fda6406c830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59494/0 (socket says 172.21.15.50:59494) 2024-04-01T02:12:49.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.381+0000 7fda69182640 1 -- 172.21.15.50:0/98786685 learned_addr learned my addr 172.21.15.50:0/98786685 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T02:12:49.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.381+0000 7fda68981640 1 --1- 172.21.15.50:0/98786685 >> v1:172.21.15.50:6789/0 conn(0x7fda64159d80 0x7fda640cb130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39228/0 (socket says 172.21.15.50:39228) 2024-04-01T02:12:49.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.381+0000 7fda69182640 1 -- 172.21.15.50:0/98786685 >> v1:172.21.15.97:6789/0 conn(0x7fda640ca3d0 legacy=0x7fda64164700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:49.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.381+0000 7fda69182640 1 -- 172.21.15.50:0/98786685 >> v1:172.21.15.50:6789/0 conn(0x7fda64159d80 legacy=0x7fda640cb130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:49.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.381+0000 7fda69182640 1 -- 172.21.15.50:0/98786685 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda6415a630 con 0x7fda641540c0 2024-04-01T02:12:49.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.381+0000 7fda69182640 1 --2- 172.21.15.50:0/98786685 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda641540c0 0x7fda6406c830 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fda60009870 tx=0x7fda6001c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb70913bc8de7ccd server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:12:49.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.385+0000 7fda57fff640 1 -- 172.21.15.50:0/98786685 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda600ab650 con 0x7fda641540c0 2024-04-01T02:12:49.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.385+0000 7fda57fff640 1 -- 172.21.15.50:0/98786685 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda600b0070 con 0x7fda641540c0 2024-04-01T02:12:49.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.385+0000 7fda57fff640 1 -- 172.21.15.50:0/98786685 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda600aba10 con 0x7fda641540c0 2024-04-01T02:12:49.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.385+0000 7fda6b3e6640 1 -- 172.21.15.50:0/98786685 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda641540c0 msgr2=0x7fda6406c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:49.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.385+0000 7fda6b3e6640 1 --2- 172.21.15.50:0/98786685 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda641540c0 0x7fda6406c830 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fda60009870 tx=0x7fda6001c560 comp rx=0 tx=0).stop 2024-04-01T02:12:49.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.385+0000 7fda6b3e6640 1 -- 172.21.15.50:0/98786685 shutdown_connections 2024-04-01T02:12:49.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.385+0000 7fda6b3e6640 1 --2- 172.21.15.50:0/98786685 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda641540c0 0x7fda6406c830 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:49.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.385+0000 7fda6b3e6640 1 -- 172.21.15.50:0/98786685 >> 172.21.15.50:0/98786685 conn(0x7fda64066f60 msgr2=0x7fda64067370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T02:12:49.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.385+0000 7fda6b3e6640 1 -- 172.21.15.50:0/98786685 shutdown_connections 2024-04-01T02:12:49.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.385+0000 7fda6b3e6640 1 -- 172.21.15.50:0/98786685 wait complete. 2024-04-01T02:12:49.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.385+0000 7fda6b3e6640 1 Processor -- start 2024-04-01T02:12:49.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.385+0000 7fda6b3e6640 1 -- start start 2024-04-01T02:12:49.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.385+0000 7fda6b3e6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda640ca3d0 0x7fda640cb390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:49.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.385+0000 7fda6b3e6640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fda641540c0 0x7fda641528c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:49.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.385+0000 7fda6b3e6640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fda64159d80 0x7fda64152e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:49.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.385+0000 7fda6b3e6640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fda640cabf0 con 0x7fda640ca3d0 2024-04-01T02:12:49.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.385+0000 7fda6b3e6640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fda640c4920 con 0x7fda64159d80 2024-04-01T02:12:49.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.385+0000 7fda6b3e6640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fda640cad70 con 0x7fda641540c0 2024-04-01T02:12:49.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.385+0000 7fda69182640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda640ca3d0 0x7fda640cb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:49.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.385+0000 7fda69182640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda640ca3d0 0x7fda640cb390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59510/0 (socket says 172.21.15.50:59510) 2024-04-01T02:12:49.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.385+0000 7fda69182640 1 -- 172.21.15.50:0/2512507870 learned_addr learned my addr 172.21.15.50:0/2512507870 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T02:12:49.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.385+0000 7fda69983640 1 --2- 172.21.15.50:0/2512507870 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fda64159d80 0x7fda64152e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:49.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.385+0000 7fda68981640 1 --2- 172.21.15.50:0/2512507870 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fda641540c0 0x7fda641528c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:49.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.385+0000 7fda69182640 1 -- 172.21.15.50:0/2512507870 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fda641540c0 msgr2=0x7fda641528c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:49.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.385+0000 7fda69182640 1 --2- 172.21.15.50:0/2512507870 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fda641540c0 0x7fda641528c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:49.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.385+0000 7fda69182640 1 -- 172.21.15.50:0/2512507870 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fda64159d80 msgr2=0x7fda64152e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:49.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.385+0000 7fda69182640 1 --2- 172.21.15.50:0/2512507870 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fda64159d80 0x7fda64152e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:49.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.385+0000 7fda69182640 1 -- 172.21.15.50:0/2512507870 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda641534c0 con 0x7fda640ca3d0 2024-04-01T02:12:49.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.385+0000 7fda69182640 1 --2- 172.21.15.50:0/2512507870 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda640ca3d0 0x7fda640cb390 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fda60019170 tx=0x7fda6001ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:12:49.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.385+0000 7fda55ffb640 1 -- 172.21.15.50:0/2512507870 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda600b4800 con 0x7fda640ca3d0 2024-04-01T02:12:49.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.385+0000 7fda55ffb640 1 -- 172.21.15.50:0/2512507870 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda600b49c0 con 0x7fda640ca3d0 2024-04-01T02:12:49.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.385+0000 7fda55ffb640 1 -- 172.21.15.50:0/2512507870 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda600b4db0 con 0x7fda640ca3d0 2024-04-01T02:12:49.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.385+0000 7fda6b3e6640 1 -- 172.21.15.50:0/2512507870 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda641f6090 con 0x7fda640ca3d0 2024-04-01T02:12:49.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.385+0000 7fda6b3e6640 1 -- 172.21.15.50:0/2512507870 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda641f6650 con 0x7fda640ca3d0 2024-04-01T02:12:49.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.389+0000 7fda6b3e6640 1 -- 172.21.15.50:0/2512507870 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fda64068230 con 0x7fda640ca3d0 2024-04-01T02:12:49.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.389+0000 7fda55ffb640 1 -- 172.21.15.50:0/2512507870 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 87103+0+0 (secure 0 0 0) 0x7fda600b3380 con 0x7fda640ca3d0 2024-04-01T02:12:49.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.389+0000 7fda55ffb640 1 --2- 172.21.15.50:0/2512507870 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fda48067420 0x7fda480698e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:49.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.389+0000 7fda55ffb640 1 -- 172.21.15.50:0/2512507870 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5738+0+0 (secure 0 0 0) 0x7fda6011f750 con 0x7fda640ca3d0 2024-04-01T02:12:49.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.389+0000 7fda55ffb640 1 --2- 172.21.15.50:0/2512507870 >> [v2:172.21.15.97:6800/1095319381,v1:172.21.15.97:6801/1095319381] conn(0x7fda4806f620 0x7fda48071a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:49.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.389+0000 7fda55ffb640 1 -- 172.21.15.50:0/2512507870 --> [v2:172.21.15.97:6800/1095319381,v1:172.21.15.97:6801/1095319381] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fda60001d40 con 0x7fda4806f620 2024-04-01T02:12:49.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.389+0000 7fda55ffb640 1 -- 172.21.15.50:0/2512507870 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fda60126050 con 0x7fda640ca3d0 2024-04-01T02:12:49.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.389+0000 7fda68981640 1 --2- 172.21.15.50:0/2512507870 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fda48067420 0x7fda480698e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:49.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.389+0000 7fda69983640 1 --2- 172.21.15.50:0/2512507870 >> [v2:172.21.15.97:6800/1095319381,v1:172.21.15.97:6801/1095319381] conn(0x7fda4806f620 0x7fda48071a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:49.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.389+0000 7fda68981640 1 --2- 172.21.15.50:0/2512507870 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fda48067420 0x7fda480698e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fda640b2420 tx=0x7fda58007c90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:12:49.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.389+0000 7fda69983640 1 --2- 172.21.15.50:0/2512507870 >> [v2:172.21.15.97:6800/1095319381,v1:172.21.15.97:6801/1095319381] conn(0x7fda4806f620 0x7fda48071a40 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:12:49.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.393+0000 7fda55ffb640 1 -- 172.21.15.50:0/2512507870 <== osd.4 v2:172.21.15.97:6800/1095319381 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fda60001d40 con 0x7fda4806f620 2024-04-01T02:12:49.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.405+0000 7fda6b3e6640 1 -- 172.21.15.50:0/2512507870 --> [v2:172.21.15.97:6800/1095319381,v1:172.21.15.97:6801/1095319381] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fda640caf10 con 0x7fda4806f620 2024-04-01T02:12:49.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.405+0000 7fda55ffb640 1 -- 172.21.15.50:0/2512507870 <== osd.4 v2:172.21.15.97:6800/1095319381 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fda640caf10 con 0x7fda4806f620 2024-04-01T02:12:49.405 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-04-01T02:12:49.405 INFO:teuthology.orchestra.run.smithi050.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-01T02:12:49.405 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-04-01T02:12:49.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.405+0000 7fda6b3e6640 1 -- 172.21.15.50:0/2512507870 >> [v2:172.21.15.97:6800/1095319381,v1:172.21.15.97:6801/1095319381] conn(0x7fda4806f620 msgr2=0x7fda48071a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:49.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.405+0000 7fda6b3e6640 1 --2- 172.21.15.50:0/2512507870 >> [v2:172.21.15.97:6800/1095319381,v1:172.21.15.97:6801/1095319381] conn(0x7fda4806f620 0x7fda48071a40 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:49.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.405+0000 7fda6b3e6640 1 -- 172.21.15.50:0/2512507870 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fda48067420 msgr2=0x7fda480698e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:49.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.405+0000 7fda6b3e6640 1 --2- 172.21.15.50:0/2512507870 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fda48067420 0x7fda480698e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fda640b2420 tx=0x7fda58007c90 comp rx=0 tx=0).stop 2024-04-01T02:12:49.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.405+0000 7fda6b3e6640 1 -- 172.21.15.50:0/2512507870 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda640ca3d0 msgr2=0x7fda640cb390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:49.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.405+0000 7fda6b3e6640 1 --2- 172.21.15.50:0/2512507870 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda640ca3d0 0x7fda640cb390 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fda60019170 tx=0x7fda6001ada0 comp rx=0 tx=0).stop 2024-04-01T02:12:49.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.405+0000 7fda69983640 1 -- 172.21.15.50:0/2512507870 reap_dead start 2024-04-01T02:12:49.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.405+0000 7fda6b3e6640 1 -- 172.21.15.50:0/2512507870 shutdown_connections 2024-04-01T02:12:49.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.405+0000 7fda6b3e6640 1 -- 172.21.15.50:0/2512507870 >> 172.21.15.50:0/2512507870 conn(0x7fda64066f60 msgr2=0x7fda64150380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T02:12:49.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.405+0000 7fda6b3e6640 1 -- 172.21.15.50:0/2512507870 shutdown_connections 2024-04-01T02:12:49.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.405+0000 7fda6b3e6640 1 -- 172.21.15.50:0/2512507870 wait complete. 2024-04-01T02:12:49.421 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-04-01T02:12:49.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.541+0000 7fa740238640 1 Processor -- start 2024-04-01T02:12:49.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.541+0000 7fa740238640 1 -- start start 2024-04-01T02:12:49.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.541+0000 7fa740238640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa7380c73a0 0x7fa7380c2900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:49.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.541+0000 7fa740238640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa738156a20 con 0x7fa7380c77c0 2024-04-01T02:12:49.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.541+0000 7fa740238640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa738156ce0 con 0x7fa738150e60 2024-04-01T02:12:49.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.541+0000 7fa740238640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fa7381578f0 con 0x7fa7380c73a0 2024-04-01T02:12:49.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.541+0000 7fa73e7d5640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fa7380c77c0 0x7fa73815a2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39240/0 (socket says 172.21.15.50:39240) 2024-04-01T02:12:49.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.541+0000 7fa73e7d5640 1 -- 172.21.15.50:0/3232398541 learned_addr learned my addr 172.21.15.50:0/3232398541 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-04-01T02:12:49.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.541+0000 7fa73d7d3640 1 --2- 172.21.15.50:0/3232398541 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa7380c73a0 0x7fa7380c2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:49.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.541+0000 7fa73cfd2640 1 -- 172.21.15.50:0/3232398541 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1931329218 0 0) 0x7fa738156a20 con 0x7fa7380c77c0 2024-04-01T02:12:49.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.541+0000 7fa73cfd2640 1 -- 172.21.15.50:0/3232398541 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa724003530 con 0x7fa7380c77c0 2024-04-01T02:12:49.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.541+0000 7fa73cfd2640 1 -- 172.21.15.50:0/3232398541 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3716749233 0 0) 0x7fa724003530 con 0x7fa7380c77c0 2024-04-01T02:12:49.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.541+0000 7fa73cfd2640 1 -- 172.21.15.50:0/3232398541 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa7380c73a0 msgr2=0x7fa7380c2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T02:12:49.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.541+0000 7fa73cfd2640 1 --2- 172.21.15.50:0/3232398541 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa7380c73a0 0x7fa7380c2900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:49.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.541+0000 7fa73cfd2640 1 -- 172.21.15.50:0/3232398541 >> v1:172.21.15.97:6789/0 conn(0x7fa738150e60 legacy=0x7fa738072f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:49.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.541+0000 7fa73cfd2640 1 -- 172.21.15.50:0/3232398541 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa738156fc0 con 0x7fa7380c77c0 2024-04-01T02:12:49.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.541+0000 7fa73cfd2640 1 -- 172.21.15.50:0/3232398541 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2779672543 0 0) 0x7fa730001a00 con 0x7fa7380c77c0 2024-04-01T02:12:49.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.541+0000 7fa73cfd2640 1 -- 172.21.15.50:0/3232398541 >> v1:172.21.15.50:6789/0 conn(0x7fa7380c77c0 legacy=0x7fa73815a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:49.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.541+0000 7fa73cfd2640 1 --2- 172.21.15.50:0/3232398541 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7240039f0 0x7fa724003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:49.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.541+0000 7fa73cfd2640 1 --2- 172.21.15.50:0/3232398541 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa7240043a0 0x7fa724004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:49.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.541+0000 7fa73cfd2640 1 --2- 172.21.15.50:0/3232398541 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa7380c73a0 0x7fa7240050d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:49.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.541+0000 7fa73cfd2640 1 -- 172.21.15.50:0/3232398541 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa7381578f0 con 0x7fa7240039f0 2024-04-01T02:12:49.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.541+0000 7fa73cfd2640 1 -- 172.21.15.50:0/3232398541 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fa72400b9d0 con 0x7fa7240043a0 2024-04-01T02:12:49.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.541+0000 7fa73cfd2640 1 -- 172.21.15.50:0/3232398541 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fa72400bbd0 con 0x7fa7380c73a0 2024-04-01T02:12:49.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.541+0000 7fa73dfd4640 1 --2- 172.21.15.50:0/3232398541 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7240039f0 0x7fa724003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:49.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.541+0000 7fa73e7d5640 1 --2- 172.21.15.50:0/3232398541 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa7380c73a0 0x7fa7240050d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:49.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.541+0000 7fa73d7d3640 1 --2- 172.21.15.50:0/3232398541 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa7240043a0 0x7fa724004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:49.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.541+0000 7fa73dfd4640 1 -- 172.21.15.50:0/3232398541 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa7380c73a0 msgr2=0x7fa7240050d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T02:12:49.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.541+0000 7fa73dfd4640 1 --2- 172.21.15.50:0/3232398541 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa7380c73a0 0x7fa7240050d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:49.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.541+0000 7fa73dfd4640 1 -- 172.21.15.50:0/3232398541 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa7240043a0 msgr2=0x7fa724004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T02:12:49.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.541+0000 7fa73dfd4640 1 --2- 172.21.15.50:0/3232398541 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa7240043a0 0x7fa724004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:49.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.541+0000 7fa73dfd4640 1 -- 172.21.15.50:0/3232398541 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa724003530 con 0x7fa7240039f0 2024-04-01T02:12:49.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.545+0000 7fa73dfd4640 1 --2- 172.21.15.50:0/3232398541 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7240039f0 0x7fa724003dd0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fa734001860 tx=0x7fa73401ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89b23fa6041ab0c5 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:12:49.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.549+0000 7fa73cfd2640 1 -- 172.21.15.50:0/3232398541 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7340b5070 con 0x7fa7240039f0 2024-04-01T02:12:49.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.549+0000 7fa73cfd2640 1 -- 172.21.15.50:0/3232398541 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7340a88b0 con 0x7fa7240039f0 2024-04-01T02:12:49.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.549+0000 7fa73cfd2640 1 -- 172.21.15.50:0/3232398541 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa734001460 con 0x7fa7240039f0 2024-04-01T02:12:49.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.549+0000 7fa740238640 1 -- 172.21.15.50:0/3232398541 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7240039f0 msgr2=0x7fa724003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:49.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.549+0000 7fa740238640 1 --2- 172.21.15.50:0/3232398541 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7240039f0 0x7fa724003dd0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fa734001860 tx=0x7fa73401ec90 comp rx=0 tx=0).stop 2024-04-01T02:12:49.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.549+0000 7fa73e7d5640 1 -- 172.21.15.50:0/3232398541 reap_dead start 2024-04-01T02:12:49.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.549+0000 7fa740238640 1 -- 172.21.15.50:0/3232398541 shutdown_connections 2024-04-01T02:12:49.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.549+0000 7fa740238640 1 -- 172.21.15.50:0/3232398541 >> 172.21.15.50:0/3232398541 conn(0x7fa738067560 msgr2=0x7fa73806b220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T02:12:49.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.549+0000 7fa740238640 1 -- 172.21.15.50:0/3232398541 shutdown_connections 2024-04-01T02:12:49.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.549+0000 7fa740238640 1 -- 172.21.15.50:0/3232398541 wait complete. 2024-04-01T02:12:49.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.549+0000 7fa740238640 1 Processor -- start 2024-04-01T02:12:49.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.549+0000 7fa740238640 1 -- start start 2024-04-01T02:12:49.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.549+0000 7fa740238640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa7240039f0 0x7fa73813ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:49.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.549+0000 7fa740238640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7380c2150 0x7fa73813b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:49.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.549+0000 7fa740238640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa7381563b0 0x7fa7381eda20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:49.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.549+0000 7fa740238640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa73815aa00 con 0x7fa7380c2150 2024-04-01T02:12:49.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.549+0000 7fa740238640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fa738157580 con 0x7fa7240039f0 2024-04-01T02:12:49.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.549+0000 7fa740238640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fa73815ab80 con 0x7fa7381563b0 2024-04-01T02:12:49.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.549+0000 7fa73d7d3640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7380c2150 0x7fa73813b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:49.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.549+0000 7fa73d7d3640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7380c2150 0x7fa73813b170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59536/0 (socket says 172.21.15.50:59536) 2024-04-01T02:12:49.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.549+0000 7fa73d7d3640 1 -- 172.21.15.50:0/1601642847 learned_addr learned my addr 172.21.15.50:0/1601642847 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T02:12:49.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.549+0000 7fa73dfd4640 1 --2- 172.21.15.50:0/1601642847 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa7240039f0 0x7fa73813ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:49.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.549+0000 7fa73e7d5640 1 --2- 172.21.15.50:0/1601642847 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa7381563b0 0x7fa7381eda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:49.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.549+0000 7fa73d7d3640 1 -- 172.21.15.50:0/1601642847 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa7381563b0 msgr2=0x7fa7381eda20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:49.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.549+0000 7fa73d7d3640 1 --2- 172.21.15.50:0/1601642847 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa7381563b0 0x7fa7381eda20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:49.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.549+0000 7fa73d7d3640 1 -- 172.21.15.50:0/1601642847 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa7240039f0 msgr2=0x7fa73813ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:49.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.549+0000 7fa73d7d3640 1 --2- 172.21.15.50:0/1601642847 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa7240039f0 0x7fa73813ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:49.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.549+0000 7fa73d7d3640 1 -- 172.21.15.50:0/1601642847 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa738154b70 con 0x7fa7380c2150 2024-04-01T02:12:49.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.549+0000 7fa73dfd4640 1 --2- 172.21.15.50:0/1601642847 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa7240039f0 0x7fa73813ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T02:12:49.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.549+0000 7fa73d7d3640 1 --2- 172.21.15.50:0/1601642847 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7380c2150 0x7fa73813b170 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fa7280119d0 tx=0x7fa728011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:12:49.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.553+0000 7fa72e7fc640 1 -- 172.21.15.50:0/1601642847 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa72800faf0 con 0x7fa7380c2150 2024-04-01T02:12:49.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.553+0000 7fa72e7fc640 1 -- 172.21.15.50:0/1601642847 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa72800fc90 con 0x7fa7380c2150 2024-04-01T02:12:49.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.553+0000 7fa72e7fc640 1 -- 172.21.15.50:0/1601642847 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa728014440 con 0x7fa7380c2150 2024-04-01T02:12:49.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.553+0000 7fa740238640 1 -- 172.21.15.50:0/1601642847 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7381ed520 con 0x7fa7380c2150 2024-04-01T02:12:49.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.553+0000 7fa740238640 1 -- 172.21.15.50:0/1601642847 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa738154e10 con 0x7fa7380c2150 2024-04-01T02:12:49.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.553+0000 7fa740238640 1 -- 172.21.15.50:0/1601642847 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa738068230 con 0x7fa7380c2150 2024-04-01T02:12:49.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.553+0000 7fa72e7fc640 1 -- 172.21.15.50:0/1601642847 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 87103+0+0 (secure 0 0 0) 0x7fa728012040 con 0x7fa7380c2150 2024-04-01T02:12:49.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.553+0000 7fa72e7fc640 1 --2- 172.21.15.50:0/1601642847 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fa71c067420 0x7fa71c0698e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:49.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.553+0000 7fa72e7fc640 1 -- 172.21.15.50:0/1601642847 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5738+0+0 (secure 0 0 0) 0x7fa728085b80 con 0x7fa7380c2150 2024-04-01T02:12:49.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.553+0000 7fa73dfd4640 1 --2- 172.21.15.50:0/1601642847 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fa71c067420 0x7fa71c0698e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:49.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.557+0000 7fa73dfd4640 1 --2- 172.21.15.50:0/1601642847 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fa71c067420 0x7fa71c0698e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa734001860 tx=0x7fa7340aa070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:12:49.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.557+0000 7fa72e7fc640 1 -- 172.21.15.50:0/1601642847 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+176632 (secure 0 0 0) 0x7fa728019030 con 0x7fa7380c2150 2024-04-01T02:12:49.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.729+0000 7fa740238640 1 -- 172.21.15.50:0/1601642847 --> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7fa7380c3700 con 0x7fa71c067420 2024-04-01T02:12:49.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.729+0000 7fa72e7fc640 1 -- 172.21.15.50:0/1601642847 <== mgr.4103 v2:172.21.15.97:6832/1677467570 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fa7380c3700 con 0x7fa71c067420 2024-04-01T02:12:49.727 INFO:teuthology.orchestra.run.smithi050.stderr:instructed osd(s) 4 to deep-scrub 2024-04-01T02:12:49.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.729+0000 7fa740238640 1 -- 172.21.15.50:0/1601642847 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fa71c067420 msgr2=0x7fa71c0698e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:49.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.729+0000 7fa740238640 1 --2- 172.21.15.50:0/1601642847 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fa71c067420 0x7fa71c0698e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa734001860 tx=0x7fa7340aa070 comp rx=0 tx=0).stop 2024-04-01T02:12:49.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.729+0000 7fa740238640 1 -- 172.21.15.50:0/1601642847 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7380c2150 msgr2=0x7fa73813b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:49.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.729+0000 7fa740238640 1 --2- 172.21.15.50:0/1601642847 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7380c2150 0x7fa73813b170 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fa7280119d0 tx=0x7fa728011e90 comp rx=0 tx=0).stop 2024-04-01T02:12:49.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.729+0000 7fa740238640 1 -- 172.21.15.50:0/1601642847 shutdown_connections 2024-04-01T02:12:49.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.729+0000 7fa740238640 1 --2- 172.21.15.50:0/1601642847 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fa71c067420 0x7fa71c0698e0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:49.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.729+0000 7fa740238640 1 --2- 172.21.15.50:0/1601642847 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa7381563b0 0x7fa7381eda20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:49.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.729+0000 7fa740238640 1 --2- 172.21.15.50:0/1601642847 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7380c2150 0x7fa73813b170 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:49.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.729+0000 7fa740238640 1 --2- 172.21.15.50:0/1601642847 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa7240039f0 0x7fa73813ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:49.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.729+0000 7fa740238640 1 -- 172.21.15.50:0/1601642847 >> 172.21.15.50:0/1601642847 conn(0x7fa738067560 msgr2=0x7fa738072f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T02:12:49.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.729+0000 7fa740238640 1 -- 172.21.15.50:0/1601642847 shutdown_connections 2024-04-01T02:12:49.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.729+0000 7fa740238640 1 -- 172.21.15.50:0/1601642847 wait complete. 2024-04-01T02:12:49.747 INFO:tasks.ceph:Scrubbing osd.5 2024-04-01T02:12:49.747 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-04-01T02:12:49.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.881+0000 7faa9f85e640 1 Processor -- start 2024-04-01T02:12:49.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.881+0000 7faa9f85e640 1 -- start start 2024-04-01T02:12:49.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.881+0000 7faa9f85e640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faa98154350 0x7faa98073440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:49.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.881+0000 7faa9f85e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7faa98072dc0 0x7faa9815dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:49.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.881+0000 7faa9f85e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa980c7670 con 0x7faa9815e210 2024-04-01T02:12:49.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.881+0000 7faa9f85e640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7faa98072b90 con 0x7faa98072dc0 2024-04-01T02:12:49.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.881+0000 7faa9f85e640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7faa9815d560 con 0x7faa98154350 2024-04-01T02:12:49.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.881+0000 7faa9ddfb640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7faa9815e210 0x7faa9806b220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39254/0 (socket says 172.21.15.50:39254) 2024-04-01T02:12:49.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.881+0000 7faa9ddfb640 1 -- 172.21.15.50:0/1308476150 learned_addr learned my addr 172.21.15.50:0/1308476150 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-04-01T02:12:49.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.881+0000 7faa9cdf9640 1 --2- 172.21.15.50:0/1308476150 >> v2:172.21.15.50:3300/0 conn(0x7faa98072dc0 0x7faa9815dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:49.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.881+0000 7faa9d5fa640 1 --2- 172.21.15.50:0/1308476150 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faa98154350 0x7faa98073440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:49.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.885+0000 7faa9cdf9640 1 -- 172.21.15.50:0/1308476150 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faa98154350 msgr2=0x7faa98073440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T02:12:49.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.885+0000 7faa9cdf9640 1 --2- 172.21.15.50:0/1308476150 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faa98154350 0x7faa98073440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:49.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.885+0000 7faa9cdf9640 1 -- 172.21.15.50:0/1308476150 >> v1:172.21.15.50:6789/0 conn(0x7faa9815e210 legacy=0x7faa9806b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:49.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.885+0000 7faa9cdf9640 1 -- 172.21.15.50:0/1308476150 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa980728b0 con 0x7faa98072dc0 2024-04-01T02:12:49.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.885+0000 7faa9cdf9640 1 --2- 172.21.15.50:0/1308476150 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa98072dc0 0x7faa9815dcd0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7faa940097c0 tx=0x7faa9401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b19b9939f66cea5 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:12:49.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.885+0000 7faa8bfff640 1 -- 172.21.15.50:0/1308476150 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa940b2070 con 0x7faa98072dc0 2024-04-01T02:12:49.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.885+0000 7faa8bfff640 1 -- 172.21.15.50:0/1308476150 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa940ad640 con 0x7faa98072dc0 2024-04-01T02:12:49.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.885+0000 7faa8bfff640 1 -- 172.21.15.50:0/1308476150 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa940ada10 con 0x7faa98072dc0 2024-04-01T02:12:49.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.885+0000 7faa9f85e640 1 -- 172.21.15.50:0/1308476150 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa98072dc0 msgr2=0x7faa9815dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:49.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.885+0000 7faa9f85e640 1 --2- 172.21.15.50:0/1308476150 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa98072dc0 0x7faa9815dcd0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7faa940097c0 tx=0x7faa9401c4a0 comp rx=0 tx=0).stop 2024-04-01T02:12:49.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.885+0000 7faa9f85e640 1 -- 172.21.15.50:0/1308476150 shutdown_connections 2024-04-01T02:12:49.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.885+0000 7faa9f85e640 1 --2- 172.21.15.50:0/1308476150 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa98072dc0 0x7faa9815dcd0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:49.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.885+0000 7faa9f85e640 1 --2- 172.21.15.50:0/1308476150 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faa98154350 0x7faa98073440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:49.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.885+0000 7faa9f85e640 1 -- 172.21.15.50:0/1308476150 >> 172.21.15.50:0/1308476150 conn(0x7faa980cc480 msgr2=0x7faa980cc890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T02:12:49.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.885+0000 7faa9f85e640 1 -- 172.21.15.50:0/1308476150 shutdown_connections 2024-04-01T02:12:49.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.885+0000 7faa9f85e640 1 -- 172.21.15.50:0/1308476150 wait complete. 2024-04-01T02:12:49.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.889+0000 7faa9f85e640 1 Processor -- start 2024-04-01T02:12:49.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.889+0000 7faa9f85e640 1 -- start start 2024-04-01T02:12:49.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.889+0000 7faa9f85e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa98072dc0 0x7faa9815cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:49.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.889+0000 7faa9f85e640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faa98154350 0x7faa98146f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:49.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.889+0000 7faa9f85e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faa9815e210 0x7faa9814be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:49.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.889+0000 7faa9f85e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7faa9806bec0 con 0x7faa98072dc0 2024-04-01T02:12:49.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.889+0000 7faa9f85e640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7faa9806bd40 con 0x7faa9815e210 2024-04-01T02:12:49.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.889+0000 7faa9f85e640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7faa98167110 con 0x7faa98154350 2024-04-01T02:12:49.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.889+0000 7faa9d5fa640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa98072dc0 0x7faa9815cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:49.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.889+0000 7faa9d5fa640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa98072dc0 0x7faa9815cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59550/0 (socket says 172.21.15.50:59550) 2024-04-01T02:12:49.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.889+0000 7faa9d5fa640 1 -- 172.21.15.50:0/846228779 learned_addr learned my addr 172.21.15.50:0/846228779 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T02:12:49.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.889+0000 7faa9cdf9640 1 --2- 172.21.15.50:0/846228779 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faa98154350 0x7faa98146f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:49.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.889+0000 7faa9ddfb640 1 --2- 172.21.15.50:0/846228779 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faa9815e210 0x7faa9814be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:49.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.889+0000 7faa9d5fa640 1 -- 172.21.15.50:0/846228779 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faa98154350 msgr2=0x7faa98146f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:49.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.889+0000 7faa9d5fa640 1 --2- 172.21.15.50:0/846228779 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faa98154350 0x7faa98146f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:49.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.889+0000 7faa9d5fa640 1 -- 172.21.15.50:0/846228779 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faa9815e210 msgr2=0x7faa9814be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:49.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.889+0000 7faa9d5fa640 1 --2- 172.21.15.50:0/846228779 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faa9815e210 0x7faa9814be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:49.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.889+0000 7faa9d5fa640 1 -- 172.21.15.50:0/846228779 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa98147440 con 0x7faa98072dc0 2024-04-01T02:12:49.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.889+0000 7faa9ddfb640 1 --2- 172.21.15.50:0/846228779 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faa9815e210 0x7faa9814be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T02:12:49.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.889+0000 7faa9d5fa640 1 --2- 172.21.15.50:0/846228779 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa98072dc0 0x7faa9815cd00 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7faa8c00d620 tx=0x7faa8c00dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:12:49.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.889+0000 7faa89ffb640 1 -- 172.21.15.50:0/846228779 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa8c00b620 con 0x7faa98072dc0 2024-04-01T02:12:49.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.889+0000 7faa89ffb640 1 -- 172.21.15.50:0/846228779 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa8c019070 con 0x7faa98072dc0 2024-04-01T02:12:49.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.889+0000 7faa89ffb640 1 -- 172.21.15.50:0/846228779 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa8c00b9e0 con 0x7faa98072dc0 2024-04-01T02:12:49.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.889+0000 7faa9f85e640 1 -- 172.21.15.50:0/846228779 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa98148540 con 0x7faa98072dc0 2024-04-01T02:12:49.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.889+0000 7faa9f85e640 1 -- 172.21.15.50:0/846228779 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa9814dba0 con 0x7faa98072dc0 2024-04-01T02:12:49.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.889+0000 7faa9f85e640 1 -- 172.21.15.50:0/846228779 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7faa980ca520 con 0x7faa98072dc0 2024-04-01T02:12:49.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.889+0000 7faa89ffb640 1 -- 172.21.15.50:0/846228779 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 87103+0+0 (secure 0 0 0) 0x7faa8c00bb80 con 0x7faa98072dc0 2024-04-01T02:12:49.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.889+0000 7faa89ffb640 1 --2- 172.21.15.50:0/846228779 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7faa7c067450 0x7faa7c069910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:49.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.893+0000 7faa89ffb640 1 -- 172.21.15.50:0/846228779 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5738+0+0 (secure 0 0 0) 0x7faa8c086550 con 0x7faa98072dc0 2024-04-01T02:12:49.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.893+0000 7faa89ffb640 1 --2- 172.21.15.50:0/846228779 >> [v2:172.21.15.97:6816/899031308,v1:172.21.15.97:6817/899031308] conn(0x7faa7c06f6b0 0x7faa7c071ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:49.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.893+0000 7faa89ffb640 1 -- 172.21.15.50:0/846228779 --> [v2:172.21.15.97:6816/899031308,v1:172.21.15.97:6817/899031308] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7faa8c001d40 con 0x7faa7c06f6b0 2024-04-01T02:12:49.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.893+0000 7faa89ffb640 1 -- 172.21.15.50:0/846228779 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7faa8c0869e0 con 0x7faa98072dc0 2024-04-01T02:12:49.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.893+0000 7faa9cdf9640 1 --2- 172.21.15.50:0/846228779 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7faa7c067450 0x7faa7c069910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:49.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.893+0000 7faa9ddfb640 1 --2- 172.21.15.50:0/846228779 >> [v2:172.21.15.97:6816/899031308,v1:172.21.15.97:6817/899031308] conn(0x7faa7c06f6b0 0x7faa7c071ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:49.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.893+0000 7faa9ddfb640 1 --2- 172.21.15.50:0/846228779 >> [v2:172.21.15.97:6816/899031308,v1:172.21.15.97:6817/899031308] conn(0x7faa7c06f6b0 0x7faa7c071ad0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:12:49.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.893+0000 7faa9cdf9640 1 --2- 172.21.15.50:0/846228779 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7faa7c067450 0x7faa7c069910 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7faa940af000 tx=0x7faa94008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:12:49.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.893+0000 7faa89ffb640 1 -- 172.21.15.50:0/846228779 <== osd.5 v2:172.21.15.97:6816/899031308 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7faa8c001d40 con 0x7faa7c06f6b0 2024-04-01T02:12:49.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.909+0000 7faa9f85e640 1 -- 172.21.15.50:0/846228779 --> [v2:172.21.15.97:6816/899031308,v1:172.21.15.97:6817/899031308] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7faa98068940 con 0x7faa7c06f6b0 2024-04-01T02:12:49.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.909+0000 7faa89ffb640 1 -- 172.21.15.50:0/846228779 <== osd.5 v2:172.21.15.97:6816/899031308 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7faa98068940 con 0x7faa7c06f6b0 2024-04-01T02:12:49.906 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-04-01T02:12:49.907 INFO:teuthology.orchestra.run.smithi050.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-01T02:12:49.907 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-04-01T02:12:49.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.909+0000 7faa9f85e640 1 -- 172.21.15.50:0/846228779 >> [v2:172.21.15.97:6816/899031308,v1:172.21.15.97:6817/899031308] conn(0x7faa7c06f6b0 msgr2=0x7faa7c071ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:49.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.909+0000 7faa9f85e640 1 --2- 172.21.15.50:0/846228779 >> [v2:172.21.15.97:6816/899031308,v1:172.21.15.97:6817/899031308] conn(0x7faa7c06f6b0 0x7faa7c071ad0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:49.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.909+0000 7faa9f85e640 1 -- 172.21.15.50:0/846228779 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7faa7c067450 msgr2=0x7faa7c069910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:49.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.909+0000 7faa9f85e640 1 --2- 172.21.15.50:0/846228779 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7faa7c067450 0x7faa7c069910 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7faa940af000 tx=0x7faa94008040 comp rx=0 tx=0).stop 2024-04-01T02:12:49.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.909+0000 7faa9f85e640 1 -- 172.21.15.50:0/846228779 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa98072dc0 msgr2=0x7faa9815cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:49.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.909+0000 7faa9f85e640 1 --2- 172.21.15.50:0/846228779 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa98072dc0 0x7faa9815cd00 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7faa8c00d620 tx=0x7faa8c00dae0 comp rx=0 tx=0).stop 2024-04-01T02:12:49.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.909+0000 7faa9ddfb640 1 -- 172.21.15.50:0/846228779 reap_dead start 2024-04-01T02:12:49.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.909+0000 7faa9f85e640 1 -- 172.21.15.50:0/846228779 shutdown_connections 2024-04-01T02:12:49.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.909+0000 7faa9f85e640 1 -- 172.21.15.50:0/846228779 >> 172.21.15.50:0/846228779 conn(0x7faa980cc480 msgr2=0x7faa980ca710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T02:12:49.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.909+0000 7faa9f85e640 1 -- 172.21.15.50:0/846228779 shutdown_connections 2024-04-01T02:12:49.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:49.909+0000 7faa9f85e640 1 -- 172.21.15.50:0/846228779 wait complete. 2024-04-01T02:12:49.924 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-04-01T02:12:50.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.049+0000 7fd330309640 1 Processor -- start 2024-04-01T02:12:50.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.049+0000 7fd330309640 1 -- start start 2024-04-01T02:12:50.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.049+0000 7fd330309640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd3280c5c70 0x7fd3280c3400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:50.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.049+0000 7fd330309640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd3280cc470 0x7fd3280723a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:50.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.049+0000 7fd330309640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3280c95a0 con 0x7fd3280c6050 2024-04-01T02:12:50.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.049+0000 7fd330309640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fd3281582b0 con 0x7fd3280c5c70 2024-04-01T02:12:50.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.049+0000 7fd330309640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fd328072f30 con 0x7fd3280cc470 2024-04-01T02:12:50.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.049+0000 7fd32e0a5640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd3280c5c70 0x7fd3280c3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:50.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.049+0000 7fd32e8a6640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fd3280c6050 0x7fd328158740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39264/0 (socket says 172.21.15.50:39264) 2024-04-01T02:12:50.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.049+0000 7fd32e8a6640 1 -- 172.21.15.50:0/3717146911 learned_addr learned my addr 172.21.15.50:0/3717146911 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-04-01T02:12:50.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.049+0000 7fd32e0a5640 1 --2- 172.21.15.50:0/3717146911 >> v2:172.21.15.50:3300/0 conn(0x7fd3280c5c70 0x7fd3280c3400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59554/0 (socket says 172.21.15.50:59554) 2024-04-01T02:12:50.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.049+0000 7fd32d8a4640 1 --2- 172.21.15.50:0/3717146911 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd3280cc470 0x7fd3280723a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:50.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.049+0000 7fd32e0a5640 1 -- 172.21.15.50:0/3717146911 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd3280cc470 msgr2=0x7fd3280723a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T02:12:50.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.049+0000 7fd32e0a5640 1 --2- 172.21.15.50:0/3717146911 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd3280cc470 0x7fd3280723a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:50.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.049+0000 7fd32e0a5640 1 -- 172.21.15.50:0/3717146911 >> v1:172.21.15.50:6789/0 conn(0x7fd3280c6050 legacy=0x7fd328158740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:50.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.049+0000 7fd32e0a5640 1 -- 172.21.15.50:0/3717146911 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3280c6500 con 0x7fd3280c5c70 2024-04-01T02:12:50.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.053+0000 7fd32e0a5640 1 --2- 172.21.15.50:0/3717146911 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3280c5c70 0x7fd3280c3400 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fd3200097c0 tx=0x7fd32001ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b92ba4ccdc10842 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:12:50.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.053+0000 7fd32d0a3640 1 -- 172.21.15.50:0/3717146911 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3200b5070 con 0x7fd3280c5c70 2024-04-01T02:12:50.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.053+0000 7fd32d0a3640 1 -- 172.21.15.50:0/3717146911 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3200a8990 con 0x7fd3280c5c70 2024-04-01T02:12:50.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.053+0000 7fd32d0a3640 1 -- 172.21.15.50:0/3717146911 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3200a8d60 con 0x7fd3280c5c70 2024-04-01T02:12:50.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.053+0000 7fd330309640 1 -- 172.21.15.50:0/3717146911 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3280c5c70 msgr2=0x7fd3280c3400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:50.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.053+0000 7fd330309640 1 --2- 172.21.15.50:0/3717146911 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3280c5c70 0x7fd3280c3400 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fd3200097c0 tx=0x7fd32001ec90 comp rx=0 tx=0).stop 2024-04-01T02:12:50.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.053+0000 7fd330309640 1 -- 172.21.15.50:0/3717146911 shutdown_connections 2024-04-01T02:12:50.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.053+0000 7fd330309640 1 --2- 172.21.15.50:0/3717146911 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd3280cc470 0x7fd3280723a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:50.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.053+0000 7fd330309640 1 --2- 172.21.15.50:0/3717146911 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3280c5c70 0x7fd3280c3400 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:50.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.053+0000 7fd330309640 1 -- 172.21.15.50:0/3717146911 >> 172.21.15.50:0/3717146911 conn(0x7fd328067130 msgr2=0x7fd32806c330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T02:12:50.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.053+0000 7fd330309640 1 -- 172.21.15.50:0/3717146911 shutdown_connections 2024-04-01T02:12:50.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.053+0000 7fd330309640 1 -- 172.21.15.50:0/3717146911 wait complete. 2024-04-01T02:12:50.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.053+0000 7fd330309640 1 Processor -- start 2024-04-01T02:12:50.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.053+0000 7fd330309640 1 -- start start 2024-04-01T02:12:50.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.053+0000 7fd330309640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd3280c5c70 0x7fd32814b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:50.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.053+0000 7fd330309640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd3280c6050 0x7fd3281f37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:50.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.053+0000 7fd330309640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3280cc470 0x7fd3281f3d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:50.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.053+0000 7fd330309640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd3280c9a70 con 0x7fd3280cc470 2024-04-01T02:12:50.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.053+0000 7fd330309640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fd3280c9790 con 0x7fd3280c6050 2024-04-01T02:12:50.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.053+0000 7fd330309640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fd328157f40 con 0x7fd3280c5c70 2024-04-01T02:12:50.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.053+0000 7fd32e8a6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3280cc470 0x7fd3281f3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:50.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.053+0000 7fd32e8a6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3280cc470 0x7fd3281f3d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59556/0 (socket says 172.21.15.50:59556) 2024-04-01T02:12:50.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.053+0000 7fd32e8a6640 1 -- 172.21.15.50:0/2079212667 learned_addr learned my addr 172.21.15.50:0/2079212667 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T02:12:50.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.057+0000 7fd32e0a5640 1 --2- 172.21.15.50:0/2079212667 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd3280c5c70 0x7fd32814b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:50.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.057+0000 7fd32d8a4640 1 --2- 172.21.15.50:0/2079212667 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd3280c6050 0x7fd3281f37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:50.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.057+0000 7fd32e8a6640 1 -- 172.21.15.50:0/2079212667 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd3280c5c70 msgr2=0x7fd32814b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:50.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.057+0000 7fd32e8a6640 1 --2- 172.21.15.50:0/2079212667 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd3280c5c70 0x7fd32814b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:50.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.057+0000 7fd32e8a6640 1 -- 172.21.15.50:0/2079212667 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd3280c6050 msgr2=0x7fd3281f37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:50.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.057+0000 7fd32e8a6640 1 --2- 172.21.15.50:0/2079212667 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd3280c6050 0x7fd3281f37d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:50.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.057+0000 7fd32e8a6640 1 -- 172.21.15.50:0/2079212667 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd328068b50 con 0x7fd3280cc470 2024-04-01T02:12:50.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.057+0000 7fd32e8a6640 1 --2- 172.21.15.50:0/2079212667 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3280cc470 0x7fd3281f3d10 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fd32400cbc0 tx=0x7fd32400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:12:50.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.057+0000 7fd31effd640 1 -- 172.21.15.50:0/2079212667 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd324017070 con 0x7fd3280cc470 2024-04-01T02:12:50.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.057+0000 7fd31effd640 1 -- 172.21.15.50:0/2079212667 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd32400ad40 con 0x7fd3280cc470 2024-04-01T02:12:50.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.057+0000 7fd330309640 1 -- 172.21.15.50:0/2079212667 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3281f0050 con 0x7fd3280cc470 2024-04-01T02:12:50.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.057+0000 7fd31effd640 1 -- 172.21.15.50:0/2079212667 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd324012600 con 0x7fd3280cc470 2024-04-01T02:12:50.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.057+0000 7fd330309640 1 -- 172.21.15.50:0/2079212667 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3281f0610 con 0x7fd3280cc470 2024-04-01T02:12:50.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.057+0000 7fd330309640 1 -- 172.21.15.50:0/2079212667 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd328068940 con 0x7fd3280cc470 2024-04-01T02:12:50.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.057+0000 7fd31effd640 1 -- 172.21.15.50:0/2079212667 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 87103+0+0 (secure 0 0 0) 0x7fd32401a070 con 0x7fd3280cc470 2024-04-01T02:12:50.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.057+0000 7fd31effd640 1 --2- 172.21.15.50:0/2079212667 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fd30c067420 0x7fd30c0698e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:50.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.057+0000 7fd31effd640 1 -- 172.21.15.50:0/2079212667 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5738+0+0 (secure 0 0 0) 0x7fd3240853b0 con 0x7fd3280cc470 2024-04-01T02:12:50.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.057+0000 7fd32e0a5640 1 --2- 172.21.15.50:0/2079212667 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fd30c067420 0x7fd30c0698e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:50.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.057+0000 7fd32e0a5640 1 --2- 172.21.15.50:0/2079212667 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fd30c067420 0x7fd30c0698e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd3200b2000 tx=0x7fd320008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:12:50.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.061+0000 7fd31effd640 1 -- 172.21.15.50:0/2079212667 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+176632 (secure 0 0 0) 0x7fd324055a50 con 0x7fd3280cc470 2024-04-01T02:12:50.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.225+0000 7fd330309640 1 -- 172.21.15.50:0/2079212667 --> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7fd3280c9ec0 con 0x7fd30c067420 2024-04-01T02:12:50.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.225+0000 7fd31effd640 1 -- 172.21.15.50:0/2079212667 <== mgr.4103 v2:172.21.15.97:6832/1677467570 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fd3280c9ec0 con 0x7fd30c067420 2024-04-01T02:12:50.223 INFO:teuthology.orchestra.run.smithi050.stderr:instructed osd(s) 5 to deep-scrub 2024-04-01T02:12:50.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.225+0000 7fd330309640 1 -- 172.21.15.50:0/2079212667 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fd30c067420 msgr2=0x7fd30c0698e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:50.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.225+0000 7fd330309640 1 --2- 172.21.15.50:0/2079212667 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fd30c067420 0x7fd30c0698e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd3200b2000 tx=0x7fd320008040 comp rx=0 tx=0).stop 2024-04-01T02:12:50.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.225+0000 7fd330309640 1 -- 172.21.15.50:0/2079212667 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3280cc470 msgr2=0x7fd3281f3d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:50.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.225+0000 7fd330309640 1 --2- 172.21.15.50:0/2079212667 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3280cc470 0x7fd3281f3d10 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fd32400cbc0 tx=0x7fd32400a430 comp rx=0 tx=0).stop 2024-04-01T02:12:50.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.225+0000 7fd330309640 1 -- 172.21.15.50:0/2079212667 shutdown_connections 2024-04-01T02:12:50.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.225+0000 7fd330309640 1 --2- 172.21.15.50:0/2079212667 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fd30c067420 0x7fd30c0698e0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:50.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.225+0000 7fd330309640 1 --2- 172.21.15.50:0/2079212667 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3280cc470 0x7fd3281f3d10 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:50.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.225+0000 7fd330309640 1 --2- 172.21.15.50:0/2079212667 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd3280c6050 0x7fd3281f37d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:50.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.225+0000 7fd330309640 1 --2- 172.21.15.50:0/2079212667 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd3280c5c70 0x7fd32814b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:50.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.225+0000 7fd330309640 1 -- 172.21.15.50:0/2079212667 >> 172.21.15.50:0/2079212667 conn(0x7fd328067130 msgr2=0x7fd32814fa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T02:12:50.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.225+0000 7fd330309640 1 -- 172.21.15.50:0/2079212667 shutdown_connections 2024-04-01T02:12:50.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.225+0000 7fd330309640 1 -- 172.21.15.50:0/2079212667 wait complete. 2024-04-01T02:12:50.243 INFO:tasks.ceph:Scrubbing osd.6 2024-04-01T02:12:50.243 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-04-01T02:12:50.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.369+0000 7ff2be5f5640 1 Processor -- start 2024-04-01T02:12:50.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.369+0000 7ff2be5f5640 1 -- start start 2024-04-01T02:12:50.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.369+0000 7ff2be5f5640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff2b815e940 0x7ff2b80c77d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:50.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.369+0000 7ff2be5f5640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2b81624e0 con 0x7ff2b8158460 2024-04-01T02:12:50.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.369+0000 7ff2be5f5640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2b80c61c0 con 0x7ff2b8162010 2024-04-01T02:12:50.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.369+0000 7ff2be5f5640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7ff2b80c7d10 con 0x7ff2b815e940 2024-04-01T02:12:50.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.369+0000 7ff2b7fff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ff2b8158460 0x7ff2b806b220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39268/0 (socket says 172.21.15.50:39268) 2024-04-01T02:12:50.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.369+0000 7ff2b7fff640 1 -- 172.21.15.50:0/4068003634 learned_addr learned my addr 172.21.15.50:0/4068003634 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-04-01T02:12:50.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.369+0000 7ff2bcb92640 1 --2- 172.21.15.50:0/4068003634 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff2b815e940 0x7ff2b80c77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:50.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.373+0000 7ff2b6ffd640 1 -- 172.21.15.50:0/4068003634 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 893810018 0 0) 0x7ff2b81624e0 con 0x7ff2b8158460 2024-04-01T02:12:50.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.373+0000 7ff2b6ffd640 1 -- 172.21.15.50:0/4068003634 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff2a4003530 con 0x7ff2b8158460 2024-04-01T02:12:50.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.373+0000 7ff2b6ffd640 1 -- 172.21.15.50:0/4068003634 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3566556473 0 0) 0x7ff2a4003530 con 0x7ff2b8158460 2024-04-01T02:12:50.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.373+0000 7ff2b6ffd640 1 -- 172.21.15.50:0/4068003634 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff2b815e940 msgr2=0x7ff2b80c77d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T02:12:50.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.373+0000 7ff2b6ffd640 1 --2- 172.21.15.50:0/4068003634 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff2b815e940 0x7ff2b80c77d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:50.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.373+0000 7ff2b6ffd640 1 -- 172.21.15.50:0/4068003634 >> v1:172.21.15.97:6789/0 conn(0x7ff2b8162010 legacy=0x7ff2b815e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:50.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.373+0000 7ff2b6ffd640 1 -- 172.21.15.50:0/4068003634 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2b80c64a0 con 0x7ff2b8158460 2024-04-01T02:12:50.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.373+0000 7ff2b6ffd640 1 -- 172.21.15.50:0/4068003634 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2779672543 0 0) 0x7ff2a0001680 con 0x7ff2b8158460 2024-04-01T02:12:50.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.373+0000 7ff2b6ffd640 1 -- 172.21.15.50:0/4068003634 >> v1:172.21.15.50:6789/0 conn(0x7ff2b8158460 legacy=0x7ff2b806b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:50.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.373+0000 7ff2b6ffd640 1 --2- 172.21.15.50:0/4068003634 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff2a40039f0 0x7ff2a4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:50.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.373+0000 7ff2b6ffd640 1 --2- 172.21.15.50:0/4068003634 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2a40043a0 0x7ff2a4004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:50.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.373+0000 7ff2b6ffd640 1 --2- 172.21.15.50:0/4068003634 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff2b815e940 0x7ff2a40050d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:50.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.373+0000 7ff2b6ffd640 1 -- 172.21.15.50:0/4068003634 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff2b80c7d10 con 0x7ff2a40043a0 2024-04-01T02:12:50.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.373+0000 7ff2b6ffd640 1 -- 172.21.15.50:0/4068003634 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7ff2a400b9d0 con 0x7ff2a40039f0 2024-04-01T02:12:50.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.373+0000 7ff2b6ffd640 1 -- 172.21.15.50:0/4068003634 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7ff2a400bbd0 con 0x7ff2b815e940 2024-04-01T02:12:50.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.373+0000 7ff2b77fe640 1 --2- 172.21.15.50:0/4068003634 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2a40043a0 0x7ff2a4004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:50.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.373+0000 7ff2b7fff640 1 --2- 172.21.15.50:0/4068003634 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff2a40039f0 0x7ff2a4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:50.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.373+0000 7ff2bcb92640 1 --2- 172.21.15.50:0/4068003634 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff2b815e940 0x7ff2a40050d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:50.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.373+0000 7ff2b77fe640 1 -- 172.21.15.50:0/4068003634 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff2b815e940 msgr2=0x7ff2a40050d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T02:12:50.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.373+0000 7ff2b77fe640 1 --2- 172.21.15.50:0/4068003634 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff2b815e940 0x7ff2a40050d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:50.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.373+0000 7ff2b77fe640 1 -- 172.21.15.50:0/4068003634 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff2a40039f0 msgr2=0x7ff2a4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T02:12:50.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.373+0000 7ff2b77fe640 1 --2- 172.21.15.50:0/4068003634 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff2a40039f0 0x7ff2a4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:50.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.373+0000 7ff2b77fe640 1 -- 172.21.15.50:0/4068003634 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2a4003530 con 0x7ff2a40043a0 2024-04-01T02:12:50.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.373+0000 7ff2b7fff640 1 --2- 172.21.15.50:0/4068003634 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff2a40039f0 0x7ff2a4003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T02:12:50.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.373+0000 7ff2b77fe640 1 --2- 172.21.15.50:0/4068003634 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2a40043a0 0x7ff2a4004870 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ff2a8001860 tx=0x7ff2a801ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3af546fd8e3afd8d server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:12:50.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.373+0000 7ff2b6ffd640 1 -- 172.21.15.50:0/4068003634 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2a80b5070 con 0x7ff2a40043a0 2024-04-01T02:12:50.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.373+0000 7ff2b6ffd640 1 -- 172.21.15.50:0/4068003634 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2a80a8890 con 0x7ff2a40043a0 2024-04-01T02:12:50.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.373+0000 7ff2b6ffd640 1 -- 172.21.15.50:0/4068003634 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2a8001460 con 0x7ff2a40043a0 2024-04-01T02:12:50.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.373+0000 7ff2be5f5640 1 -- 172.21.15.50:0/4068003634 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2a40043a0 msgr2=0x7ff2a4004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:50.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.373+0000 7ff2be5f5640 1 --2- 172.21.15.50:0/4068003634 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2a40043a0 0x7ff2a4004870 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ff2a8001860 tx=0x7ff2a801ec70 comp rx=0 tx=0).stop 2024-04-01T02:12:50.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.373+0000 7ff2bcb92640 1 -- 172.21.15.50:0/4068003634 reap_dead start 2024-04-01T02:12:50.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.373+0000 7ff2be5f5640 1 -- 172.21.15.50:0/4068003634 shutdown_connections 2024-04-01T02:12:50.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.373+0000 7ff2be5f5640 1 -- 172.21.15.50:0/4068003634 >> 172.21.15.50:0/4068003634 conn(0x7ff2b80cb560 msgr2=0x7ff2b80cb970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T02:12:50.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.373+0000 7ff2be5f5640 1 -- 172.21.15.50:0/4068003634 shutdown_connections 2024-04-01T02:12:50.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.373+0000 7ff2be5f5640 1 -- 172.21.15.50:0/4068003634 wait complete. 2024-04-01T02:12:50.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.377+0000 7ff2be5f5640 1 Processor -- start 2024-04-01T02:12:50.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.377+0000 7ff2be5f5640 1 -- start start 2024-04-01T02:12:50.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.377+0000 7ff2be5f5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2a40043a0 0x7ff2b81610a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:50.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.377+0000 7ff2be5f5640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff2b80c9290 0x7ff2b815f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:50.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.377+0000 7ff2be5f5640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff2b8156120 0x7ff2b806e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:50.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.377+0000 7ff2be5f5640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff2b806b930 con 0x7ff2a40043a0 2024-04-01T02:12:50.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.377+0000 7ff2be5f5640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7ff2b80716d0 con 0x7ff2b80c9290 2024-04-01T02:12:50.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.377+0000 7ff2be5f5640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7ff2b806bab0 con 0x7ff2b8156120 2024-04-01T02:12:50.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.377+0000 7ff2b7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2a40043a0 0x7ff2b81610a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:50.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.377+0000 7ff2b7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2a40043a0 0x7ff2b81610a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59566/0 (socket says 172.21.15.50:59566) 2024-04-01T02:12:50.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.377+0000 7ff2b7fff640 1 -- 172.21.15.50:0/2678937506 learned_addr learned my addr 172.21.15.50:0/2678937506 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T02:12:50.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.377+0000 7ff2bcb92640 1 --2- 172.21.15.50:0/2678937506 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff2b8156120 0x7ff2b806e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:50.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.377+0000 7ff2b7fff640 1 -- 172.21.15.50:0/2678937506 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff2b8156120 msgr2=0x7ff2b806e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:50.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.377+0000 7ff2b7fff640 1 --2- 172.21.15.50:0/2678937506 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff2b8156120 0x7ff2b806e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:50.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.377+0000 7ff2b77fe640 1 --2- 172.21.15.50:0/2678937506 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff2b80c9290 0x7ff2b815f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:50.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.377+0000 7ff2b7fff640 1 -- 172.21.15.50:0/2678937506 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff2b80c9290 msgr2=0x7ff2b815f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:50.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.377+0000 7ff2b7fff640 1 --2- 172.21.15.50:0/2678937506 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff2b80c9290 0x7ff2b815f1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:50.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.377+0000 7ff2b7fff640 1 -- 172.21.15.50:0/2678937506 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2b8161980 con 0x7ff2a40043a0 2024-04-01T02:12:50.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.377+0000 7ff2b7fff640 1 --2- 172.21.15.50:0/2678937506 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2a40043a0 0x7ff2b81610a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff2a000e7b0 tx=0x7ff2a000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:12:50.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.377+0000 7ff2b4ff9640 1 -- 172.21.15.50:0/2678937506 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2a000c870 con 0x7ff2a40043a0 2024-04-01T02:12:50.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.377+0000 7ff2b4ff9640 1 -- 172.21.15.50:0/2678937506 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2a0018070 con 0x7ff2a40043a0 2024-04-01T02:12:50.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.377+0000 7ff2be5f5640 1 -- 172.21.15.50:0/2678937506 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2b81f4ea0 con 0x7ff2a40043a0 2024-04-01T02:12:50.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.377+0000 7ff2b4ff9640 1 -- 172.21.15.50:0/2678937506 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2a000cc50 con 0x7ff2a40043a0 2024-04-01T02:12:50.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.377+0000 7ff2be5f5640 1 -- 172.21.15.50:0/2678937506 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2b81f4bc0 con 0x7ff2a40043a0 2024-04-01T02:12:50.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.377+0000 7ff2be5f5640 1 -- 172.21.15.50:0/2678937506 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff2b8068230 con 0x7ff2a40043a0 2024-04-01T02:12:50.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.381+0000 7ff2b4ff9640 1 -- 172.21.15.50:0/2678937506 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 87103+0+0 (secure 0 0 0) 0x7ff2a0026430 con 0x7ff2a40043a0 2024-04-01T02:12:50.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.381+0000 7ff2b4ff9640 1 --2- 172.21.15.50:0/2678937506 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7ff298067450 0x7ff298069910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:50.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.381+0000 7ff2b4ff9640 1 -- 172.21.15.50:0/2678937506 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5738+0+0 (secure 0 0 0) 0x7ff2a0085d70 con 0x7ff2a40043a0 2024-04-01T02:12:50.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.381+0000 7ff2b4ff9640 1 --2- 172.21.15.50:0/2678937506 >> [v2:172.21.15.97:6824/2224814961,v1:172.21.15.97:6825/2224814961] conn(0x7ff29806f6b0 0x7ff298071ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:50.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.381+0000 7ff2b4ff9640 1 -- 172.21.15.50:0/2678937506 --> [v2:172.21.15.97:6824/2224814961,v1:172.21.15.97:6825/2224814961] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff2a0020ec0 con 0x7ff29806f6b0 2024-04-01T02:12:50.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.381+0000 7ff2b4ff9640 1 -- 172.21.15.50:0/2678937506 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7ff2a0086120 con 0x7ff2a40043a0 2024-04-01T02:12:50.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.381+0000 7ff2b77fe640 1 --2- 172.21.15.50:0/2678937506 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7ff298067450 0x7ff298069910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:50.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.381+0000 7ff2bcb92640 1 --2- 172.21.15.50:0/2678937506 >> [v2:172.21.15.97:6824/2224814961,v1:172.21.15.97:6825/2224814961] conn(0x7ff29806f6b0 0x7ff298071ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:50.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.381+0000 7ff2b77fe640 1 --2- 172.21.15.50:0/2678937506 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7ff298067450 0x7ff298069910 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff2a8001860 tx=0x7ff2a80aa070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:12:50.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.381+0000 7ff2bcb92640 1 --2- 172.21.15.50:0/2678937506 >> [v2:172.21.15.97:6824/2224814961,v1:172.21.15.97:6825/2224814961] conn(0x7ff29806f6b0 0x7ff298071ad0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:12:50.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.381+0000 7ff2b4ff9640 1 -- 172.21.15.50:0/2678937506 <== osd.6 v2:172.21.15.97:6824/2224814961 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff2a0020ec0 con 0x7ff29806f6b0 2024-04-01T02:12:50.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.397+0000 7ff2be5f5640 1 -- 172.21.15.50:0/2678937506 --> [v2:172.21.15.97:6824/2224814961,v1:172.21.15.97:6825/2224814961] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ff2b80c74c0 con 0x7ff29806f6b0 2024-04-01T02:12:50.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.397+0000 7ff2b4ff9640 1 -- 172.21.15.50:0/2678937506 <== osd.6 v2:172.21.15.97:6824/2224814961 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7ff2b80c74c0 con 0x7ff29806f6b0 2024-04-01T02:12:50.396 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-04-01T02:12:50.397 INFO:teuthology.orchestra.run.smithi050.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-01T02:12:50.397 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-04-01T02:12:50.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.397+0000 7ff2be5f5640 1 -- 172.21.15.50:0/2678937506 >> [v2:172.21.15.97:6824/2224814961,v1:172.21.15.97:6825/2224814961] conn(0x7ff29806f6b0 msgr2=0x7ff298071ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:50.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.397+0000 7ff2be5f5640 1 --2- 172.21.15.50:0/2678937506 >> [v2:172.21.15.97:6824/2224814961,v1:172.21.15.97:6825/2224814961] conn(0x7ff29806f6b0 0x7ff298071ad0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:50.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.397+0000 7ff2be5f5640 1 -- 172.21.15.50:0/2678937506 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7ff298067450 msgr2=0x7ff298069910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:50.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.397+0000 7ff2be5f5640 1 --2- 172.21.15.50:0/2678937506 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7ff298067450 0x7ff298069910 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff2a8001860 tx=0x7ff2a80aa070 comp rx=0 tx=0).stop 2024-04-01T02:12:50.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.397+0000 7ff2be5f5640 1 -- 172.21.15.50:0/2678937506 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2a40043a0 msgr2=0x7ff2b81610a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:50.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.397+0000 7ff2be5f5640 1 --2- 172.21.15.50:0/2678937506 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2a40043a0 0x7ff2b81610a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff2a000e7b0 tx=0x7ff2a000ec70 comp rx=0 tx=0).stop 2024-04-01T02:12:50.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.397+0000 7ff2bcb92640 1 -- 172.21.15.50:0/2678937506 reap_dead start 2024-04-01T02:12:50.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.397+0000 7ff2be5f5640 1 -- 172.21.15.50:0/2678937506 shutdown_connections 2024-04-01T02:12:50.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.397+0000 7ff2be5f5640 1 -- 172.21.15.50:0/2678937506 >> 172.21.15.50:0/2678937506 conn(0x7ff2b80cb560 msgr2=0x7ff2b80cb940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T02:12:50.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.397+0000 7ff2be5f5640 1 -- 172.21.15.50:0/2678937506 shutdown_connections 2024-04-01T02:12:50.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.397+0000 7ff2be5f5640 1 -- 172.21.15.50:0/2678937506 wait complete. 2024-04-01T02:12:50.415 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-04-01T02:12:50.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.537+0000 7f90ab902640 1 Processor -- start 2024-04-01T02:12:50.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.537+0000 7f90ab902640 1 -- start start 2024-04-01T02:12:50.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.537+0000 7f90ab902640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f90a40c7850 0x7f90a4163570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:50.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.537+0000 7f90ab902640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90a40c30d0 con 0x7f90a4151de0 2024-04-01T02:12:50.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.537+0000 7f90ab902640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90a415b370 con 0x7f90a40c2900 2024-04-01T02:12:50.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.537+0000 7f90ab902640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f90a415c0f0 con 0x7f90a40c7850 2024-04-01T02:12:50.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.537+0000 7f90a969e640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f90a4151de0 0x7f90a4157be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39278/0 (socket says 172.21.15.50:39278) 2024-04-01T02:12:50.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.537+0000 7f90a969e640 1 -- 172.21.15.50:0/2587759080 learned_addr learned my addr 172.21.15.50:0/2587759080 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-04-01T02:12:50.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.537+0000 7f90a9e9f640 1 --2- 172.21.15.50:0/2587759080 >> v2:172.21.15.97:3300/0 conn(0x7f90a40c7850 0x7f90a4163570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:50.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.537+0000 7f909bfff640 1 -- 172.21.15.50:0/2587759080 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1135106586 0 0) 0x7f90a40c30d0 con 0x7f90a4151de0 2024-04-01T02:12:50.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.537+0000 7f909bfff640 1 -- 172.21.15.50:0/2587759080 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9090003530 con 0x7f90a4151de0 2024-04-01T02:12:50.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.537+0000 7f909bfff640 1 -- 172.21.15.50:0/2587759080 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3993864328 0 0) 0x7f9090003530 con 0x7f90a4151de0 2024-04-01T02:12:50.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.537+0000 7f909bfff640 1 -- 172.21.15.50:0/2587759080 >> v2:172.21.15.97:3300/0 conn(0x7f90a40c7850 msgr2=0x7f90a4163570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T02:12:50.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.537+0000 7f909bfff640 1 --2- 172.21.15.50:0/2587759080 >> v2:172.21.15.97:3300/0 conn(0x7f90a40c7850 0x7f90a4163570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:50.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.537+0000 7f909bfff640 1 -- 172.21.15.50:0/2587759080 >> v1:172.21.15.97:6789/0 conn(0x7f90a40c2900 legacy=0x7f90a40c5f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:50.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.537+0000 7f909bfff640 1 -- 172.21.15.50:0/2587759080 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90a40c2df0 con 0x7f90a4151de0 2024-04-01T02:12:50.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.541+0000 7f909bfff640 1 -- 172.21.15.50:0/2587759080 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2779672543 0 0) 0x7f90a0001a00 con 0x7f90a4151de0 2024-04-01T02:12:50.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.541+0000 7f909bfff640 1 -- 172.21.15.50:0/2587759080 >> v1:172.21.15.50:6789/0 conn(0x7f90a4151de0 legacy=0x7f90a4157be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:50.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.541+0000 7f909bfff640 1 --2- 172.21.15.50:0/2587759080 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f90900039c0 0x7f9090003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:50.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.541+0000 7f909bfff640 1 --2- 172.21.15.50:0/2587759080 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9090004810 0x7f9090004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:50.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.541+0000 7f909bfff640 1 --2- 172.21.15.50:0/2587759080 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f90900051d0 0x7f909000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:50.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.541+0000 7f909bfff640 1 -- 172.21.15.50:0/2587759080 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f90a415c0f0 con 0x7f9090004810 2024-04-01T02:12:50.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.541+0000 7f909bfff640 1 -- 172.21.15.50:0/2587759080 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f909000c070 con 0x7f90900051d0 2024-04-01T02:12:50.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.541+0000 7f909bfff640 1 -- 172.21.15.50:0/2587759080 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f909000c270 con 0x7f90900039c0 2024-04-01T02:12:50.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.541+0000 7f90a8e9d640 1 --2- 172.21.15.50:0/2587759080 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9090004810 0x7f9090004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:50.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.541+0000 7f90a969e640 1 --2- 172.21.15.50:0/2587759080 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f90900039c0 0x7f9090003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:50.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.541+0000 7f90a9e9f640 1 --2- 172.21.15.50:0/2587759080 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f90900051d0 0x7f909000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:50.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.541+0000 7f90a8e9d640 1 -- 172.21.15.50:0/2587759080 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f90900039c0 msgr2=0x7f9090003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T02:12:50.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.541+0000 7f90a8e9d640 1 --2- 172.21.15.50:0/2587759080 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f90900039c0 0x7f9090003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:50.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.541+0000 7f90a8e9d640 1 -- 172.21.15.50:0/2587759080 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f90900051d0 msgr2=0x7f909000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T02:12:50.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.541+0000 7f90a8e9d640 1 --2- 172.21.15.50:0/2587759080 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f90900051d0 0x7f909000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:50.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.541+0000 7f90a8e9d640 1 -- 172.21.15.50:0/2587759080 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9090003530 con 0x7f9090004810 2024-04-01T02:12:50.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.541+0000 7f90a9e9f640 1 -- 172.21.15.50:0/2587759080 reap_dead start 2024-04-01T02:12:50.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.541+0000 7f90a8e9d640 1 --2- 172.21.15.50:0/2587759080 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9090004810 0x7f9090004c90 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f9094001780 tx=0x7f909401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9ad6ea98bc618db server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:12:50.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.541+0000 7f909bfff640 1 -- 172.21.15.50:0/2587759080 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90940013a0 con 0x7f9090004810 2024-04-01T02:12:50.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.541+0000 7f909bfff640 1 -- 172.21.15.50:0/2587759080 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90940052f0 con 0x7f9090004810 2024-04-01T02:12:50.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.541+0000 7f909bfff640 1 -- 172.21.15.50:0/2587759080 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9094003840 con 0x7f9090004810 2024-04-01T02:12:50.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.541+0000 7f90ab902640 1 -- 172.21.15.50:0/2587759080 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9090004810 msgr2=0x7f9090004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:50.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.541+0000 7f90ab902640 1 --2- 172.21.15.50:0/2587759080 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9090004810 0x7f9090004c90 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f9094001780 tx=0x7f909401c400 comp rx=0 tx=0).stop 2024-04-01T02:12:50.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.541+0000 7f90ab902640 1 -- 172.21.15.50:0/2587759080 shutdown_connections 2024-04-01T02:12:50.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.541+0000 7f90ab902640 1 --2- 172.21.15.50:0/2587759080 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9090004810 0x7f9090004c90 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:50.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.541+0000 7f90ab902640 1 -- 172.21.15.50:0/2587759080 >> 172.21.15.50:0/2587759080 conn(0x7f90a4067560 msgr2=0x7f90a406b220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T02:12:50.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.541+0000 7f90ab902640 1 -- 172.21.15.50:0/2587759080 shutdown_connections 2024-04-01T02:12:50.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.541+0000 7f90ab902640 1 -- 172.21.15.50:0/2587759080 wait complete. 2024-04-01T02:12:50.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.545+0000 7f90ab902640 1 Processor -- start 2024-04-01T02:12:50.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.545+0000 7f90ab902640 1 -- start start 2024-04-01T02:12:50.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.545+0000 7f90ab902640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9090004810 0x7f90a41584c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:50.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.545+0000 7f90ab902640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f90a41e3700 0x7f90a4143ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:50.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.545+0000 7f90ab902640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90a4144000 0x7f90a41e1090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:50.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.545+0000 7f90ab902640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f90a415bbd0 con 0x7f90a4144000 2024-04-01T02:12:50.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.545+0000 7f90ab902640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f90a415b8f0 con 0x7f90a41e3700 2024-04-01T02:12:50.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.545+0000 7f90ab902640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f90a40c88a0 con 0x7f9090004810 2024-04-01T02:12:50.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.545+0000 7f90a9e9f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90a4144000 0x7f90a41e1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:50.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.545+0000 7f90a9e9f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90a4144000 0x7f90a41e1090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59586/0 (socket says 172.21.15.50:59586) 2024-04-01T02:12:50.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.545+0000 7f90a9e9f640 1 -- 172.21.15.50:0/1922668147 learned_addr learned my addr 172.21.15.50:0/1922668147 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T02:12:50.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.545+0000 7f90a969e640 1 --2- 172.21.15.50:0/1922668147 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9090004810 0x7f90a41584c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:50.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.545+0000 7f90a8e9d640 1 --2- 172.21.15.50:0/1922668147 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f90a41e3700 0x7f90a4143ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:50.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.545+0000 7f90a9e9f640 1 -- 172.21.15.50:0/1922668147 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9090004810 msgr2=0x7f90a41584c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:50.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.545+0000 7f90a9e9f640 1 --2- 172.21.15.50:0/1922668147 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9090004810 0x7f90a41584c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:50.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.545+0000 7f90a9e9f640 1 -- 172.21.15.50:0/1922668147 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f90a41e3700 msgr2=0x7f90a4143ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:50.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.545+0000 7f90a9e9f640 1 --2- 172.21.15.50:0/1922668147 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f90a41e3700 0x7f90a4143ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:50.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.545+0000 7f90a9e9f640 1 -- 172.21.15.50:0/1922668147 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90a41ed860 con 0x7f90a4144000 2024-04-01T02:12:50.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.545+0000 7f90a969e640 1 --2- 172.21.15.50:0/1922668147 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9090004810 0x7f90a41584c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T02:12:50.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.545+0000 7f90a9e9f640 1 --2- 172.21.15.50:0/1922668147 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90a4144000 0x7f90a41e1090 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f909c011490 tx=0x7f909c011950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:12:50.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.545+0000 7f9099ffb640 1 -- 172.21.15.50:0/1922668147 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f909c015930 con 0x7f90a4144000 2024-04-01T02:12:50.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.545+0000 7f9099ffb640 1 -- 172.21.15.50:0/1922668147 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f909c01c070 con 0x7f90a4144000 2024-04-01T02:12:50.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.545+0000 7f90ab902640 1 -- 172.21.15.50:0/1922668147 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90a4158a00 con 0x7f90a4144000 2024-04-01T02:12:50.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.545+0000 7f9099ffb640 1 -- 172.21.15.50:0/1922668147 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f909c015d10 con 0x7f90a4144000 2024-04-01T02:12:50.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.545+0000 7f90ab902640 1 -- 172.21.15.50:0/1922668147 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90a41e1c50 con 0x7f90a4144000 2024-04-01T02:12:50.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.545+0000 7f90ab902640 1 -- 172.21.15.50:0/1922668147 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90a4068230 con 0x7f90a4144000 2024-04-01T02:12:50.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.545+0000 7f9099ffb640 1 -- 172.21.15.50:0/1922668147 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 87103+0+0 (secure 0 0 0) 0x7f909c020410 con 0x7f90a4144000 2024-04-01T02:12:50.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.549+0000 7f9099ffb640 1 --2- 172.21.15.50:0/1922668147 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f9088067420 0x7f90880698e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:50.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.549+0000 7f9099ffb640 1 -- 172.21.15.50:0/1922668147 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5738+0+0 (secure 0 0 0) 0x7f909c085460 con 0x7f90a4144000 2024-04-01T02:12:50.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.549+0000 7f90a969e640 1 --2- 172.21.15.50:0/1922668147 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f9088067420 0x7f90880698e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:50.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.549+0000 7f90a969e640 1 --2- 172.21.15.50:0/1922668147 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f9088067420 0x7f90880698e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f90a00013e0 tx=0x7f90a0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:12:50.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.553+0000 7f9099ffb640 1 -- 172.21.15.50:0/1922668147 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+176632 (secure 0 0 0) 0x7f909c025020 con 0x7f90a4144000 2024-04-01T02:12:50.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.717+0000 7f90ab902640 1 -- 172.21.15.50:0/1922668147 --> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f90a41e3f40 con 0x7f9088067420 2024-04-01T02:12:50.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.721+0000 7f9099ffb640 1 -- 172.21.15.50:0/1922668147 <== mgr.4103 v2:172.21.15.97:6832/1677467570 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f90a41e3f40 con 0x7f9088067420 2024-04-01T02:12:50.718 INFO:teuthology.orchestra.run.smithi050.stderr:instructed osd(s) 6 to deep-scrub 2024-04-01T02:12:50.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.721+0000 7f90ab902640 1 -- 172.21.15.50:0/1922668147 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f9088067420 msgr2=0x7f90880698e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:50.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.721+0000 7f90ab902640 1 --2- 172.21.15.50:0/1922668147 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f9088067420 0x7f90880698e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f90a00013e0 tx=0x7f90a0009040 comp rx=0 tx=0).stop 2024-04-01T02:12:50.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.721+0000 7f90ab902640 1 -- 172.21.15.50:0/1922668147 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90a4144000 msgr2=0x7f90a41e1090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:50.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.721+0000 7f90ab902640 1 --2- 172.21.15.50:0/1922668147 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90a4144000 0x7f90a41e1090 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f909c011490 tx=0x7f909c011950 comp rx=0 tx=0).stop 2024-04-01T02:12:50.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.721+0000 7f90ab902640 1 -- 172.21.15.50:0/1922668147 shutdown_connections 2024-04-01T02:12:50.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.721+0000 7f90ab902640 1 --2- 172.21.15.50:0/1922668147 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f9088067420 0x7f90880698e0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:50.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.721+0000 7f90ab902640 1 --2- 172.21.15.50:0/1922668147 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90a4144000 0x7f90a41e1090 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:50.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.721+0000 7f90ab902640 1 --2- 172.21.15.50:0/1922668147 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f90a41e3700 0x7f90a4143ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:50.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.721+0000 7f90ab902640 1 --2- 172.21.15.50:0/1922668147 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9090004810 0x7f90a41584c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:50.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.721+0000 7f90ab902640 1 -- 172.21.15.50:0/1922668147 >> 172.21.15.50:0/1922668147 conn(0x7f90a4067560 msgr2=0x7f90a40cb5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T02:12:50.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.721+0000 7f90ab902640 1 -- 172.21.15.50:0/1922668147 shutdown_connections 2024-04-01T02:12:50.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.721+0000 7f90ab902640 1 -- 172.21.15.50:0/1922668147 wait complete. 2024-04-01T02:12:50.739 INFO:tasks.ceph:Scrubbing osd.7 2024-04-01T02:12:50.739 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-04-01T02:12:50.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.877+0000 7fd2c9543640 1 Processor -- start 2024-04-01T02:12:50.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.877+0000 7fd2c9543640 1 -- start start 2024-04-01T02:12:50.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.877+0000 7fd2c9543640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd2c41541a0 0x7fd2c40703c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:50.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.877+0000 7fd2c9543640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fd2c4070900 0x7fd2c40c8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:50.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.877+0000 7fd2c9543640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2c40c9840 con 0x7fd2c40c9420 2024-04-01T02:12:50.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.877+0000 7fd2c9543640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fd2c4159ef0 con 0x7fd2c4070900 2024-04-01T02:12:50.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.877+0000 7fd2c9543640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fd2c40c7a70 con 0x7fd2c41541a0 2024-04-01T02:12:50.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.877+0000 7fd2c2ffd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd2c41541a0 0x7fd2c40703c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:50.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.877+0000 7fd2c37fe640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fd2c40c9420 0x7fd2c415a3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.50:42874/0 (socket says 172.21.15.50:42874) 2024-04-01T02:12:50.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.877+0000 7fd2ba7fc640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fd2c4070900 0x7fd2c40c8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:50.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.877+0000 7fd2c37fe640 1 -- 172.21.15.50:0/4237060271 learned_addr learned my addr 172.21.15.50:0/4237060271 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-04-01T02:12:50.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.877+0000 7fd2c2ffd640 1 -- 172.21.15.50:0/4237060271 >> v2:172.21.15.97:3300/0 conn(0x7fd2c4070900 msgr2=0x7fd2c40c8ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T02:12:50.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.877+0000 7fd2c2ffd640 1 --2- 172.21.15.50:0/4237060271 >> v2:172.21.15.97:3300/0 conn(0x7fd2c4070900 0x7fd2c40c8ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:50.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.877+0000 7fd2c2ffd640 1 -- 172.21.15.50:0/4237060271 >> v1:172.21.15.97:6789/0 conn(0x7fd2c40c9420 legacy=0x7fd2c415a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:50.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.877+0000 7fd2c2ffd640 1 -- 172.21.15.50:0/4237060271 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2c40c7d50 con 0x7fd2c41541a0 2024-04-01T02:12:50.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.881+0000 7fd2c2ffd640 1 --2- 172.21.15.50:0/4237060271 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd2c41541a0 0x7fd2c40703c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd2b40097c0 tx=0x7fd2b401c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=998c6076b7f33072 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:12:50.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.881+0000 7fd2c27fc640 1 -- 172.21.15.50:0/4237060271 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2b40b0070 con 0x7fd2c41541a0 2024-04-01T02:12:50.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.881+0000 7fd2c27fc640 1 -- 172.21.15.50:0/4237060271 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2b40ab600 con 0x7fd2c41541a0 2024-04-01T02:12:50.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.881+0000 7fd2c27fc640 1 -- 172.21.15.50:0/4237060271 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2b40ab9d0 con 0x7fd2c41541a0 2024-04-01T02:12:50.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.881+0000 7fd2c9543640 1 -- 172.21.15.50:0/4237060271 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd2c41541a0 msgr2=0x7fd2c40703c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:50.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.881+0000 7fd2c9543640 1 --2- 172.21.15.50:0/4237060271 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd2c41541a0 0x7fd2c40703c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd2b40097c0 tx=0x7fd2b401c410 comp rx=0 tx=0).stop 2024-04-01T02:12:50.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.881+0000 7fd2c9543640 1 -- 172.21.15.50:0/4237060271 shutdown_connections 2024-04-01T02:12:50.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.881+0000 7fd2c9543640 1 --2- 172.21.15.50:0/4237060271 >> v2:172.21.15.97:3300/0 conn(0x7fd2c4070900 0x7fd2c40c8ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:50.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.881+0000 7fd2c9543640 1 --2- 172.21.15.50:0/4237060271 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd2c41541a0 0x7fd2c40703c0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:50.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.881+0000 7fd2c9543640 1 -- 172.21.15.50:0/4237060271 >> 172.21.15.50:0/4237060271 conn(0x7fd2c4067560 msgr2=0x7fd2c406c330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T02:12:50.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.881+0000 7fd2c9543640 1 -- 172.21.15.50:0/4237060271 shutdown_connections 2024-04-01T02:12:50.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.881+0000 7fd2c9543640 1 -- 172.21.15.50:0/4237060271 wait complete. 2024-04-01T02:12:50.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.881+0000 7fd2c9543640 1 Processor -- start 2024-04-01T02:12:50.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.881+0000 7fd2c9543640 1 -- start start 2024-04-01T02:12:50.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.885+0000 7fd2c9543640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd2c4070900 0x7fd2c41463f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:50.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.885+0000 7fd2c9543640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd2c40c9420 0x7fd2c4154860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:50.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.885+0000 7fd2c9543640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2c41541a0 0x7fd2c4143d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:50.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.885+0000 7fd2c9543640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd2c4073230 con 0x7fd2c41541a0 2024-04-01T02:12:50.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.885+0000 7fd2c9543640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fd2c4154580 con 0x7fd2c4070900 2024-04-01T02:12:50.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.885+0000 7fd2c9543640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fd2c40733b0 con 0x7fd2c40c9420 2024-04-01T02:12:50.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.885+0000 7fd2c37fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2c41541a0 0x7fd2c4143d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:50.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.885+0000 7fd2c37fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2c41541a0 0x7fd2c4143d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59598/0 (socket says 172.21.15.50:59598) 2024-04-01T02:12:50.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.885+0000 7fd2c37fe640 1 -- 172.21.15.50:0/2065694234 learned_addr learned my addr 172.21.15.50:0/2065694234 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T02:12:50.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.885+0000 7fd2c2ffd640 1 --2- 172.21.15.50:0/2065694234 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd2c4070900 0x7fd2c41463f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:50.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.885+0000 7fd2ba7fc640 1 --2- 172.21.15.50:0/2065694234 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd2c40c9420 0x7fd2c4154860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:50.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.885+0000 7fd2c37fe640 1 -- 172.21.15.50:0/2065694234 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd2c40c9420 msgr2=0x7fd2c4154860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:50.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.885+0000 7fd2c37fe640 1 --2- 172.21.15.50:0/2065694234 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd2c40c9420 0x7fd2c4154860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:50.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.885+0000 7fd2c37fe640 1 -- 172.21.15.50:0/2065694234 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd2c4070900 msgr2=0x7fd2c41463f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:50.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.885+0000 7fd2c37fe640 1 --2- 172.21.15.50:0/2065694234 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd2c4070900 0x7fd2c41463f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:50.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.885+0000 7fd2c37fe640 1 -- 172.21.15.50:0/2065694234 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2c4156c40 con 0x7fd2c41541a0 2024-04-01T02:12:50.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.885+0000 7fd2c37fe640 1 --2- 172.21.15.50:0/2065694234 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2c41541a0 0x7fd2c4143d30 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fd2bc00ca70 tx=0x7fd2bc00cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:12:50.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.885+0000 7fd2bbfff640 1 -- 172.21.15.50:0/2065694234 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2bc017070 con 0x7fd2c41541a0 2024-04-01T02:12:50.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.885+0000 7fd2bbfff640 1 -- 172.21.15.50:0/2065694234 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2bc00abd0 con 0x7fd2c41541a0 2024-04-01T02:12:50.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.885+0000 7fd2c9543640 1 -- 172.21.15.50:0/2065694234 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2c4069420 con 0x7fd2c41541a0 2024-04-01T02:12:50.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.885+0000 7fd2bbfff640 1 -- 172.21.15.50:0/2065694234 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2bc012400 con 0x7fd2c41541a0 2024-04-01T02:12:50.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.885+0000 7fd2c9543640 1 -- 172.21.15.50:0/2065694234 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2c4156680 con 0x7fd2c41541a0 2024-04-01T02:12:50.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.885+0000 7fd2c9543640 1 -- 172.21.15.50:0/2065694234 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd2c4068940 con 0x7fd2c41541a0 2024-04-01T02:12:50.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.885+0000 7fd2bbfff640 1 -- 172.21.15.50:0/2065694234 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 87103+0+0 (secure 0 0 0) 0x7fd2bc01a070 con 0x7fd2c41541a0 2024-04-01T02:12:50.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.885+0000 7fd2bbfff640 1 --2- 172.21.15.50:0/2065694234 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fd2a4067450 0x7fd2a4069910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:50.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.885+0000 7fd2bbfff640 1 -- 172.21.15.50:0/2065694234 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5738+0+0 (secure 0 0 0) 0x7fd2bc085960 con 0x7fd2c41541a0 2024-04-01T02:12:50.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.885+0000 7fd2bbfff640 1 --2- 172.21.15.50:0/2065694234 >> [v2:172.21.15.97:6808/284968823,v1:172.21.15.97:6809/284968823] conn(0x7fd2a406f6b0 0x7fd2a4071ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:50.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.885+0000 7fd2bbfff640 1 -- 172.21.15.50:0/2065694234 --> [v2:172.21.15.97:6808/284968823,v1:172.21.15.97:6809/284968823] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd2a40721a0 con 0x7fd2a406f6b0 2024-04-01T02:12:50.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.885+0000 7fd2bbfff640 1 -- 172.21.15.50:0/2065694234 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fd2bc085df0 con 0x7fd2c41541a0 2024-04-01T02:12:50.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.885+0000 7fd2c2ffd640 1 --2- 172.21.15.50:0/2065694234 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fd2a4067450 0x7fd2a4069910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:50.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.889+0000 7fd2ba7fc640 1 --2- 172.21.15.50:0/2065694234 >> [v2:172.21.15.97:6808/284968823,v1:172.21.15.97:6809/284968823] conn(0x7fd2a406f6b0 0x7fd2a4071ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:50.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.889+0000 7fd2c2ffd640 1 --2- 172.21.15.50:0/2065694234 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fd2a4067450 0x7fd2a4069910 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd2b40ad000 tx=0x7fd2b4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:12:50.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.889+0000 7fd2ba7fc640 1 --2- 172.21.15.50:0/2065694234 >> [v2:172.21.15.97:6808/284968823,v1:172.21.15.97:6809/284968823] conn(0x7fd2a406f6b0 0x7fd2a4071ad0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:12:50.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.889+0000 7fd2bbfff640 1 -- 172.21.15.50:0/2065694234 <== osd.7 v2:172.21.15.97:6808/284968823 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd2a40721a0 con 0x7fd2a406f6b0 2024-04-01T02:12:50.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.905+0000 7fd2c9543640 1 -- 172.21.15.50:0/2065694234 --> [v2:172.21.15.97:6808/284968823,v1:172.21.15.97:6809/284968823] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fd2c4072e20 con 0x7fd2a406f6b0 2024-04-01T02:12:50.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.905+0000 7fd2bbfff640 1 -- 172.21.15.50:0/2065694234 <== osd.7 v2:172.21.15.97:6808/284968823 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fd2c4072e20 con 0x7fd2a406f6b0 2024-04-01T02:12:50.903 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-04-01T02:12:50.903 INFO:teuthology.orchestra.run.smithi050.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-01T02:12:50.904 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-04-01T02:12:50.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.905+0000 7fd2c9543640 1 -- 172.21.15.50:0/2065694234 >> [v2:172.21.15.97:6808/284968823,v1:172.21.15.97:6809/284968823] conn(0x7fd2a406f6b0 msgr2=0x7fd2a4071ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:50.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.905+0000 7fd2c9543640 1 --2- 172.21.15.50:0/2065694234 >> [v2:172.21.15.97:6808/284968823,v1:172.21.15.97:6809/284968823] conn(0x7fd2a406f6b0 0x7fd2a4071ad0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:50.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.905+0000 7fd2c9543640 1 -- 172.21.15.50:0/2065694234 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fd2a4067450 msgr2=0x7fd2a4069910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:50.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.905+0000 7fd2c9543640 1 --2- 172.21.15.50:0/2065694234 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fd2a4067450 0x7fd2a4069910 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd2b40ad000 tx=0x7fd2b4008040 comp rx=0 tx=0).stop 2024-04-01T02:12:50.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.905+0000 7fd2c9543640 1 -- 172.21.15.50:0/2065694234 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2c41541a0 msgr2=0x7fd2c4143d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:50.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.905+0000 7fd2c9543640 1 --2- 172.21.15.50:0/2065694234 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2c41541a0 0x7fd2c4143d30 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fd2bc00ca70 tx=0x7fd2bc00cf30 comp rx=0 tx=0).stop 2024-04-01T02:12:50.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.905+0000 7fd2c37fe640 1 -- 172.21.15.50:0/2065694234 reap_dead start 2024-04-01T02:12:50.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.905+0000 7fd2c9543640 1 -- 172.21.15.50:0/2065694234 shutdown_connections 2024-04-01T02:12:50.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.905+0000 7fd2c9543640 1 -- 172.21.15.50:0/2065694234 >> 172.21.15.50:0/2065694234 conn(0x7fd2c4067560 msgr2=0x7fd2c4151e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T02:12:50.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.905+0000 7fd2c9543640 1 -- 172.21.15.50:0/2065694234 shutdown_connections 2024-04-01T02:12:50.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:50.905+0000 7fd2c9543640 1 -- 172.21.15.50:0/2065694234 wait complete. 2024-04-01T02:12:50.921 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-04-01T02:12:51.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.045+0000 7f764f1bd640 1 Processor -- start 2024-04-01T02:12:51.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.045+0000 7f764f1bd640 1 -- start start 2024-04-01T02:12:51.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.045+0000 7f764f1bd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f76480706d0 0x7f764815b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:51.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.045+0000 7f764f1bd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f764815b7f0 0x7f76480cd620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:51.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.045+0000 7f764f1bd640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76480c31f0 con 0x7f7648151f50 2024-04-01T02:12:51.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.045+0000 7f764f1bd640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f76480c2750 con 0x7f76480706d0 2024-04-01T02:12:51.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.045+0000 7f764f1bd640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f76480c8db0 con 0x7f764815b7f0 2024-04-01T02:12:51.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.045+0000 7f764cf59640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f7648151f50 0x7f764806fec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39286/0 (socket says 172.21.15.50:39286) 2024-04-01T02:12:51.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.045+0000 7f764cf59640 1 -- 172.21.15.50:0/1547383468 learned_addr learned my addr 172.21.15.50:0/1547383468 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-04-01T02:12:51.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.045+0000 7f7647fff640 1 --2- 172.21.15.50:0/1547383468 >> v2:172.21.15.97:3300/0 conn(0x7f76480706d0 0x7f764815b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:51.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.045+0000 7f764d75a640 1 --2- 172.21.15.50:0/1547383468 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f764815b7f0 0x7f76480cd620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:51.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.045+0000 7f76477fe640 1 -- 172.21.15.50:0/1547383468 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2447503888 0 0) 0x7f76480c31f0 con 0x7f7648151f50 2024-04-01T02:12:51.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.045+0000 7f76477fe640 1 -- 172.21.15.50:0/1547383468 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7638003530 con 0x7f7648151f50 2024-04-01T02:12:51.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.045+0000 7f76477fe640 1 -- 172.21.15.50:0/1547383468 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3107976544 0 0) 0x7f7638003530 con 0x7f7648151f50 2024-04-01T02:12:51.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.045+0000 7f76477fe640 1 -- 172.21.15.50:0/1547383468 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f764815b7f0 msgr2=0x7f76480cd620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T02:12:51.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.045+0000 7f76477fe640 1 --2- 172.21.15.50:0/1547383468 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f764815b7f0 0x7f76480cd620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:51.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.045+0000 7f76477fe640 1 -- 172.21.15.50:0/1547383468 >> v2:172.21.15.97:3300/0 conn(0x7f76480706d0 msgr2=0x7f764815b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T02:12:51.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.045+0000 7f76477fe640 1 --2- 172.21.15.50:0/1547383468 >> v2:172.21.15.97:3300/0 conn(0x7f76480706d0 0x7f764815b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:51.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.045+0000 7f76477fe640 1 -- 172.21.15.50:0/1547383468 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76480c8230 con 0x7f7648151f50 2024-04-01T02:12:51.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.045+0000 7f76477fe640 1 -- 172.21.15.50:0/1547383468 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2779672543 0 0) 0x7f763c001680 con 0x7f7648151f50 2024-04-01T02:12:51.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.045+0000 7f76477fe640 1 -- 172.21.15.50:0/1547383468 >> v1:172.21.15.50:6789/0 conn(0x7f7648151f50 legacy=0x7f764806fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:51.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.045+0000 7f76477fe640 1 --2- 172.21.15.50:0/1547383468 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f76380039c0 0x7f7638003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:51.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.045+0000 7f76477fe640 1 --2- 172.21.15.50:0/1547383468 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f764815b7f0 0x7f7638004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:51.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.045+0000 7f76477fe640 1 --2- 172.21.15.50:0/1547383468 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7638004d50 0x7f76380051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:51.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.045+0000 7f76477fe640 1 -- 172.21.15.50:0/1547383468 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f76480c2750 con 0x7f7638004d50 2024-04-01T02:12:51.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.045+0000 7f76477fe640 1 -- 172.21.15.50:0/1547383468 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f76480c8db0 con 0x7f76380039c0 2024-04-01T02:12:51.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.045+0000 7f76477fe640 1 -- 172.21.15.50:0/1547383468 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f763800b9d0 con 0x7f764815b7f0 2024-04-01T02:12:51.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.045+0000 7f764d75a640 1 --2- 172.21.15.50:0/1547383468 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7638004d50 0x7f76380051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:51.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.045+0000 7f764cf59640 1 --2- 172.21.15.50:0/1547383468 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f76380039c0 0x7f7638003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:51.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.045+0000 7f7647fff640 1 --2- 172.21.15.50:0/1547383468 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f764815b7f0 0x7f7638004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:51.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.045+0000 7f764d75a640 1 -- 172.21.15.50:0/1547383468 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f764815b7f0 msgr2=0x7f7638004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T02:12:51.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.045+0000 7f764d75a640 1 --2- 172.21.15.50:0/1547383468 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f764815b7f0 0x7f7638004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:51.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.045+0000 7f764d75a640 1 -- 172.21.15.50:0/1547383468 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f76380039c0 msgr2=0x7f7638003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T02:12:51.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.045+0000 7f764d75a640 1 --2- 172.21.15.50:0/1547383468 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f76380039c0 0x7f7638003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:51.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.045+0000 7f764d75a640 1 -- 172.21.15.50:0/1547383468 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7638003530 con 0x7f7638004d50 2024-04-01T02:12:51.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.045+0000 7f7647fff640 1 --2- 172.21.15.50:0/1547383468 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f764815b7f0 0x7f7638004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T02:12:51.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.049+0000 7f764d75a640 1 --2- 172.21.15.50:0/1547383468 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7638004d50 0x7f76380051d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f7640009f90 tx=0x7f764001cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7604a2f97cbe89ec server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:12:51.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.049+0000 7f76477fe640 1 -- 172.21.15.50:0/1547383468 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76400b2070 con 0x7f7638004d50 2024-04-01T02:12:51.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.049+0000 7f76477fe640 1 -- 172.21.15.50:0/1547383468 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76400a5c50 con 0x7f7638004d50 2024-04-01T02:12:51.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.049+0000 7f76477fe640 1 -- 172.21.15.50:0/1547383468 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7640009c10 con 0x7f7638004d50 2024-04-01T02:12:51.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.049+0000 7f764f1bd640 1 -- 172.21.15.50:0/1547383468 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7638004d50 msgr2=0x7f76380051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:51.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.049+0000 7f764f1bd640 1 --2- 172.21.15.50:0/1547383468 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7638004d50 0x7f76380051d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f7640009f90 tx=0x7f764001cc40 comp rx=0 tx=0).stop 2024-04-01T02:12:51.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.049+0000 7f764d75a640 1 -- 172.21.15.50:0/1547383468 reap_dead start 2024-04-01T02:12:51.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.049+0000 7f764f1bd640 1 -- 172.21.15.50:0/1547383468 shutdown_connections 2024-04-01T02:12:51.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.049+0000 7f764f1bd640 1 -- 172.21.15.50:0/1547383468 >> 172.21.15.50:0/1547383468 conn(0x7f764806b220 msgr2=0x7f764806b630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T02:12:51.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.049+0000 7f764f1bd640 1 -- 172.21.15.50:0/1547383468 shutdown_connections 2024-04-01T02:12:51.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.049+0000 7f764f1bd640 1 -- 172.21.15.50:0/1547383468 wait complete. 2024-04-01T02:12:51.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.049+0000 7f764f1bd640 1 Processor -- start 2024-04-01T02:12:51.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.049+0000 7f764f1bd640 1 -- start start 2024-04-01T02:12:51.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.053+0000 7f764f1bd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7638004d50 0x7f76480c4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:51.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.053+0000 7f764f1bd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f76480c5720 0x7f76481eaed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:51.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.053+0000 7f764f1bd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f76481503c0 0x7f764814e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:51.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.053+0000 7f764f1bd640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f76480c2cd0 con 0x7f7638004d50 2024-04-01T02:12:51.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.053+0000 7f764f1bd640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f76480c29f0 con 0x7f76481503c0 2024-04-01T02:12:51.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.053+0000 7f764f1bd640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f76480c87f0 con 0x7f76480c5720 2024-04-01T02:12:51.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.053+0000 7f764cf59640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7638004d50 0x7f76480c4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:51.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.053+0000 7f764cf59640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7638004d50 0x7f76480c4fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59610/0 (socket says 172.21.15.50:59610) 2024-04-01T02:12:51.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.053+0000 7f764cf59640 1 -- 172.21.15.50:0/1257887151 learned_addr learned my addr 172.21.15.50:0/1257887151 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T02:12:51.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.053+0000 7f7647fff640 1 --2- 172.21.15.50:0/1257887151 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f76480c5720 0x7f76481eaed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:51.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.053+0000 7f764d75a640 1 --2- 172.21.15.50:0/1257887151 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f76481503c0 0x7f764814e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:51.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.053+0000 7f764cf59640 1 -- 172.21.15.50:0/1257887151 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f76480c5720 msgr2=0x7f76481eaed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:51.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.053+0000 7f764cf59640 1 --2- 172.21.15.50:0/1257887151 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f76480c5720 0x7f76481eaed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:51.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.053+0000 7f764cf59640 1 -- 172.21.15.50:0/1257887151 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f76481503c0 msgr2=0x7f764814e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:51.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.053+0000 7f764cf59640 1 --2- 172.21.15.50:0/1257887151 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f76481503c0 0x7f764814e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:51.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.053+0000 7f764cf59640 1 -- 172.21.15.50:0/1257887151 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76480c5c30 con 0x7f7638004d50 2024-04-01T02:12:51.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.053+0000 7f764cf59640 1 --2- 172.21.15.50:0/1257887151 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7638004d50 0x7f76480c4fb0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f763c00e820 tx=0x7f763c00ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:12:51.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.053+0000 7f76457fa640 1 -- 172.21.15.50:0/1257887151 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f763c00c870 con 0x7f7638004d50 2024-04-01T02:12:51.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.053+0000 7f76457fa640 1 -- 172.21.15.50:0/1257887151 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f763c018070 con 0x7f7638004d50 2024-04-01T02:12:51.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.053+0000 7f764f1bd640 1 -- 172.21.15.50:0/1257887151 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76480c5f10 con 0x7f7638004d50 2024-04-01T02:12:51.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.053+0000 7f76457fa640 1 -- 172.21.15.50:0/1257887151 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f763c00cc50 con 0x7f7638004d50 2024-04-01T02:12:51.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.053+0000 7f764f1bd640 1 -- 172.21.15.50:0/1257887151 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76480c67b0 con 0x7f7638004d50 2024-04-01T02:12:51.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.053+0000 7f764f1bd640 1 -- 172.21.15.50:0/1257887151 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7648068940 con 0x7f7638004d50 2024-04-01T02:12:51.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.053+0000 7f76457fa640 1 -- 172.21.15.50:0/1257887151 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 87103+0+0 (secure 0 0 0) 0x7f763c01d460 con 0x7f7638004d50 2024-04-01T02:12:51.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.053+0000 7f76457fa640 1 --2- 172.21.15.50:0/1257887151 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f762c067450 0x7f762c069910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:51.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.053+0000 7f76457fa640 1 -- 172.21.15.50:0/1257887151 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5738+0+0 (secure 0 0 0) 0x7f763c085520 con 0x7f7638004d50 2024-04-01T02:12:51.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.053+0000 7f7647fff640 1 --2- 172.21.15.50:0/1257887151 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f762c067450 0x7f762c069910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:51.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.057+0000 7f7647fff640 1 --2- 172.21.15.50:0/1257887151 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f762c067450 0x7f762c069910 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f764806c490 tx=0x7f7634008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:12:51.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.057+0000 7f76457fa640 1 -- 172.21.15.50:0/1257887151 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+176632 (secure 0 0 0) 0x7f763c0562a0 con 0x7f7638004d50 2024-04-01T02:12:51.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.225+0000 7f764f1bd640 1 -- 172.21.15.50:0/1257887151 --> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f76480cd4a0 con 0x7f762c067450 2024-04-01T02:12:51.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.225+0000 7f76457fa640 1 -- 172.21.15.50:0/1257887151 <== mgr.4103 v2:172.21.15.97:6832/1677467570 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f76480cd4a0 con 0x7f762c067450 2024-04-01T02:12:51.225 INFO:teuthology.orchestra.run.smithi050.stderr:instructed osd(s) 7 to deep-scrub 2024-04-01T02:12:51.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.229+0000 7f764f1bd640 1 -- 172.21.15.50:0/1257887151 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f762c067450 msgr2=0x7f762c069910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:51.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.229+0000 7f764f1bd640 1 --2- 172.21.15.50:0/1257887151 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f762c067450 0x7f762c069910 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f764806c490 tx=0x7f7634008040 comp rx=0 tx=0).stop 2024-04-01T02:12:51.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.229+0000 7f764f1bd640 1 -- 172.21.15.50:0/1257887151 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7638004d50 msgr2=0x7f76480c4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:51.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.229+0000 7f764f1bd640 1 --2- 172.21.15.50:0/1257887151 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7638004d50 0x7f76480c4fb0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f763c00e820 tx=0x7f763c00ece0 comp rx=0 tx=0).stop 2024-04-01T02:12:51.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.229+0000 7f764f1bd640 1 -- 172.21.15.50:0/1257887151 shutdown_connections 2024-04-01T02:12:51.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.229+0000 7f764f1bd640 1 --2- 172.21.15.50:0/1257887151 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f762c067450 0x7f762c069910 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:51.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.229+0000 7f764f1bd640 1 --2- 172.21.15.50:0/1257887151 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f76481503c0 0x7f764814e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:51.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.229+0000 7f764f1bd640 1 --2- 172.21.15.50:0/1257887151 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f76480c5720 0x7f76481eaed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:51.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.229+0000 7f764f1bd640 1 --2- 172.21.15.50:0/1257887151 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7638004d50 0x7f76480c4fb0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:51.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.229+0000 7f764f1bd640 1 -- 172.21.15.50:0/1257887151 >> 172.21.15.50:0/1257887151 conn(0x7f764806b220 msgr2=0x7f764806b630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T02:12:51.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.229+0000 7f764f1bd640 1 -- 172.21.15.50:0/1257887151 shutdown_connections 2024-04-01T02:12:51.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.229+0000 7f764f1bd640 1 -- 172.21.15.50:0/1257887151 wait complete. 2024-04-01T02:12:51.245 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-01T02:12:51.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.365+0000 7fb885db9640 1 Processor -- start 2024-04-01T02:12:51.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.365+0000 7fb885db9640 1 -- start start 2024-04-01T02:12:51.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.365+0000 7fb885db9640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb8800c5b30 0x7fb8800c8c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:51.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.365+0000 7fb885db9640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb880156e80 0x7fb88014ff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:51.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.365+0000 7fb885db9640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8800c47b0 con 0x7fb88006f2e0 2024-04-01T02:12:51.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.365+0000 7fb885db9640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fb8800c4a90 con 0x7fb8800c5b30 2024-04-01T02:12:51.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.365+0000 7fb885db9640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fb8800c4d70 con 0x7fb880156e80 2024-04-01T02:12:51.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.365+0000 7fb87effd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb8800c5b30 0x7fb8800c8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:51.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.365+0000 7fb87effd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb8800c5b30 0x7fb8800c8c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59616/0 (socket says 172.21.15.50:59616) 2024-04-01T02:12:51.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.365+0000 7fb87effd640 1 -- 172.21.15.50:0/3957247438 learned_addr learned my addr 172.21.15.50:0/3957247438 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T02:12:51.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.365+0000 7fb87ffff640 1 --2- 172.21.15.50:0/3957247438 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb880156e80 0x7fb88014ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:51.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.365+0000 7fb87effd640 1 -- 172.21.15.50:0/3957247438 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb880156e80 msgr2=0x7fb88014ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T02:12:51.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.365+0000 7fb87effd640 1 --2- 172.21.15.50:0/3957247438 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb880156e80 0x7fb88014ff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:51.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.365+0000 7fb87effd640 1 -- 172.21.15.50:0/3957247438 >> v1:172.21.15.97:6789/0 conn(0x7fb88006f2e0 legacy=0x7fb8800c6230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T02:12:51.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.365+0000 7fb87effd640 1 -- 172.21.15.50:0/3957247438 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8800c5050 con 0x7fb8800c5b30 2024-04-01T02:12:51.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.369+0000 7fb87effd640 1 --2- 172.21.15.50:0/3957247438 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8800c5b30 0x7fb8800c8c00 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fb87400aa10 tx=0x7fb8740200e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=200dcbacd336c98a server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:12:51.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.369+0000 7fb87e7fc640 1 -- 172.21.15.50:0/3957247438 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8740b6070 con 0x7fb8800c5b30 2024-04-01T02:12:51.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.369+0000 7fb87e7fc640 1 -- 172.21.15.50:0/3957247438 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8740b1440 con 0x7fb8800c5b30 2024-04-01T02:12:51.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.369+0000 7fb87e7fc640 1 -- 172.21.15.50:0/3957247438 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb87400b040 con 0x7fb8800c5b30 2024-04-01T02:12:51.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.369+0000 7fb885db9640 1 -- 172.21.15.50:0/3957247438 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8800c5b30 msgr2=0x7fb8800c8c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:51.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.369+0000 7fb885db9640 1 --2- 172.21.15.50:0/3957247438 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8800c5b30 0x7fb8800c8c00 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fb87400aa10 tx=0x7fb8740200e0 comp rx=0 tx=0).stop 2024-04-01T02:12:51.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.369+0000 7fb885db9640 1 -- 172.21.15.50:0/3957247438 shutdown_connections 2024-04-01T02:12:51.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.369+0000 7fb885db9640 1 --2- 172.21.15.50:0/3957247438 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb880156e80 0x7fb88014ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:51.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.369+0000 7fb885db9640 1 --2- 172.21.15.50:0/3957247438 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8800c5b30 0x7fb8800c8c00 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:51.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.369+0000 7fb885db9640 1 -- 172.21.15.50:0/3957247438 >> 172.21.15.50:0/3957247438 conn(0x7fb8800cb830 msgr2=0x7fb8800cbc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T02:12:51.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.369+0000 7fb885db9640 1 -- 172.21.15.50:0/3957247438 shutdown_connections 2024-04-01T02:12:51.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.369+0000 7fb885db9640 1 -- 172.21.15.50:0/3957247438 wait complete. 2024-04-01T02:12:51.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.373+0000 7fb885db9640 1 Processor -- start 2024-04-01T02:12:51.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.373+0000 7fb885db9640 1 -- start start 2024-04-01T02:12:51.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.373+0000 7fb885db9640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb88006f2e0 0x7fb880155130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:51.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.373+0000 7fb885db9640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb880156e80 0x7fb88014d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:51.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.373+0000 7fb885db9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb88014f580 0x7fb88013cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:51.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.373+0000 7fb885db9640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb8800c9140 con 0x7fb88014f580 2024-04-01T02:12:51.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.373+0000 7fb885db9640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fb8800c5610 con 0x7fb880156e80 2024-04-01T02:12:51.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.373+0000 7fb885db9640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fb8800c4350 con 0x7fb88006f2e0 2024-04-01T02:12:51.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.373+0000 7fb87ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb88014f580 0x7fb88013cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:51.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.373+0000 7fb87ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb88014f580 0x7fb88013cf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59620/0 (socket says 172.21.15.50:59620) 2024-04-01T02:12:51.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.373+0000 7fb87ffff640 1 -- 172.21.15.50:0/2900428346 learned_addr learned my addr 172.21.15.50:0/2900428346 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T02:12:51.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.373+0000 7fb87f7fe640 1 --2- 172.21.15.50:0/2900428346 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb88006f2e0 0x7fb880155130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:51.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.373+0000 7fb87effd640 1 --2- 172.21.15.50:0/2900428346 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb880156e80 0x7fb88014d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:51.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.373+0000 7fb87ffff640 1 -- 172.21.15.50:0/2900428346 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb88006f2e0 msgr2=0x7fb880155130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:51.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.373+0000 7fb87ffff640 1 --2- 172.21.15.50:0/2900428346 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb88006f2e0 0x7fb880155130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:51.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.373+0000 7fb87ffff640 1 -- 172.21.15.50:0/2900428346 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb880156e80 msgr2=0x7fb88014d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:51.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.373+0000 7fb87ffff640 1 --2- 172.21.15.50:0/2900428346 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb880156e80 0x7fb88014d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:51.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.373+0000 7fb87ffff640 1 -- 172.21.15.50:0/2900428346 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8801f1e20 con 0x7fb88014f580 2024-04-01T02:12:51.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.373+0000 7fb87f7fe640 1 --2- 172.21.15.50:0/2900428346 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb88006f2e0 0x7fb880155130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T02:12:51.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.373+0000 7fb87ffff640 1 --2- 172.21.15.50:0/2900428346 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb88014f580 0x7fb88013cf10 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fb87800cd20 tx=0x7fb87800a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:12:51.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.373+0000 7fb867fff640 1 -- 172.21.15.50:0/2900428346 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb878003ba0 con 0x7fb88014f580 2024-04-01T02:12:51.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.373+0000 7fb867fff640 1 -- 172.21.15.50:0/2900428346 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb878003d40 con 0x7fb88014f580 2024-04-01T02:12:51.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.373+0000 7fb867fff640 1 -- 172.21.15.50:0/2900428346 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb878004240 con 0x7fb88014f580 2024-04-01T02:12:51.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.373+0000 7fb885db9640 1 -- 172.21.15.50:0/2900428346 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8801ee8d0 con 0x7fb88014f580 2024-04-01T02:12:51.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.373+0000 7fb885db9640 1 -- 172.21.15.50:0/2900428346 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8801edb10 con 0x7fb88014f580 2024-04-01T02:12:51.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.373+0000 7fb885db9640 1 -- 172.21.15.50:0/2900428346 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb880068940 con 0x7fb88014f580 2024-04-01T02:12:51.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.377+0000 7fb867fff640 1 -- 172.21.15.50:0/2900428346 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 87103+0+0 (secure 0 0 0) 0x7fb8780043e0 con 0x7fb88014f580 2024-04-01T02:12:51.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.377+0000 7fb867fff640 1 --2- 172.21.15.50:0/2900428346 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fb86c067420 0x7fb86c0698e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:12:51.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.377+0000 7fb867fff640 1 -- 172.21.15.50:0/2900428346 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5738+0+0 (secure 0 0 0) 0x7fb878086170 con 0x7fb88014f580 2024-04-01T02:12:51.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.377+0000 7fb87f7fe640 1 --2- 172.21.15.50:0/2900428346 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fb86c067420 0x7fb86c0698e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:12:51.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.377+0000 7fb87f7fe640 1 --2- 172.21.15.50:0/2900428346 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fb86c067420 0x7fb86c0698e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb8700098b0 tx=0x7fb870008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:12:51.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.381+0000 7fb867fff640 1 -- 172.21.15.50:0/2900428346 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+176632 (secure 0 0 0) 0x7fb878056e50 con 0x7fb88014f580 2024-04-01T02:12:51.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.545+0000 7fb885db9640 1 -- 172.21.15.50:0/2900428346 --> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb880153b20 con 0x7fb86c067420 2024-04-01T02:12:51.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.565+0000 7fb867fff640 1 -- 172.21.15.50:0/2900428346 <== mgr.4103 v2:172.21.15.97:6832/1677467570 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+254165 (secure 0 0 0) 0x7fb880153b20 con 0x7fb86c067420 2024-04-01T02:12:51.563 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-01T02:12:51.564 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-04-01T02:12:51.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.565+0000 7fb885db9640 1 -- 172.21.15.50:0/2900428346 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fb86c067420 msgr2=0x7fb86c0698e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:51.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.565+0000 7fb885db9640 1 --2- 172.21.15.50:0/2900428346 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fb86c067420 0x7fb86c0698e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb8700098b0 tx=0x7fb870008040 comp rx=0 tx=0).stop 2024-04-01T02:12:51.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.565+0000 7fb885db9640 1 -- 172.21.15.50:0/2900428346 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb88014f580 msgr2=0x7fb88013cf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:12:51.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.565+0000 7fb885db9640 1 --2- 172.21.15.50:0/2900428346 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb88014f580 0x7fb88013cf10 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fb87800cd20 tx=0x7fb87800a660 comp rx=0 tx=0).stop 2024-04-01T02:12:51.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.565+0000 7fb885db9640 1 -- 172.21.15.50:0/2900428346 shutdown_connections 2024-04-01T02:12:51.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.565+0000 7fb885db9640 1 --2- 172.21.15.50:0/2900428346 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fb86c067420 0x7fb86c0698e0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:51.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.565+0000 7fb885db9640 1 --2- 172.21.15.50:0/2900428346 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb88014f580 0x7fb88013cf10 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:51.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.565+0000 7fb885db9640 1 --2- 172.21.15.50:0/2900428346 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb880156e80 0x7fb88014d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:51.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.565+0000 7fb885db9640 1 --2- 172.21.15.50:0/2900428346 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb88006f2e0 0x7fb880155130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:12:51.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.565+0000 7fb885db9640 1 -- 172.21.15.50:0/2900428346 >> 172.21.15.50:0/2900428346 conn(0x7fb8800cb830 msgr2=0x7fb8800c6d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T02:12:51.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.565+0000 7fb885db9640 1 -- 172.21.15.50:0/2900428346 shutdown_connections 2024-04-01T02:12:51.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:12:51.565+0000 7fb885db9640 1 -- 172.21.15.50:0/2900428346 wait complete. 2024-04-01T02:12:51.581 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":531,"stamp":"2024-04-01T02:12:50.391825+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":415038813,"num_objects":742,"num_object_clones":0,"num_object_copies":1484,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":742,"num_whiteouts":0,"num_read":1875,"num_read_kb":2843,"num_write":55998,"num_write_kb":1354498,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":62737,"ondisk_log_size":62737,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":993660,"kb_used_data":290300,"kb_used_omap":12,"kb_used_meta":703283,"kb_avail":753981060,"statfs":{"total":773094113280,"available":772076605440,"internally_reserved":0,"allocated":297267200,"data_stored":830690738,"data_compressed":57247476,"data_compressed_allocated":83542016,"data_compressed_original":620507992,"omap_allocated":12751,"internal_metadata":720162353},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":426548,"num_objects":-3,"num_object_clones":0,"num_object_copies":-6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003974"},"pg_stats":[{"pgid":"3.3f","version":"23'487","reported_seq":512,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.733199+0000","last_change":"2024-04-01T01:55:49.279342+0000","last_active":"2024-04-01T02:12:38.733199+0000","last_peered":"2024-04-01T02:12:38.733199+0000","last_clean":"2024-04-01T02:12:38.733199+0000","last_became_active":"2024-04-01T01:55:49.279011+0000","last_became_peered":"2024-04-01T01:55:49.279011+0000","last_unstale":"2024-04-01T02:12:38.733199+0000","last_undegraded":"2024-04-01T02:12:38.733199+0000","last_fullsized":"2024-04-01T02:12:38.733199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4211749,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":345,"num_write_kb":18423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"23'557","reported_seq":581,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.676141+0000","last_change":"2024-04-01T01:55:49.247181+0000","last_active":"2024-04-01T02:12:38.676141+0000","last_peered":"2024-04-01T02:12:38.676141+0000","last_clean":"2024-04-01T02:12:38.676141+0000","last_became_active":"2024-04-01T01:55:49.246660+0000","last_became_peered":"2024-04-01T01:55:49.246660+0000","last_unstale":"2024-04-01T02:12:38.676141+0000","last_undegraded":"2024-04-01T02:12:38.676141+0000","last_fullsized":"2024-04-01T02:12:38.676141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":557,"log_dups_size":0,"ondisk_log_size":557,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:27:12.089520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3694421,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":432,"num_write_kb":10812,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"23'528","reported_seq":552,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.682048+0000","last_change":"2024-04-01T01:55:49.240347+0000","last_active":"2024-04-01T02:12:38.682048+0000","last_peered":"2024-04-01T02:12:38.682048+0000","last_clean":"2024-04-01T02:12:38.682048+0000","last_became_active":"2024-04-01T01:55:49.239904+0000","last_became_peered":"2024-04-01T01:55:49.239904+0000","last_unstale":"2024-04-01T02:12:38.682048+0000","last_undegraded":"2024-04-01T02:12:38.682048+0000","last_fullsized":"2024-04-01T02:12:38.682048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:37:43.280869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5131013,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":399,"num_write_kb":17827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"23'481","reported_seq":505,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.720237+0000","last_change":"2024-04-01T01:55:49.279352+0000","last_active":"2024-04-01T02:12:38.720237+0000","last_peered":"2024-04-01T02:12:38.720237+0000","last_clean":"2024-04-01T02:12:38.720237+0000","last_became_active":"2024-04-01T01:55:49.279041+0000","last_became_peered":"2024-04-01T01:55:49.279041+0000","last_unstale":"2024-04-01T02:12:38.720237+0000","last_undegraded":"2024-04-01T02:12:38.720237+0000","last_fullsized":"2024-04-01T02:12:38.720237+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":481,"log_dups_size":0,"ondisk_log_size":481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:13:13.114168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":658438,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":353,"num_write_kb":8202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"23'578","reported_seq":601,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.732212+0000","last_change":"2024-04-01T01:55:49.246874+0000","last_active":"2024-04-01T02:12:38.732212+0000","last_peered":"2024-04-01T02:12:38.732212+0000","last_clean":"2024-04-01T02:12:38.732212+0000","last_became_active":"2024-04-01T01:55:49.246152+0000","last_became_peered":"2024-04-01T01:55:49.246152+0000","last_unstale":"2024-04-01T02:12:38.732212+0000","last_undegraded":"2024-04-01T02:12:38.732212+0000","last_fullsized":"2024-04-01T02:12:38.732212+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":578,"log_dups_size":0,"ondisk_log_size":578,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3987251,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":442,"num_write_kb":11887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"23'477","reported_seq":499,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.714821+0000","last_change":"2024-04-01T01:55:49.254029+0000","last_active":"2024-04-01T02:12:38.714821+0000","last_peered":"2024-04-01T02:12:38.714821+0000","last_clean":"2024-04-01T02:12:38.714821+0000","last_became_active":"2024-04-01T01:55:49.253348+0000","last_became_peered":"2024-04-01T01:55:49.253348+0000","last_unstale":"2024-04-01T02:12:38.714821+0000","last_undegraded":"2024-04-01T02:12:38.714821+0000","last_fullsized":"2024-04-01T02:12:38.714821+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":477,"log_dups_size":0,"ondisk_log_size":477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:33:56.754206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3474466,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":343,"num_write_kb":9649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"23'559","reported_seq":582,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.702507+0000","last_change":"2024-04-01T01:55:49.247604+0000","last_active":"2024-04-01T02:12:38.702507+0000","last_peered":"2024-04-01T02:12:38.702507+0000","last_clean":"2024-04-01T02:12:38.702507+0000","last_became_active":"2024-04-01T01:55:49.247373+0000","last_became_peered":"2024-04-01T01:55:49.247373+0000","last_unstale":"2024-04-01T02:12:38.702507+0000","last_undegraded":"2024-04-01T02:12:38.702507+0000","last_fullsized":"2024-04-01T02:12:38.702507+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":559,"log_dups_size":0,"ondisk_log_size":559,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2878976,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":421,"num_write_kb":10504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"23'479","reported_seq":501,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.702730+0000","last_change":"2024-04-01T01:55:49.262994+0000","last_active":"2024-04-01T02:12:38.702730+0000","last_peered":"2024-04-01T02:12:38.702730+0000","last_clean":"2024-04-01T02:12:38.702730+0000","last_became_active":"2024-04-01T01:55:49.262736+0000","last_became_peered":"2024-04-01T01:55:49.262736+0000","last_unstale":"2024-04-01T02:12:38.702730+0000","last_undegraded":"2024-04-01T02:12:38.702730+0000","last_fullsized":"2024-04-01T02:12:38.702730+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":479,"log_dups_size":0,"ondisk_log_size":479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:35:14.625545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3489692,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":346,"num_write_kb":10932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"23'511","reported_seq":533,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.727389+0000","last_change":"2024-04-01T01:55:49.260244+0000","last_active":"2024-04-01T02:12:38.727389+0000","last_peered":"2024-04-01T02:12:38.727389+0000","last_clean":"2024-04-01T02:12:38.727389+0000","last_became_active":"2024-04-01T01:55:49.259745+0000","last_became_peered":"2024-04-01T01:55:49.259745+0000","last_unstale":"2024-04-01T02:12:38.727389+0000","last_undegraded":"2024-04-01T02:12:38.727389+0000","last_fullsized":"2024-04-01T02:12:38.727389+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":511,"log_dups_size":0,"ondisk_log_size":511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:00:34.607980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3721216,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":377,"num_write_kb":13356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"23'490","reported_seq":506,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.726657+0000","last_change":"2024-04-01T01:56:38.229250+0000","last_active":"2024-04-01T02:12:38.726657+0000","last_peered":"2024-04-01T02:12:38.726657+0000","last_clean":"2024-04-01T02:12:38.726657+0000","last_became_active":"2024-04-01T01:56:38.228548+0000","last_became_peered":"2024-04-01T01:56:38.228548+0000","last_unstale":"2024-04-01T02:12:38.726657+0000","last_undegraded":"2024-04-01T02:12:38.726657+0000","last_fullsized":"2024-04-01T02:12:38.726657+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":490,"log_dups_size":0,"ondisk_log_size":490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:15:01.912111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2985236,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":363,"num_write_kb":27800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.35","version":"23'471","reported_seq":495,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:47.814954+0000","last_change":"2024-04-01T01:55:49.271392+0000","last_active":"2024-04-01T02:12:47.814954+0000","last_peered":"2024-04-01T02:12:47.814954+0000","last_clean":"2024-04-01T02:12:47.814954+0000","last_became_active":"2024-04-01T01:55:49.270877+0000","last_became_peered":"2024-04-01T01:55:49.270877+0000","last_unstale":"2024-04-01T02:12:47.814954+0000","last_undegraded":"2024-04-01T02:12:47.814954+0000","last_fullsized":"2024-04-01T02:12:47.814954+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3409567,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":12314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"23'413","reported_seq":437,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:47.814976+0000","last_change":"2024-04-01T01:55:49.259816+0000","last_active":"2024-04-01T02:12:47.814976+0000","last_peered":"2024-04-01T02:12:47.814976+0000","last_clean":"2024-04-01T02:12:47.814976+0000","last_became_active":"2024-04-01T01:55:49.259193+0000","last_became_peered":"2024-04-01T01:55:49.259193+0000","last_unstale":"2024-04-01T02:12:47.814976+0000","last_undegraded":"2024-04-01T02:12:47.814976+0000","last_fullsized":"2024-04-01T02:12:47.814976+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2357039,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":282,"num_write_kb":7635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"23'431","reported_seq":454,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.701153+0000","last_change":"2024-04-01T01:55:49.247878+0000","last_active":"2024-04-01T02:12:38.701153+0000","last_peered":"2024-04-01T02:12:38.701153+0000","last_clean":"2024-04-01T02:12:38.701153+0000","last_became_active":"2024-04-01T01:55:49.247436+0000","last_became_peered":"2024-04-01T01:55:49.247436+0000","last_unstale":"2024-04-01T02:12:38.701153+0000","last_undegraded":"2024-04-01T02:12:38.701153+0000","last_fullsized":"2024-04-01T02:12:38.701153+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:26:09.632757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":608576,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":293,"num_write_kb":6624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"23'521","reported_seq":544,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.672100+0000","last_change":"2024-04-01T01:55:49.246266+0000","last_active":"2024-04-01T02:12:38.672100+0000","last_peered":"2024-04-01T02:12:38.672100+0000","last_clean":"2024-04-01T02:12:38.672100+0000","last_became_active":"2024-04-01T01:55:49.245650+0000","last_became_peered":"2024-04-01T01:55:49.245650+0000","last_unstale":"2024-04-01T02:12:38.672100+0000","last_undegraded":"2024-04-01T02:12:38.672100+0000","last_fullsized":"2024-04-01T02:12:38.672100+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":521,"log_dups_size":0,"ondisk_log_size":521,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:14:32.577522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3014274,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":389,"num_write_kb":12247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"23'508","reported_seq":531,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.702841+0000","last_change":"2024-04-01T01:55:49.248046+0000","last_active":"2024-04-01T02:12:38.702841+0000","last_peered":"2024-04-01T02:12:38.702841+0000","last_clean":"2024-04-01T02:12:38.702841+0000","last_became_active":"2024-04-01T01:55:49.247662+0000","last_became_peered":"2024-04-01T01:55:49.247662+0000","last_unstale":"2024-04-01T02:12:38.702841+0000","last_undegraded":"2024-04-01T02:12:38.702841+0000","last_fullsized":"2024-04-01T02:12:38.702841+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":508,"log_dups_size":0,"ondisk_log_size":508,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:59:26.879090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3985408,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":369,"num_write_kb":15794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"23'682","reported_seq":705,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.721747+0000","last_change":"2024-04-01T01:55:49.269484+0000","last_active":"2024-04-01T02:12:38.721747+0000","last_peered":"2024-04-01T02:12:38.721747+0000","last_clean":"2024-04-01T02:12:38.721747+0000","last_became_active":"2024-04-01T01:55:49.261839+0000","last_became_peered":"2024-04-01T01:55:49.261839+0000","last_unstale":"2024-04-01T02:12:38.721747+0000","last_undegraded":"2024-04-01T02:12:38.721747+0000","last_fullsized":"2024-04-01T02:12:38.721747+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":682,"log_dups_size":0,"ondisk_log_size":682,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:44:29.950624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6390669,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":553,"num_write_kb":46118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"23'595","reported_seq":618,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.734605+0000","last_change":"2024-04-01T01:55:49.276113+0000","last_active":"2024-04-01T02:12:38.734605+0000","last_peered":"2024-04-01T02:12:38.734605+0000","last_clean":"2024-04-01T02:12:38.734605+0000","last_became_active":"2024-04-01T01:55:49.275727+0000","last_became_peered":"2024-04-01T01:55:49.275727+0000","last_unstale":"2024-04-01T02:12:38.734605+0000","last_undegraded":"2024-04-01T02:12:38.734605+0000","last_fullsized":"2024-04-01T02:12:38.734605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":595,"log_dups_size":0,"ondisk_log_size":595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:50:59.209071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1955840,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":457,"num_write_kb":17131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"23'506","reported_seq":529,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.726548+0000","last_change":"2024-04-01T01:55:49.252859+0000","last_active":"2024-04-01T02:12:38.726548+0000","last_peered":"2024-04-01T02:12:38.726548+0000","last_clean":"2024-04-01T02:12:38.726548+0000","last_became_active":"2024-04-01T01:55:49.252553+0000","last_became_peered":"2024-04-01T01:55:49.252553+0000","last_unstale":"2024-04-01T02:12:38.726548+0000","last_undegraded":"2024-04-01T02:12:38.726548+0000","last_fullsized":"2024-04-01T02:12:38.726548+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":506,"log_dups_size":0,"ondisk_log_size":506,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:13:13.114168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5136348,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":357,"num_write_kb":34023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"23'525","reported_seq":548,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.713522+0000","last_change":"2024-04-01T01:55:49.260274+0000","last_active":"2024-04-01T02:12:38.713522+0000","last_peered":"2024-04-01T02:12:38.713522+0000","last_clean":"2024-04-01T02:12:38.713522+0000","last_became_active":"2024-04-01T01:55:49.259935+0000","last_became_peered":"2024-04-01T01:55:49.259935+0000","last_unstale":"2024-04-01T02:12:38.713522+0000","last_undegraded":"2024-04-01T02:12:38.713522+0000","last_fullsized":"2024-04-01T02:12:38.713522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":525,"log_dups_size":0,"ondisk_log_size":525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:24:55.348340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6314527,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":390,"num_write_kb":35275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"23'655","reported_seq":679,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.726007+0000","last_change":"2024-04-01T01:55:49.259523+0000","last_active":"2024-04-01T02:12:38.726007+0000","last_peered":"2024-04-01T02:12:38.726007+0000","last_clean":"2024-04-01T02:12:38.726007+0000","last_became_active":"2024-04-01T01:55:49.258670+0000","last_became_peered":"2024-04-01T01:55:49.258670+0000","last_unstale":"2024-04-01T02:12:38.726007+0000","last_undegraded":"2024-04-01T02:12:38.726007+0000","last_fullsized":"2024-04-01T02:12:38.726007+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":655,"log_dups_size":0,"ondisk_log_size":655,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3478562,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":525,"num_write_kb":13686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"23'528","reported_seq":551,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.713062+0000","last_change":"2024-04-01T01:55:49.243824+0000","last_active":"2024-04-01T02:12:38.713062+0000","last_peered":"2024-04-01T02:12:38.713062+0000","last_clean":"2024-04-01T02:12:38.713062+0000","last_became_active":"2024-04-01T01:55:49.243518+0000","last_became_peered":"2024-04-01T01:55:49.243518+0000","last_unstale":"2024-04-01T02:12:38.713062+0000","last_undegraded":"2024-04-01T02:12:38.713062+0000","last_fullsized":"2024-04-01T02:12:38.713062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:24:42.777720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1873749,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":387,"num_write_kb":9989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"23'557","reported_seq":580,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.697153+0000","last_change":"2024-04-01T01:55:49.258207+0000","last_active":"2024-04-01T02:12:38.697153+0000","last_peered":"2024-04-01T02:12:38.697153+0000","last_clean":"2024-04-01T02:12:38.697153+0000","last_became_active":"2024-04-01T01:55:49.257576+0000","last_became_peered":"2024-04-01T01:55:49.257576+0000","last_unstale":"2024-04-01T02:12:38.697153+0000","last_undegraded":"2024-04-01T02:12:38.697153+0000","last_fullsized":"2024-04-01T02:12:38.697153+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":557,"log_dups_size":0,"ondisk_log_size":557,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:13:13.114168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3745621,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":429,"num_write_kb":26683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"23'495","reported_seq":518,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.697781+0000","last_change":"2024-04-01T01:55:49.250832+0000","last_active":"2024-04-01T02:12:38.697781+0000","last_peered":"2024-04-01T02:12:38.697781+0000","last_clean":"2024-04-01T02:12:38.697781+0000","last_became_active":"2024-04-01T01:55:49.250522+0000","last_became_peered":"2024-04-01T01:55:49.250522+0000","last_unstale":"2024-04-01T02:12:38.697781+0000","last_undegraded":"2024-04-01T02:12:38.697781+0000","last_fullsized":"2024-04-01T02:12:38.697781+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:47:04.592262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1694624,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":361,"num_write_kb":9747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"23'519","reported_seq":542,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.712726+0000","last_change":"2024-04-01T01:55:49.270067+0000","last_active":"2024-04-01T02:12:38.712726+0000","last_peered":"2024-04-01T02:12:38.712726+0000","last_clean":"2024-04-01T02:12:38.712726+0000","last_became_active":"2024-04-01T01:55:49.269694+0000","last_became_peered":"2024-04-01T01:55:49.269694+0000","last_unstale":"2024-04-01T02:12:38.712726+0000","last_undegraded":"2024-04-01T02:12:38.712726+0000","last_fullsized":"2024-04-01T02:12:38.712726+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":519,"log_dups_size":0,"ondisk_log_size":519,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:21:46.367144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4783138,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384,"num_write_kb":12273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"23'556","reported_seq":579,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.722272+0000","last_change":"2024-04-01T01:55:49.243460+0000","last_active":"2024-04-01T02:12:38.722272+0000","last_peered":"2024-04-01T02:12:38.722272+0000","last_clean":"2024-04-01T02:12:38.722272+0000","last_became_active":"2024-04-01T01:55:49.243017+0000","last_became_peered":"2024-04-01T01:55:49.243017+0000","last_unstale":"2024-04-01T02:12:38.722272+0000","last_undegraded":"2024-04-01T02:12:38.722272+0000","last_fullsized":"2024-04-01T02:12:38.722272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":556,"log_dups_size":0,"ondisk_log_size":556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:20:18.156798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3977024,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":423,"num_write_kb":11436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"23'580","reported_seq":603,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.740597+0000","last_change":"2024-04-01T01:55:49.280226+0000","last_active":"2024-04-01T02:12:38.740597+0000","last_peered":"2024-04-01T02:12:38.740597+0000","last_clean":"2024-04-01T02:12:38.740597+0000","last_became_active":"2024-04-01T01:55:49.279882+0000","last_became_peered":"2024-04-01T01:55:49.279882+0000","last_unstale":"2024-04-01T02:12:38.740597+0000","last_undegraded":"2024-04-01T02:12:38.740597+0000","last_fullsized":"2024-04-01T02:12:38.740597+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":580,"log_dups_size":0,"ondisk_log_size":580,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:06:48.999905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8142848,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":413,"num_write_kb":37888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"23'766","reported_seq":789,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.659698+0000","last_change":"2024-04-01T01:55:49.249890+0000","last_active":"2024-04-01T02:12:38.659698+0000","last_peered":"2024-04-01T02:12:38.659698+0000","last_clean":"2024-04-01T02:12:38.659698+0000","last_became_active":"2024-04-01T01:55:49.249588+0000","last_became_peered":"2024-04-01T01:55:49.249588+0000","last_unstale":"2024-04-01T02:12:38.659698+0000","last_undegraded":"2024-04-01T02:12:38.659698+0000","last_fullsized":"2024-04-01T02:12:38.659698+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":766,"log_dups_size":0,"ondisk_log_size":766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:02:25.180455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4497408,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":644,"num_write_kb":39031,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"23'440","reported_seq":463,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.674903+0000","last_change":"2024-04-01T01:55:49.254529+0000","last_active":"2024-04-01T02:12:38.674903+0000","last_peered":"2024-04-01T02:12:38.674903+0000","last_clean":"2024-04-01T02:12:38.674903+0000","last_became_active":"2024-04-01T01:55:49.253726+0000","last_became_peered":"2024-04-01T01:55:49.253726+0000","last_unstale":"2024-04-01T02:12:38.674903+0000","last_undegraded":"2024-04-01T02:12:38.674903+0000","last_fullsized":"2024-04-01T02:12:38.674903+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:55:44.175129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2117070,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":308,"num_write_kb":8584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"23'485","reported_seq":509,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.676378+0000","last_change":"2024-04-01T01:55:49.252043+0000","last_active":"2024-04-01T02:12:38.676378+0000","last_peered":"2024-04-01T02:12:38.676378+0000","last_clean":"2024-04-01T02:12:38.676378+0000","last_became_active":"2024-04-01T01:55:49.251760+0000","last_became_peered":"2024-04-01T01:55:49.251760+0000","last_unstale":"2024-04-01T02:12:38.676378+0000","last_undegraded":"2024-04-01T02:12:38.676378+0000","last_fullsized":"2024-04-01T02:12:38.676378+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:12:25.325040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1909794,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":354,"num_write_kb":10727,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"23'882","reported_seq":906,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.722329+0000","last_change":"2024-04-01T01:55:49.270451+0000","last_active":"2024-04-01T02:12:38.722329+0000","last_peered":"2024-04-01T02:12:38.722329+0000","last_clean":"2024-04-01T02:12:38.722329+0000","last_became_active":"2024-04-01T01:55:49.269636+0000","last_became_peered":"2024-04-01T01:55:49.269636+0000","last_unstale":"2024-04-01T02:12:38.722329+0000","last_undegraded":"2024-04-01T02:12:38.722329+0000","last_fullsized":"2024-04-01T02:12:38.722329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":882,"log_dups_size":0,"ondisk_log_size":882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:11:14.234867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6037504,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":748,"num_write_kb":31167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"23'555","reported_seq":579,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.683302+0000","last_change":"2024-04-01T01:55:49.266187+0000","last_active":"2024-04-01T02:12:38.683302+0000","last_peered":"2024-04-01T02:12:38.683302+0000","last_clean":"2024-04-01T02:12:38.683302+0000","last_became_active":"2024-04-01T01:55:49.265946+0000","last_became_peered":"2024-04-01T01:55:49.265946+0000","last_unstale":"2024-04-01T02:12:38.683302+0000","last_undegraded":"2024-04-01T02:12:38.683302+0000","last_fullsized":"2024-04-01T02:12:38.683302+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":555,"log_dups_size":0,"ondisk_log_size":555,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:37:46.890765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4188782,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":415,"num_write_kb":13639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"23'519","reported_seq":543,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.715900+0000","last_change":"2024-04-01T01:55:49.273104+0000","last_active":"2024-04-01T02:12:38.715900+0000","last_peered":"2024-04-01T02:12:38.715900+0000","last_clean":"2024-04-01T02:12:38.715900+0000","last_became_active":"2024-04-01T01:55:49.272742+0000","last_became_peered":"2024-04-01T01:55:49.272742+0000","last_unstale":"2024-04-01T02:12:38.715900+0000","last_undegraded":"2024-04-01T02:12:38.715900+0000","last_fullsized":"2024-04-01T02:12:38.715900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":519,"log_dups_size":0,"ondisk_log_size":519,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:37:46.890765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2869248,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":375,"num_write_kb":19168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"23'536","reported_seq":558,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.691868+0000","last_change":"2024-04-01T01:55:49.241595+0000","last_active":"2024-04-01T02:12:38.691868+0000","last_peered":"2024-04-01T02:12:38.691868+0000","last_clean":"2024-04-01T02:12:38.691868+0000","last_became_active":"2024-04-01T01:55:49.238286+0000","last_became_peered":"2024-04-01T01:55:49.238286+0000","last_unstale":"2024-04-01T02:12:38.691868+0000","last_undegraded":"2024-04-01T02:12:38.691868+0000","last_fullsized":"2024-04-01T02:12:38.691868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":536,"log_dups_size":0,"ondisk_log_size":536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:06:48.999905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6652831,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":403,"num_write_kb":17955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"23'644","reported_seq":668,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:08:21.199984+0000","last_change":"2024-04-01T01:55:48.225145+0000","last_active":"2024-04-01T02:08:21.199984+0000","last_peered":"2024-04-01T02:08:21.199984+0000","last_clean":"2024-04-01T02:08:21.199984+0000","last_became_active":"2024-04-01T01:55:48.224408+0000","last_became_peered":"2024-04-01T01:55:48.224408+0000","last_unstale":"2024-04-01T02:08:21.199984+0000","last_undegraded":"2024-04-01T02:08:21.199984+0000","last_fullsized":"2024-04-01T02:08:21.199984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":644,"log_dups_size":0,"ondisk_log_size":644,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:41:59.465915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":643,"num_write_kb":4346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"23'476","reported_seq":498,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.721153+0000","last_change":"2024-04-01T01:55:49.247771+0000","last_active":"2024-04-01T02:12:38.721153+0000","last_peered":"2024-04-01T02:12:38.721153+0000","last_clean":"2024-04-01T02:12:38.721153+0000","last_became_active":"2024-04-01T01:55:49.247496+0000","last_became_peered":"2024-04-01T01:55:49.247496+0000","last_unstale":"2024-04-01T02:12:38.721153+0000","last_undegraded":"2024-04-01T02:12:38.721153+0000","last_fullsized":"2024-04-01T02:12:38.721153+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":476,"log_dups_size":0,"ondisk_log_size":476,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:02:25.180455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3922463,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":358,"num_write_kb":10126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"23'1940","reported_seq":1964,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:47.532543+0000","last_change":"2024-04-01T01:55:48.221934+0000","last_active":"2024-04-01T02:12:47.532543+0000","last_peered":"2024-04-01T02:12:47.532543+0000","last_clean":"2024-04-01T02:12:47.532543+0000","last_became_active":"2024-04-01T01:55:48.221614+0000","last_became_peered":"2024-04-01T01:55:48.221614+0000","last_unstale":"2024-04-01T02:12:47.532543+0000","last_undegraded":"2024-04-01T02:12:47.532543+0000","last_fullsized":"2024-04-01T02:12:47.532543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":1940,"log_dups_size":0,"ondisk_log_size":1940,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:06:47.990123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16738373,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1936,"num_write_kb":17229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"23'393","reported_seq":417,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:10:16.229529+0000","last_change":"2024-04-01T01:55:48.217879+0000","last_active":"2024-04-01T02:10:16.229529+0000","last_peered":"2024-04-01T02:10:16.229529+0000","last_clean":"2024-04-01T02:10:16.229529+0000","last_became_active":"2024-04-01T01:55:48.216141+0000","last_became_peered":"2024-04-01T01:55:48.216141+0000","last_unstale":"2024-04-01T02:10:16.229529+0000","last_undegraded":"2024-04-01T02:10:16.229529+0000","last_fullsized":"2024-04-01T02:10:16.229529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:36:42.625449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":392,"num_write_kb":4245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"23'553","reported_seq":576,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.688353+0000","last_change":"2024-04-01T01:55:49.246424+0000","last_active":"2024-04-01T02:12:38.688353+0000","last_peered":"2024-04-01T02:12:38.688353+0000","last_clean":"2024-04-01T02:12:38.688353+0000","last_became_active":"2024-04-01T01:55:49.243823+0000","last_became_peered":"2024-04-01T01:55:49.243823+0000","last_unstale":"2024-04-01T02:12:38.688353+0000","last_undegraded":"2024-04-01T02:12:38.688353+0000","last_fullsized":"2024-04-01T02:12:38.688353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":553,"log_dups_size":0,"ondisk_log_size":553,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:27:45.663474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3965184,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":412,"num_write_kb":14098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"23'1752","reported_seq":1777,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:11:59.821172+0000","last_change":"2024-04-01T01:55:48.222831+0000","last_active":"2024-04-01T02:11:59.821172+0000","last_peered":"2024-04-01T02:11:59.821172+0000","last_clean":"2024-04-01T02:11:59.821172+0000","last_became_active":"2024-04-01T01:55:48.222535+0000","last_became_peered":"2024-04-01T01:55:48.222535+0000","last_unstale":"2024-04-01T02:11:59.821172+0000","last_undegraded":"2024-04-01T02:11:59.821172+0000","last_fullsized":"2024-04-01T02:11:59.821172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":1752,"log_dups_size":0,"ondisk_log_size":1752,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:49:34.960786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1749,"num_write_kb":12993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"23'533","reported_seq":555,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.685623+0000","last_change":"2024-04-01T01:55:49.231967+0000","last_active":"2024-04-01T02:12:38.685623+0000","last_peered":"2024-04-01T02:12:38.685623+0000","last_clean":"2024-04-01T02:12:38.685623+0000","last_became_active":"2024-04-01T01:55:49.230659+0000","last_became_peered":"2024-04-01T01:55:49.230659+0000","last_unstale":"2024-04-01T02:12:38.685623+0000","last_undegraded":"2024-04-01T02:12:38.685623+0000","last_fullsized":"2024-04-01T02:12:38.685623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":533,"log_dups_size":0,"ondisk_log_size":533,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:57:31.843504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3477908,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":407,"num_write_kb":10690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"23'1","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:10:18.221449+0000","last_change":"2024-04-01T01:55:48.216724+0000","last_active":"2024-04-01T02:10:18.221449+0000","last_peered":"2024-04-01T02:10:18.221449+0000","last_clean":"2024-04-01T02:10:18.221449+0000","last_became_active":"2024-04-01T01:55:48.216318+0000","last_became_peered":"2024-04-01T01:55:48.216318+0000","last_unstale":"2024-04-01T02:10:18.221449+0000","last_undegraded":"2024-04-01T02:10:18.221449+0000","last_fullsized":"2024-04-01T02:10:18.221449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:25:51.219789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"23'551","reported_seq":574,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.741357+0000","last_change":"2024-04-01T01:55:49.280230+0000","last_active":"2024-04-01T02:12:38.741357+0000","last_peered":"2024-04-01T02:12:38.741357+0000","last_clean":"2024-04-01T02:12:38.741357+0000","last_became_active":"2024-04-01T01:55:49.279866+0000","last_became_peered":"2024-04-01T01:55:49.279866+0000","last_unstale":"2024-04-01T02:12:38.741357+0000","last_undegraded":"2024-04-01T02:12:38.741357+0000","last_fullsized":"2024-04-01T02:12:38.741357+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":551,"log_dups_size":0,"ondisk_log_size":551,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:00:34.607980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2636189,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":401,"num_write_kb":10506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"23'494","reported_seq":520,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:43.112391+0000","last_change":"2024-04-01T01:55:48.213879+0000","last_active":"2024-04-01T02:12:43.112391+0000","last_peered":"2024-04-01T02:12:43.112391+0000","last_clean":"2024-04-01T02:12:43.112391+0000","last_became_active":"2024-04-01T01:55:48.213610+0000","last_became_peered":"2024-04-01T01:55:48.213610+0000","last_unstale":"2024-04-01T02:12:43.112391+0000","last_undegraded":"2024-04-01T02:12:43.112391+0000","last_fullsized":"2024-04-01T02:12:43.112391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":494,"log_dups_size":0,"ondisk_log_size":494,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":490,"num_write_kb":4342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"23'507","reported_seq":530,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.712401+0000","last_change":"2024-04-01T01:55:49.261532+0000","last_active":"2024-04-01T02:12:38.712401+0000","last_peered":"2024-04-01T02:12:38.712401+0000","last_clean":"2024-04-01T02:12:38.712401+0000","last_became_active":"2024-04-01T01:55:49.261260+0000","last_became_peered":"2024-04-01T01:55:49.261260+0000","last_unstale":"2024-04-01T02:12:38.712401+0000","last_undegraded":"2024-04-01T02:12:38.712401+0000","last_fullsized":"2024-04-01T02:12:38.712401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":507,"log_dups_size":0,"ondisk_log_size":507,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:30:02.149564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2169152,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":377,"num_write_kb":10428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"23'1317","reported_seq":1342,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:37.139675+0000","last_change":"2024-04-01T01:55:48.227054+0000","last_active":"2024-04-01T02:12:37.139675+0000","last_peered":"2024-04-01T02:12:37.139675+0000","last_clean":"2024-04-01T02:12:37.139675+0000","last_became_active":"2024-04-01T01:55:48.226061+0000","last_became_peered":"2024-04-01T01:55:48.226061+0000","last_unstale":"2024-04-01T02:12:37.139675+0000","last_undegraded":"2024-04-01T02:12:37.139675+0000","last_fullsized":"2024-04-01T02:12:37.139675+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":1317,"log_dups_size":0,"ondisk_log_size":1317,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:18:27.840431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1316,"num_write_kb":5169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"23'650","reported_seq":673,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.727577+0000","last_change":"2024-04-01T01:55:49.261662+0000","last_active":"2024-04-01T02:12:38.727577+0000","last_peered":"2024-04-01T02:12:38.727577+0000","last_clean":"2024-04-01T02:12:38.727577+0000","last_became_active":"2024-04-01T01:55:49.261286+0000","last_became_peered":"2024-04-01T01:55:49.261286+0000","last_unstale":"2024-04-01T02:12:38.727577+0000","last_undegraded":"2024-04-01T02:12:38.727577+0000","last_fullsized":"2024-04-01T02:12:38.727577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":650,"log_dups_size":0,"ondisk_log_size":650,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:56:11.350186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3031627,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":532,"num_write_kb":22303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"23'1654","reported_seq":1679,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:23.004257+0000","last_change":"2024-04-01T01:55:48.219739+0000","last_active":"2024-04-01T02:12:23.004257+0000","last_peered":"2024-04-01T02:12:23.004257+0000","last_clean":"2024-04-01T02:12:23.004257+0000","last_became_active":"2024-04-01T01:55:48.219107+0000","last_became_peered":"2024-04-01T01:55:48.219107+0000","last_unstale":"2024-04-01T02:12:23.004257+0000","last_undegraded":"2024-04-01T02:12:23.004257+0000","last_fullsized":"2024-04-01T02:12:23.004257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":1654,"log_dups_size":0,"ondisk_log_size":1654,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:14:12.790111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1651,"num_write_kb":13025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"23'479","reported_seq":503,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:47.814882+0000","last_change":"2024-04-01T01:55:49.255056+0000","last_active":"2024-04-01T02:12:47.814882+0000","last_peered":"2024-04-01T02:12:47.814882+0000","last_clean":"2024-04-01T02:12:47.814882+0000","last_became_active":"2024-04-01T01:55:49.247910+0000","last_became_peered":"2024-04-01T01:55:49.247910+0000","last_unstale":"2024-04-01T02:12:47.814882+0000","last_undegraded":"2024-04-01T02:12:47.814882+0000","last_fullsized":"2024-04-01T02:12:47.814882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":479,"log_dups_size":0,"ondisk_log_size":479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3214612,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":324,"num_write_kb":15075,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"23'1306","reported_seq":1331,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:09:48.210530+0000","last_change":"2024-04-01T01:55:48.215613+0000","last_active":"2024-04-01T02:09:48.210530+0000","last_peered":"2024-04-01T02:09:48.210530+0000","last_clean":"2024-04-01T02:09:48.210530+0000","last_became_active":"2024-04-01T01:55:48.214669+0000","last_became_peered":"2024-04-01T01:55:48.214669+0000","last_unstale":"2024-04-01T02:09:48.210530+0000","last_undegraded":"2024-04-01T02:09:48.210530+0000","last_fullsized":"2024-04-01T02:09:48.210530+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":1306,"log_dups_size":0,"ondisk_log_size":1306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:25:51.219789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1305,"num_write_kb":8736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"23'502","reported_seq":525,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.703951+0000","last_change":"2024-04-01T01:55:49.270153+0000","last_active":"2024-04-01T02:12:38.703951+0000","last_peered":"2024-04-01T02:12:38.703951+0000","last_clean":"2024-04-01T02:12:38.703951+0000","last_became_active":"2024-04-01T01:55:49.269840+0000","last_became_peered":"2024-04-01T01:55:49.269840+0000","last_unstale":"2024-04-01T02:12:38.703951+0000","last_undegraded":"2024-04-01T02:12:38.703951+0000","last_fullsized":"2024-04-01T02:12:38.703951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":502,"log_dups_size":0,"ondisk_log_size":502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:00:34.607980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2873887,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":372,"num_write_kb":10690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:09:48.231670+0000","last_change":"2024-04-01T01:55:48.214783+0000","last_active":"2024-04-01T02:09:48.231670+0000","last_peered":"2024-04-01T02:09:48.231670+0000","last_clean":"2024-04-01T02:09:48.231670+0000","last_became_active":"2024-04-01T01:55:48.213463+0000","last_became_peered":"2024-04-01T01:55:48.213463+0000","last_unstale":"2024-04-01T02:09:48.231670+0000","last_undegraded":"2024-04-01T02:09:48.231670+0000","last_fullsized":"2024-04-01T02:09:48.231670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:00:33.598198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"23'694","reported_seq":717,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.732478+0000","last_change":"2024-04-01T01:55:49.274841+0000","last_active":"2024-04-01T02:12:38.732478+0000","last_peered":"2024-04-01T02:12:38.732478+0000","last_clean":"2024-04-01T02:12:38.732478+0000","last_became_active":"2024-04-01T01:55:49.274430+0000","last_became_peered":"2024-04-01T01:55:49.274430+0000","last_unstale":"2024-04-01T02:12:38.732478+0000","last_undegraded":"2024-04-01T02:12:38.732478+0000","last_fullsized":"2024-04-01T02:12:38.732478+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":694,"log_dups_size":0,"ondisk_log_size":694,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T13:25:36.254927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1869911,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":559,"num_write_kb":109429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:08.109126+0000","last_change":"2024-04-01T01:55:48.210944+0000","last_active":"2024-04-01T02:12:08.109126+0000","last_peered":"2024-04-01T02:12:08.109126+0000","last_clean":"2024-04-01T02:12:08.109126+0000","last_became_active":"2024-04-01T01:55:48.210616+0000","last_became_peered":"2024-04-01T01:55:48.210616+0000","last_unstale":"2024-04-01T02:12:08.109126+0000","last_undegraded":"2024-04-01T02:12:08.109126+0000","last_fullsized":"2024-04-01T02:12:08.109126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"23'514","reported_seq":537,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.691443+0000","last_change":"2024-04-01T01:55:49.239528+0000","last_active":"2024-04-01T02:12:38.691443+0000","last_peered":"2024-04-01T02:12:38.691443+0000","last_clean":"2024-04-01T02:12:38.691443+0000","last_became_active":"2024-04-01T01:55:49.238805+0000","last_became_peered":"2024-04-01T01:55:49.238805+0000","last_unstale":"2024-04-01T02:12:38.691443+0000","last_undegraded":"2024-04-01T02:12:38.691443+0000","last_fullsized":"2024-04-01T02:12:38.691443+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":514,"log_dups_size":0,"ondisk_log_size":514,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:37:46.890765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1821215,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":368,"num_write_kb":8386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"23'816","reported_seq":841,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:11:05.530786+0000","last_change":"2024-04-01T01:55:48.211677+0000","last_active":"2024-04-01T02:11:05.530786+0000","last_peered":"2024-04-01T02:11:05.530786+0000","last_clean":"2024-04-01T02:11:05.530786+0000","last_became_active":"2024-04-01T01:55:48.210893+0000","last_became_peered":"2024-04-01T01:55:48.210893+0000","last_unstale":"2024-04-01T02:11:05.530786+0000","last_undegraded":"2024-04-01T02:11:05.530786+0000","last_fullsized":"2024-04-01T02:11:05.530786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:04:19.568533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":818,"num_write_kb":8585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"23'607","reported_seq":630,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.717565+0000","last_change":"2024-04-01T01:55:49.261872+0000","last_active":"2024-04-01T02:12:38.717565+0000","last_peered":"2024-04-01T02:12:38.717565+0000","last_clean":"2024-04-01T02:12:38.717565+0000","last_became_active":"2024-04-01T01:55:49.261517+0000","last_became_peered":"2024-04-01T01:55:49.261517+0000","last_unstale":"2024-04-01T02:12:38.717565+0000","last_undegraded":"2024-04-01T02:12:38.717565+0000","last_fullsized":"2024-04-01T02:12:38.717565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":607,"log_dups_size":0,"ondisk_log_size":607,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T13:02:55.577616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5805184,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":464,"num_write_kb":32813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"23'422","reported_seq":448,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:11:38.106882+0000","last_change":"2024-04-01T01:55:48.198687+0000","last_active":"2024-04-01T02:11:38.106882+0000","last_peered":"2024-04-01T02:11:38.106882+0000","last_clean":"2024-04-01T02:11:38.106882+0000","last_became_active":"2024-04-01T01:55:48.198319+0000","last_became_peered":"2024-04-01T01:55:48.198319+0000","last_unstale":"2024-04-01T02:11:38.106882+0000","last_undegraded":"2024-04-01T02:11:38.106882+0000","last_fullsized":"2024-04-01T02:11:38.106882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":421,"num_write_kb":4293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"23'517","reported_seq":540,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.738045+0000","last_change":"2024-04-01T01:55:49.272424+0000","last_active":"2024-04-01T02:12:38.738045+0000","last_peered":"2024-04-01T02:12:38.738045+0000","last_clean":"2024-04-01T02:12:38.738045+0000","last_became_active":"2024-04-01T01:55:49.265670+0000","last_became_peered":"2024-04-01T01:55:49.265670+0000","last_unstale":"2024-04-01T02:12:38.738045+0000","last_undegraded":"2024-04-01T02:12:38.738045+0000","last_fullsized":"2024-04-01T02:12:38.738045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":517,"log_dups_size":0,"ondisk_log_size":517,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:26:09.632757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4958208,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":395,"num_write_kb":11184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"23'500","reported_seq":525,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:09:22.676923+0000","last_change":"2024-04-01T01:55:48.219312+0000","last_active":"2024-04-01T02:09:22.676923+0000","last_peered":"2024-04-01T02:09:22.676923+0000","last_clean":"2024-04-01T02:09:22.676923+0000","last_became_active":"2024-04-01T01:55:48.218562+0000","last_became_peered":"2024-04-01T01:55:48.218562+0000","last_unstale":"2024-04-01T02:09:22.676923+0000","last_undegraded":"2024-04-01T02:09:22.676923+0000","last_fullsized":"2024-04-01T02:09:22.676923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":500,"log_dups_size":0,"ondisk_log_size":500,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:38:32.247471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":500,"num_write_kb":4281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"23'489","reported_seq":513,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.733469+0000","last_change":"2024-04-01T01:55:49.268041+0000","last_active":"2024-04-01T02:12:38.733469+0000","last_peered":"2024-04-01T02:12:38.733469+0000","last_clean":"2024-04-01T02:12:38.733469+0000","last_became_active":"2024-04-01T01:55:49.267502+0000","last_became_peered":"2024-04-01T01:55:49.267502+0000","last_unstale":"2024-04-01T02:12:38.733469+0000","last_undegraded":"2024-04-01T02:12:38.733469+0000","last_fullsized":"2024-04-01T02:12:38.733469+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":489,"log_dups_size":0,"ondisk_log_size":489,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2609152,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":355,"num_write_kb":9167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"23'652","reported_seq":677,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:09:21.209057+0000","last_change":"2024-04-01T01:55:48.216662+0000","last_active":"2024-04-01T02:09:21.209057+0000","last_peered":"2024-04-01T02:09:21.209057+0000","last_clean":"2024-04-01T02:09:21.209057+0000","last_became_active":"2024-04-01T01:55:48.215852+0000","last_became_peered":"2024-04-01T01:55:48.215852+0000","last_unstale":"2024-04-01T02:09:21.209057+0000","last_undegraded":"2024-04-01T02:09:21.209057+0000","last_fullsized":"2024-04-01T02:09:21.209057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":652,"log_dups_size":0,"ondisk_log_size":652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:25:39.713293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":651,"num_write_kb":4358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"23'532","reported_seq":556,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.723439+0000","last_change":"2024-04-01T01:55:49.256142+0000","last_active":"2024-04-01T02:12:38.723439+0000","last_peered":"2024-04-01T02:12:38.723439+0000","last_clean":"2024-04-01T02:12:38.723439+0000","last_became_active":"2024-04-01T01:55:49.255781+0000","last_became_peered":"2024-04-01T01:55:49.255781+0000","last_unstale":"2024-04-01T02:12:38.723439+0000","last_undegraded":"2024-04-01T02:12:38.723439+0000","last_fullsized":"2024-04-01T02:12:38.723439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":532,"log_dups_size":0,"ondisk_log_size":532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3486100,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384,"num_write_kb":10452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"23'482","reported_seq":507,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:07.732858+0000","last_change":"2024-04-01T01:55:48.219851+0000","last_active":"2024-04-01T02:12:07.732858+0000","last_peered":"2024-04-01T02:12:07.732858+0000","last_clean":"2024-04-01T02:12:07.732858+0000","last_became_active":"2024-04-01T01:55:48.215898+0000","last_became_peered":"2024-04-01T01:55:48.215898+0000","last_unstale":"2024-04-01T02:12:07.732858+0000","last_undegraded":"2024-04-01T02:12:07.732858+0000","last_fullsized":"2024-04-01T02:12:07.732858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:18:27.840431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":481,"num_write_kb":4326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"23'543","reported_seq":566,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.725313+0000","last_change":"2024-04-01T01:55:49.275452+0000","last_active":"2024-04-01T02:12:38.725313+0000","last_peered":"2024-04-01T02:12:38.725313+0000","last_clean":"2024-04-01T02:12:38.725313+0000","last_became_active":"2024-04-01T01:55:49.274600+0000","last_became_peered":"2024-04-01T01:55:49.274600+0000","last_unstale":"2024-04-01T02:12:38.725313+0000","last_undegraded":"2024-04-01T02:12:38.725313+0000","last_fullsized":"2024-04-01T02:12:38.725313+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":543,"log_dups_size":0,"ondisk_log_size":543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:19:24.052574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3740270,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":421,"num_write_kb":13583,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":182,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:09:43.218713+0000","last_change":"2024-04-01T01:55:43.145201+0000","last_active":"2024-04-01T02:09:43.218713+0000","last_peered":"2024-04-01T02:09:43.218713+0000","last_clean":"2024-04-01T02:09:43.218713+0000","last_became_active":"2024-04-01T01:55:43.144882+0000","last_became_peered":"2024-04-01T01:55:43.144882+0000","last_unstale":"2024-04-01T02:09:43.218713+0000","last_undegraded":"2024-04-01T02:09:43.218713+0000","last_fullsized":"2024-04-01T02:09:43.218713+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:42.134502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:42.134502+0000","last_clean_scrub_stamp":"2024-04-01T01:55:42.134502+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:02:26.589535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"23'539","reported_seq":565,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:11:39.852771+0000","last_change":"2024-04-01T01:55:48.207222+0000","last_active":"2024-04-01T02:11:39.852771+0000","last_peered":"2024-04-01T02:11:39.852771+0000","last_clean":"2024-04-01T02:11:39.852771+0000","last_became_active":"2024-04-01T01:55:48.206293+0000","last_became_peered":"2024-04-01T01:55:48.206293+0000","last_unstale":"2024-04-01T02:11:39.852771+0000","last_undegraded":"2024-04-01T02:11:39.852771+0000","last_fullsized":"2024-04-01T02:11:39.852771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":539,"log_dups_size":0,"ondisk_log_size":539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:37:45.880984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":538,"num_write_kb":4366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"23'475","reported_seq":499,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.699425+0000","last_change":"2024-04-01T01:55:49.273517+0000","last_active":"2024-04-01T02:12:38.699425+0000","last_peered":"2024-04-01T02:12:38.699425+0000","last_clean":"2024-04-01T02:12:38.699425+0000","last_became_active":"2024-04-01T01:55:49.273197+0000","last_became_peered":"2024-04-01T01:55:49.273197+0000","last_unstale":"2024-04-01T02:12:38.699425+0000","last_undegraded":"2024-04-01T02:12:38.699425+0000","last_fullsized":"2024-04-01T02:12:38.699425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:14:32.577522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2100352,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":362,"num_write_kb":7512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"23'1724","reported_seq":1750,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:11:27.553670+0000","last_change":"2024-04-01T01:55:48.214341+0000","last_active":"2024-04-01T02:11:27.553670+0000","last_peered":"2024-04-01T02:11:27.553670+0000","last_clean":"2024-04-01T02:11:27.553670+0000","last_became_active":"2024-04-01T01:55:48.213914+0000","last_became_peered":"2024-04-01T01:55:48.213914+0000","last_unstale":"2024-04-01T02:11:27.553670+0000","last_undegraded":"2024-04-01T02:11:27.553670+0000","last_fullsized":"2024-04-01T02:11:27.553670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":1724,"log_dups_size":0,"ondisk_log_size":1724,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:09:28.276592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1721,"num_write_kb":12994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"23'521","reported_seq":545,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.699651+0000","last_change":"2024-04-01T01:55:49.272106+0000","last_active":"2024-04-01T02:12:38.699651+0000","last_peered":"2024-04-01T02:12:38.699651+0000","last_clean":"2024-04-01T02:12:38.699651+0000","last_became_active":"2024-04-01T01:55:49.271821+0000","last_became_peered":"2024-04-01T01:55:49.271821+0000","last_unstale":"2024-04-01T02:12:38.699651+0000","last_undegraded":"2024-04-01T02:12:38.699651+0000","last_fullsized":"2024-04-01T02:12:38.699651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":521,"log_dups_size":0,"ondisk_log_size":521,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T13:22:31.821166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2398580,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":392,"num_write_kb":9213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"23'1760","reported_seq":3545,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:37.134355+0000","last_change":"2024-04-01T01:55:48.218296+0000","last_active":"2024-04-01T02:12:37.134355+0000","last_peered":"2024-04-01T02:12:37.134355+0000","last_clean":"2024-04-01T02:12:37.134355+0000","last_became_active":"2024-04-01T01:55:48.217516+0000","last_became_peered":"2024-04-01T01:55:48.217516+0000","last_unstale":"2024-04-01T02:12:37.134355+0000","last_undegraded":"2024-04-01T02:12:37.134355+0000","last_fullsized":"2024-04-01T02:12:37.134355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":1760,"log_dups_size":0,"ondisk_log_size":1760,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:36:42.625449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1520757,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1759,"num_read_kb":2743,"num_write":1759,"num_write_kb":2743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"23'578","reported_seq":602,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.683159+0000","last_change":"2024-04-01T01:55:49.246734+0000","last_active":"2024-04-01T02:12:38.683159+0000","last_peered":"2024-04-01T02:12:38.683159+0000","last_clean":"2024-04-01T02:12:38.683159+0000","last_became_active":"2024-04-01T01:55:49.246152+0000","last_became_peered":"2024-04-01T01:55:49.246152+0000","last_unstale":"2024-04-01T02:12:38.683159+0000","last_undegraded":"2024-04-01T02:12:38.683159+0000","last_fullsized":"2024-04-01T02:12:38.683159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":578,"log_dups_size":0,"ondisk_log_size":578,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:52:34.992185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4683946,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":447,"num_write_kb":12840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"23'1294","reported_seq":1320,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:10:23.234493+0000","last_change":"2024-04-01T01:55:48.222956+0000","last_active":"2024-04-01T02:10:23.234493+0000","last_peered":"2024-04-01T02:10:23.234493+0000","last_clean":"2024-04-01T02:10:23.234493+0000","last_became_active":"2024-04-01T01:55:48.222414+0000","last_became_peered":"2024-04-01T01:55:48.222414+0000","last_unstale":"2024-04-01T02:10:23.234493+0000","last_undegraded":"2024-04-01T02:10:23.234493+0000","last_fullsized":"2024-04-01T02:10:23.234493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":1294,"log_dups_size":0,"ondisk_log_size":1294,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:26:08.622975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1292,"num_write_kb":8711,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"23'509","reported_seq":534,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.735044+0000","last_change":"2024-04-01T01:55:49.247633+0000","last_active":"2024-04-01T02:12:38.735044+0000","last_peered":"2024-04-01T02:12:38.735044+0000","last_clean":"2024-04-01T02:12:38.735044+0000","last_became_active":"2024-04-01T01:55:49.247285+0000","last_became_peered":"2024-04-01T01:55:49.247285+0000","last_unstale":"2024-04-01T02:12:38.735044+0000","last_undegraded":"2024-04-01T02:12:38.735044+0000","last_fullsized":"2024-04-01T02:12:38.735044+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":509,"log_dups_size":0,"ondisk_log_size":509,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1905973,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":374,"num_write_kb":9925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"23'411","reported_seq":437,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:11:49.203845+0000","last_change":"2024-04-01T01:55:48.226323+0000","last_active":"2024-04-01T02:11:49.203845+0000","last_peered":"2024-04-01T02:11:49.203845+0000","last_clean":"2024-04-01T02:11:49.203845+0000","last_became_active":"2024-04-01T01:55:48.225487+0000","last_became_peered":"2024-04-01T01:55:48.225487+0000","last_unstale":"2024-04-01T02:11:49.203845+0000","last_undegraded":"2024-04-01T02:11:49.203845+0000","last_fullsized":"2024-04-01T02:11:49.203845+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:13:17.832963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":410,"num_write_kb":4283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"23'561","reported_seq":585,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.695026+0000","last_change":"2024-04-01T01:55:49.265542+0000","last_active":"2024-04-01T02:12:38.695026+0000","last_peered":"2024-04-01T02:12:38.695026+0000","last_clean":"2024-04-01T02:12:38.695026+0000","last_became_active":"2024-04-01T01:55:49.264914+0000","last_became_peered":"2024-04-01T01:55:49.264914+0000","last_unstale":"2024-04-01T02:12:38.695026+0000","last_undegraded":"2024-04-01T02:12:38.695026+0000","last_fullsized":"2024-04-01T02:12:38.695026+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":561,"log_dups_size":0,"ondisk_log_size":561,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:55:44.175129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3471816,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":416,"num_write_kb":10624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"23'809","reported_seq":835,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:11:54.724715+0000","last_change":"2024-04-01T01:55:48.227292+0000","last_active":"2024-04-01T02:11:54.724715+0000","last_peered":"2024-04-01T02:11:54.724715+0000","last_clean":"2024-04-01T02:11:54.724715+0000","last_became_active":"2024-04-01T01:55:48.226948+0000","last_became_peered":"2024-04-01T01:55:48.226948+0000","last_unstale":"2024-04-01T02:11:54.724715+0000","last_undegraded":"2024-04-01T02:11:54.724715+0000","last_fullsized":"2024-04-01T02:11:54.724715+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":809,"log_dups_size":0,"ondisk_log_size":809,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:55:43.165347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":807,"num_write_kb":8573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"23'580","reported_seq":604,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.666892+0000","last_change":"2024-04-01T01:55:49.244171+0000","last_active":"2024-04-01T02:12:38.666892+0000","last_peered":"2024-04-01T02:12:38.666892+0000","last_clean":"2024-04-01T02:12:38.666892+0000","last_became_active":"2024-04-01T01:55:49.241632+0000","last_became_peered":"2024-04-01T01:55:49.241632+0000","last_unstale":"2024-04-01T02:12:38.666892+0000","last_undegraded":"2024-04-01T02:12:38.666892+0000","last_fullsized":"2024-04-01T02:12:38.666892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":580,"log_dups_size":0,"ondisk_log_size":580,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:24:42.777720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1649698,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":453,"num_write_kb":12096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"23'923","reported_seq":948,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.128694+0000","last_change":"2024-04-01T01:55:48.204432+0000","last_active":"2024-04-01T02:12:38.128694+0000","last_peered":"2024-04-01T02:12:38.128694+0000","last_clean":"2024-04-01T02:12:38.128694+0000","last_became_active":"2024-04-01T01:55:48.203576+0000","last_became_peered":"2024-04-01T01:55:48.203576+0000","last_unstale":"2024-04-01T02:12:38.128694+0000","last_undegraded":"2024-04-01T02:12:38.128694+0000","last_fullsized":"2024-04-01T02:12:38.128694+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":923,"log_dups_size":0,"ondisk_log_size":923,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:49:34.960786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2724,"num_write_kb":1428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"23'518","reported_seq":541,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.675180+0000","last_change":"2024-04-01T01:55:49.244993+0000","last_active":"2024-04-01T02:12:38.675180+0000","last_peered":"2024-04-01T02:12:38.675180+0000","last_clean":"2024-04-01T02:12:38.675180+0000","last_became_active":"2024-04-01T01:55:49.244632+0000","last_became_peered":"2024-04-01T01:55:49.244632+0000","last_unstale":"2024-04-01T02:12:38.675180+0000","last_undegraded":"2024-04-01T02:12:38.675180+0000","last_fullsized":"2024-04-01T02:12:38.675180+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":518,"log_dups_size":0,"ondisk_log_size":518,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:30:26.148968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2231074,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":416,"num_write_kb":11781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"23'451","reported_seq":476,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:11:20.248134+0000","last_change":"2024-04-01T01:55:48.221282+0000","last_active":"2024-04-01T02:11:20.248134+0000","last_peered":"2024-04-01T02:11:20.248134+0000","last_clean":"2024-04-01T02:11:20.248134+0000","last_became_active":"2024-04-01T01:55:48.220889+0000","last_became_peered":"2024-04-01T01:55:48.220889+0000","last_unstale":"2024-04-01T02:11:20.248134+0000","last_undegraded":"2024-04-01T02:11:20.248134+0000","last_fullsized":"2024-04-01T02:11:20.248134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:13:12.104386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":451,"num_write_kb":4303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"23'576","reported_seq":599,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.681858+0000","last_change":"2024-04-01T01:55:49.251927+0000","last_active":"2024-04-01T02:12:38.681858+0000","last_peered":"2024-04-01T02:12:38.681858+0000","last_clean":"2024-04-01T02:12:38.681858+0000","last_became_active":"2024-04-01T01:55:49.251641+0000","last_became_peered":"2024-04-01T01:55:49.251641+0000","last_unstale":"2024-04-01T02:12:38.681858+0000","last_undegraded":"2024-04-01T02:12:38.681858+0000","last_fullsized":"2024-04-01T02:12:38.681858+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T13:22:31.821166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1372160,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":436,"num_write_kb":14438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"23'656","reported_seq":682,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:10:58.104040+0000","last_change":"2024-04-01T01:55:48.204161+0000","last_active":"2024-04-01T02:10:58.104040+0000","last_peered":"2024-04-01T02:10:58.104040+0000","last_clean":"2024-04-01T02:10:58.104040+0000","last_became_active":"2024-04-01T01:55:48.203828+0000","last_became_peered":"2024-04-01T01:55:48.203828+0000","last_unstale":"2024-04-01T02:10:58.104040+0000","last_undegraded":"2024-04-01T02:10:58.104040+0000","last_fullsized":"2024-04-01T02:10:58.104040+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":656,"log_dups_size":0,"ondisk_log_size":656,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":655,"num_write_kb":4360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"23'536","reported_seq":559,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:35.139930+0000","last_change":"2024-04-01T01:55:49.259699+0000","last_active":"2024-04-01T02:12:35.139930+0000","last_peered":"2024-04-01T02:12:35.139930+0000","last_clean":"2024-04-01T02:12:35.139930+0000","last_became_active":"2024-04-01T01:55:49.259332+0000","last_became_peered":"2024-04-01T01:55:49.259332+0000","last_unstale":"2024-04-01T02:12:35.139930+0000","last_undegraded":"2024-04-01T02:12:35.139930+0000","last_fullsized":"2024-04-01T02:12:35.139930+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":536,"log_dups_size":0,"ondisk_log_size":536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:02:41.829474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2628206,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":12728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"23'521","reported_seq":546,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:11:11.799786+0000","last_change":"2024-04-01T01:55:48.206742+0000","last_active":"2024-04-01T02:11:11.799786+0000","last_peered":"2024-04-01T02:11:11.799786+0000","last_clean":"2024-04-01T02:11:11.799786+0000","last_became_active":"2024-04-01T01:55:48.206027+0000","last_became_peered":"2024-04-01T01:55:48.206027+0000","last_unstale":"2024-04-01T02:11:11.799786+0000","last_undegraded":"2024-04-01T02:11:11.799786+0000","last_fullsized":"2024-04-01T02:11:11.799786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":521,"log_dups_size":0,"ondisk_log_size":521,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:18:27.840431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":520,"num_write_kb":4323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"23'492","reported_seq":515,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.675506+0000","last_change":"2024-04-01T01:55:49.246379+0000","last_active":"2024-04-01T02:12:38.675506+0000","last_peered":"2024-04-01T02:12:38.675506+0000","last_clean":"2024-04-01T02:12:38.675506+0000","last_became_active":"2024-04-01T01:55:49.245774+0000","last_became_peered":"2024-04-01T01:55:49.245774+0000","last_unstale":"2024-04-01T02:12:38.675506+0000","last_undegraded":"2024-04-01T02:12:38.675506+0000","last_fullsized":"2024-04-01T02:12:38.675506+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":492,"log_dups_size":0,"ondisk_log_size":492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:25:48.896071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2457258,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":347,"num_write_kb":7703,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"23'731","reported_seq":756,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:21.550193+0000","last_change":"2024-04-01T01:55:48.222218+0000","last_active":"2024-04-01T02:12:21.550193+0000","last_peered":"2024-04-01T02:12:21.550193+0000","last_clean":"2024-04-01T02:12:21.550193+0000","last_became_active":"2024-04-01T01:55:48.221148+0000","last_became_peered":"2024-04-01T01:55:48.221148+0000","last_unstale":"2024-04-01T02:12:21.550193+0000","last_undegraded":"2024-04-01T02:12:21.550193+0000","last_fullsized":"2024-04-01T02:12:21.550193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":731,"log_dups_size":0,"ondisk_log_size":731,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:25:51.219789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":729,"num_write_kb":8526,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"23'573","reported_seq":596,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.673104+0000","last_change":"2024-04-01T01:55:49.249648+0000","last_active":"2024-04-01T02:12:38.673104+0000","last_peered":"2024-04-01T02:12:38.673104+0000","last_clean":"2024-04-01T02:12:38.673104+0000","last_became_active":"2024-04-01T01:55:49.248925+0000","last_became_peered":"2024-04-01T01:55:49.248925+0000","last_unstale":"2024-04-01T02:12:38.673104+0000","last_undegraded":"2024-04-01T02:12:38.673104+0000","last_fullsized":"2024-04-01T02:12:38.673104+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":573,"log_dups_size":0,"ondisk_log_size":573,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:33:56.754206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4491912,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":426,"num_write_kb":28953,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"23'1469","reported_seq":1494,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:16.455768+0000","last_change":"2024-04-01T01:55:48.207522+0000","last_active":"2024-04-01T02:12:16.455768+0000","last_peered":"2024-04-01T02:12:16.455768+0000","last_clean":"2024-04-01T02:12:16.455768+0000","last_became_active":"2024-04-01T01:55:48.206856+0000","last_became_peered":"2024-04-01T01:55:48.206856+0000","last_unstale":"2024-04-01T02:12:16.455768+0000","last_undegraded":"2024-04-01T02:12:16.455768+0000","last_fullsized":"2024-04-01T02:12:16.455768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":1469,"log_dups_size":0,"ondisk_log_size":1469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:33:55.744424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1465,"num_write_kb":12919,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"23'559","reported_seq":582,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.722571+0000","last_change":"2024-04-01T01:55:49.274489+0000","last_active":"2024-04-01T02:12:38.722571+0000","last_peered":"2024-04-01T02:12:38.722571+0000","last_clean":"2024-04-01T02:12:38.722571+0000","last_became_active":"2024-04-01T01:55:49.270254+0000","last_became_peered":"2024-04-01T01:55:49.270254+0000","last_unstale":"2024-04-01T02:12:38.722571+0000","last_undegraded":"2024-04-01T02:12:38.722571+0000","last_fullsized":"2024-04-01T02:12:38.722571+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":559,"log_dups_size":0,"ondisk_log_size":559,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T13:09:00.491227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5269504,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":425,"num_write_kb":26844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"23'507","reported_seq":529,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.733757+0000","last_change":"2024-04-01T01:55:49.275782+0000","last_active":"2024-04-01T02:12:38.733757+0000","last_peered":"2024-04-01T02:12:38.733757+0000","last_clean":"2024-04-01T02:12:38.733757+0000","last_became_active":"2024-04-01T01:55:49.275050+0000","last_became_peered":"2024-04-01T01:55:49.275050+0000","last_unstale":"2024-04-01T02:12:38.733757+0000","last_undegraded":"2024-04-01T02:12:38.733757+0000","last_fullsized":"2024-04-01T02:12:38.733757+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":507,"log_dups_size":0,"ondisk_log_size":507,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:26:15.406856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1932316,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":383,"num_write_kb":9512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"23'404","reported_seq":429,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:10:48.103294+0000","last_change":"2024-04-01T01:55:48.223704+0000","last_active":"2024-04-01T02:10:48.103294+0000","last_peered":"2024-04-01T02:10:48.103294+0000","last_clean":"2024-04-01T02:10:48.103294+0000","last_became_active":"2024-04-01T01:55:48.223220+0000","last_became_peered":"2024-04-01T01:55:48.223220+0000","last_unstale":"2024-04-01T02:10:48.103294+0000","last_undegraded":"2024-04-01T02:10:48.103294+0000","last_fullsized":"2024-04-01T02:10:48.103294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":404,"num_write_kb":4216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"23'478","reported_seq":500,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.712722+0000","last_change":"2024-04-01T01:55:49.264857+0000","last_active":"2024-04-01T02:12:38.712722+0000","last_peered":"2024-04-01T02:12:38.712722+0000","last_clean":"2024-04-01T02:12:38.712722+0000","last_became_active":"2024-04-01T01:55:49.258478+0000","last_became_peered":"2024-04-01T01:55:49.258478+0000","last_unstale":"2024-04-01T02:12:38.712722+0000","last_undegraded":"2024-04-01T02:12:38.712722+0000","last_fullsized":"2024-04-01T02:12:38.712722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":478,"log_dups_size":0,"ondisk_log_size":478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:33:56.754206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2118876,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":354,"num_write_kb":10865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"23'1762","reported_seq":1787,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:07.778078+0000","last_change":"2024-04-01T01:55:48.218370+0000","last_active":"2024-04-01T02:12:07.778078+0000","last_peered":"2024-04-01T02:12:07.778078+0000","last_clean":"2024-04-01T02:12:07.778078+0000","last_became_active":"2024-04-01T01:55:48.217755+0000","last_became_peered":"2024-04-01T01:55:48.217755+0000","last_unstale":"2024-04-01T02:12:07.778078+0000","last_undegraded":"2024-04-01T02:12:07.778078+0000","last_fullsized":"2024-04-01T02:12:07.778078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":1762,"log_dups_size":0,"ondisk_log_size":1762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1758,"num_write_kb":13032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"23'607","reported_seq":631,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.722636+0000","last_change":"2024-04-01T01:55:49.243377+0000","last_active":"2024-04-01T02:12:38.722636+0000","last_peered":"2024-04-01T02:12:38.722636+0000","last_clean":"2024-04-01T02:12:38.722636+0000","last_became_active":"2024-04-01T01:55:49.242851+0000","last_became_peered":"2024-04-01T01:55:49.242851+0000","last_unstale":"2024-04-01T02:12:38.722636+0000","last_undegraded":"2024-04-01T02:12:38.722636+0000","last_fullsized":"2024-04-01T02:12:38.722636+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":607,"log_dups_size":0,"ondisk_log_size":607,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:48:38.596647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2501666,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":481,"num_write_kb":61542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"23'1142","reported_seq":1168,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:27.519474+0000","last_change":"2024-04-01T01:55:48.213862+0000","last_active":"2024-04-01T02:12:27.519474+0000","last_peered":"2024-04-01T02:12:27.519474+0000","last_clean":"2024-04-01T02:12:27.519474+0000","last_became_active":"2024-04-01T01:55:48.213122+0000","last_became_peered":"2024-04-01T01:55:48.213122+0000","last_unstale":"2024-04-01T02:12:27.519474+0000","last_undegraded":"2024-04-01T02:12:27.519474+0000","last_fullsized":"2024-04-01T02:12:27.519474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":1142,"log_dups_size":0,"ondisk_log_size":1142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:59:23.563864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1140,"num_write_kb":8675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"23'568","reported_seq":592,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.724948+0000","last_change":"2024-04-01T01:55:49.252273+0000","last_active":"2024-04-01T02:12:38.724948+0000","last_peered":"2024-04-01T02:12:38.724948+0000","last_clean":"2024-04-01T02:12:38.724948+0000","last_became_active":"2024-04-01T01:55:49.251963+0000","last_became_peered":"2024-04-01T01:55:49.251963+0000","last_unstale":"2024-04-01T02:12:38.724948+0000","last_undegraded":"2024-04-01T02:12:38.724948+0000","last_fullsized":"2024-04-01T02:12:38.724948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":568,"log_dups_size":0,"ondisk_log_size":568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:56:18.086766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1665465,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":447,"num_write_kb":10082,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"23'994","reported_seq":1020,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:11:32.607321+0000","last_change":"2024-04-01T01:55:48.225858+0000","last_active":"2024-04-01T02:11:32.607321+0000","last_peered":"2024-04-01T02:11:32.607321+0000","last_clean":"2024-04-01T02:11:32.607321+0000","last_became_active":"2024-04-01T01:55:48.224494+0000","last_became_peered":"2024-04-01T01:55:48.224494+0000","last_unstale":"2024-04-01T02:11:32.607321+0000","last_undegraded":"2024-04-01T02:11:32.607321+0000","last_fullsized":"2024-04-01T02:11:32.607321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:47.163119+0000","last_clean_scrub_stamp":"2024-04-01T01:55:47.163119+0000","objects_scrubbed":0,"log_size":994,"log_dups_size":0,"ondisk_log_size":994,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:09:28.276592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389190,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":993,"num_write_kb":8588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":215832773,"num_objects":671,"num_object_clones":0,"num_object_copies":1342,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":671,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26120,"num_write_kb":1144114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":33914880,"data_stored":431659406,"data_compressed":20248526,"data_compressed_allocated":27738112,"data_compressed_original":427758424,"omap_allocated":0,"internal_metadata":0},"log_size":34657,"ondisk_log_size":34657,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":198615672,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":1759,"num_read_kb":2743,"num_write":29719,"num_write_kb":207968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":261406720,"data_stored":397231344,"data_compressed":36932112,"data_compressed_allocated":55713792,"data_compressed_original":191602688,"omap_allocated":0,"internal_metadata":0},"log_size":27963,"ondisk_log_size":27963,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66838,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509649,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":103636,"kb_used_data":23884,"kb_used_omap":1,"kb_used_meta":79742,"kb_avail":94268204,"statfs":{"total":96636764160,"available":96530640896,"internally_reserved":0,"allocated":24457216,"data_stored":69188313,"data_compressed":4487044,"data_compressed_allocated":6590464,"data_compressed_original":51672926,"omap_allocated":1590,"internal_metadata":81656266},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509650,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":119288,"kb_used_data":33968,"kb_used_omap":1,"kb_used_meta":85310,"kb_avail":94252552,"statfs":{"total":96636764160,"available":96514613248,"internally_reserved":0,"allocated":34783232,"data_stored":88936133,"data_compressed":7023647,"data_compressed_allocated":10317824,"data_compressed_original":64849434,"omap_allocated":1595,"internal_metadata":87357893},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509648,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":184324,"kb_used_data":62908,"kb_used_omap":1,"kb_used_meta":121406,"kb_avail":94187516,"statfs":{"total":96636764160,"available":96448016384,"internally_reserved":0,"allocated":64417792,"data_stored":165045143,"data_compressed":11682465,"data_compressed_allocated":17096704,"data_compressed_original":118219990,"omap_allocated":1592,"internal_metadata":124320200},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509649,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":93932,"kb_used_data":26660,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94277908,"statfs":{"total":96636764160,"available":96540577792,"internally_reserved":0,"allocated":27299840,"data_stored":94836675,"data_compressed":5914255,"data_compressed_allocated":8593408,"data_compressed_original":76574396,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509649,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":96400,"kb_used_data":29128,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94275440,"statfs":{"total":96636764160,"available":96538050560,"internally_reserved":0,"allocated":29827072,"data_stored":88082926,"data_compressed":5618475,"data_compressed_allocated":8155136,"data_compressed_original":66844186,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509648,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":161932,"kb_used_data":50244,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":94209908,"statfs":{"total":96636764160,"available":96470945792,"internally_reserved":0,"allocated":51449856,"data_stored":133539293,"data_compressed":9646909,"data_compressed_allocated":14168064,"data_compressed_original":96757598,"omap_allocated":1595,"internal_metadata":114358725},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542352,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":95764,"kb_used_data":24332,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94276076,"statfs":{"total":96636764160,"available":96538701824,"internally_reserved":0,"allocated":24915968,"data_stored":74736278,"data_compressed":5225453,"data_compressed_allocated":7524352,"data_compressed_original":57747294,"omap_allocated":1594,"internal_metadata":73136582},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575057,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":138384,"kb_used_data":39176,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":94233456,"statfs":{"total":96636764160,"available":96495058944,"internally_reserved":0,"allocated":40116224,"data_stored":116325977,"data_compressed":7649228,"data_compressed_allocated":11096064,"data_compressed_original":87842168,"omap_allocated":1595,"internal_metadata":101579205},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33419,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33419,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":46317568,"data_stored":71264381,"data_compressed":6727789,"data_compressed_allocated":10149888,"data_compressed_original":35106816,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":25587712,"data_stored":37748806,"data_compressed":3257537,"data_compressed_allocated":4939776,"data_compressed_original":17104896,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":22360064,"data_stored":33555104,"data_compressed":3040138,"data_compressed_allocated":4640768,"data_compressed_original":15843328,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":58327040,"data_stored":88042123,"data_compressed":8070060,"data_compressed_allocated":12161024,"data_compressed_original":41881600,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":31485952,"data_stored":50332992,"data_compressed":5217803,"data_compressed_allocated":7843840,"data_compressed_original":26705920,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":34701312,"data_stored":51852497,"data_compressed":4625369,"data_compressed_allocated":6967296,"data_compressed_original":24129536,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":21364736,"data_stored":33554432,"data_compressed":3299283,"data_compressed_allocated":4878336,"data_compressed_original":17068032,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":21262336,"data_stored":30881009,"data_compressed":2694133,"data_compressed_allocated":4132864,"data_compressed_original":13762560,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4947968,"data_stored":62241427,"data_compressed":2919120,"data_compressed_allocated":4018176,"data_compressed_original":61650782,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3940352,"data_stored":49659666,"data_compressed":2327519,"data_compressed_allocated":3170304,"data_compressed_original":49165850,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4706304,"data_stored":61197485,"data_compressed":2874117,"data_compressed_allocated":3952640,"data_compressed_original":60731068,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":5861376,"data_stored":76921769,"data_compressed":3612405,"data_compressed_allocated":4935680,"data_compressed_original":76338390,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":3063808,"data_stored":38519055,"data_compressed":1805844,"data_compressed_allocated":2473984,"data_compressed_original":38143514,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":5115904,"data_stored":63799026,"data_compressed":2990440,"data_compressed_allocated":4083712,"data_compressed_original":63139192,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":3317760,"data_stored":41097760,"data_compressed":1926170,"data_compressed_allocated":2646016,"data_compressed_original":40679262,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":2961408,"data_stored":38223218,"data_compressed":1792911,"data_compressed_allocated":2457600,"data_compressed_original":37910366,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-01T02:12:51.588 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-04-01T01:55:48.172901+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=1, tm_min=55, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=2, tm_min=12, tm_sec=46, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T02:12:51.588 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-04-01T01:55:48.172901+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=1, tm_min=55, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=2, tm_min=12, tm_sec=46, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T02:12:51.588 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-04-01T01:55:48.172901+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=1, tm_min=55, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=2, tm_min=12, tm_sec=46, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T02:12:51.589 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-04-01T01:55:48.172901+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=1, tm_min=55, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=2, tm_min=12, tm_sec=46, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T02:12:51.589 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-04-01T01:55:48.172901+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=1, tm_min=55, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=2, tm_min=12, tm_sec=46, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T02:12:51.589 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-04-01T01:55:48.172901+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=1, tm_min=55, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=2, tm_min=12, tm_sec=46, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T02:12:51.589 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-04-01T01:55:48.172901+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=1, tm_min=55, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=2, tm_min=12, tm_sec=46, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T02:12:51.589 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-04-01T01:55:48.172901+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=1, tm_min=55, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=2, tm_min=12, tm_sec=46, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T02:12:51.589 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-04-01T01:55:48.172901+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=1, tm_min=55, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=2, tm_min=12, tm_sec=46, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T02:12:51.590 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-04-01T01:55:48.172901+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=1, tm_min=55, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=2, tm_min=12, tm_sec=46, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T02:12:51.590 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-04-01T01:55:48.172901+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=1, tm_min=55, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=2, tm_min=12, tm_sec=46, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T02:12:51.590 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-04-01T01:55:48.172901+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=1, tm_min=55, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=2, tm_min=12, tm_sec=46, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T02:12:51.590 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-04-01T01:55:48.172901+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=1, tm_min=55, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=2, tm_min=12, tm_sec=46, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T02:12:51.590 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-04-01T01:55:48.172901+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=1, tm_min=55, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=2, tm_min=12, tm_sec=46, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T02:12:51.591 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-04-01T01:55:48.172901+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=1, tm_min=55, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=2, tm_min=12, tm_sec=46, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T02:12:51.591 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-04-01T01:55:48.172901+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=1, tm_min=55, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=2, tm_min=12, tm_sec=46, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T02:12:51.591 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-04-01T01:55:48.172901+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=1, tm_min=55, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=2, tm_min=12, tm_sec=46, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T02:12:51.591 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-04-01T01:55:48.172901+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=1, tm_min=55, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=2, tm_min=12, tm_sec=46, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T02:12:51.591 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-04-01T01:55:48.172901+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=1, tm_min=55, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=2, tm_min=12, tm_sec=46, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T02:12:51.591 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-04-01T01:55:48.172901+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=1, tm_min=55, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=2, tm_min=12, tm_sec=46, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T02:12:51.592 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-04-01T01:55:48.172901+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=1, tm_min=55, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=2, tm_min=12, tm_sec=46, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T02:12:51.592 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-04-01T01:55:48.172901+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=1, tm_min=55, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=2, tm_min=12, tm_sec=46, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T02:12:51.592 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-04-01T01:55:48.172901+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=1, tm_min=55, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=2, tm_min=12, tm_sec=46, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T02:12:51.592 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-04-01T01:55:48.172901+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=1, tm_min=55, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=2, tm_min=12, tm_sec=46, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T02:12:51.592 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-04-01T01:55:48.172901+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=1, tm_min=55, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=2, tm_min=12, tm_sec=46, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T02:12:51.592 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-04-01T01:55:48.172901+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=1, tm_min=55, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=2, tm_min=12, tm_sec=46, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T02:12:51.593 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-04-01T01:55:48.172901+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=1, tm_min=55, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=2, tm_min=12, tm_sec=46, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T02:12:51.593 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-04-01T01:55:48.172901+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=1, tm_min=55, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=2, tm_min=12, tm_sec=46, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T02:12:51.593 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-04-01T01:55:48.172901+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=1, tm_min=55, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=2, tm_min=12, tm_sec=46, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T02:12:51.593 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-04-01T01:55:48.172901+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=1, tm_min=55, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=2, tm_min=12, tm_sec=46, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T02:12:51.593 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-04-01T01:55:48.172901+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=1, tm_min=55, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=2, tm_min=12, tm_sec=46, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T02:12:51.593 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-04-01T01:55:48.172901+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=1, tm_min=55, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=2, tm_min=12, tm_sec=46, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T02:12:51.594 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-01T01:55:48.172901+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=1, tm_min=55, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=2, tm_min=12, tm_sec=46, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T02:12:51.594 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2024-04-01T01:55:47.163119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=1, tm_min=55, tm_sec=47, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=2, tm_min=12, tm_sec=46, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T02:12:51.594 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-01T01:55:48.172901+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=1, tm_min=55, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=2, tm_min=12, tm_sec=46, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T02:12:51.594 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-04-01T01:55:47.163119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=1, tm_min=55, tm_sec=47, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=2, tm_min=12, tm_sec=46, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T02:12:51.594 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2024-04-01T01:55:47.163119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=1, tm_min=55, tm_sec=47, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=2, tm_min=12, tm_sec=46, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T02:12:51.594 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-01T01:55:48.172901+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=1, tm_min=55, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=2, tm_min=12, tm_sec=46, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T02:12:51.595 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-04-01T01:55:47.163119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=1, tm_min=55, tm_sec=47, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=2, tm_min=12, tm_sec=46, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T02:12:51.595 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-01T01:55:48.172901+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=1, tm_min=55, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=2, tm_min=12, tm_sec=46, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T02:12:51.595 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2024-04-01T01:55:47.163119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=1, tm_min=55, tm_sec=47, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=2, tm_min=12, tm_sec=46, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T02:12:51.595 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-01T01:55:48.172901+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=1, tm_min=55, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=2, tm_min=12, tm_sec=46, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T02:12:51.595 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2024-04-01T01:55:47.163119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=1, tm_min=55, tm_sec=47, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=2, tm_min=12, tm_sec=46, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T02:12:51.595 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-01T01:55:48.172901+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=1, tm_min=55, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=2, tm_min=12, tm_sec=46, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T02:12:51.595 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2024-04-01T01:55:47.163119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=1, tm_min=55, tm_sec=47, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=2, tm_min=12, tm_sec=46, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T02:12:51.596 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-01T01:55:48.172901+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=1, tm_min=55, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=2, tm_min=12, tm_sec=46, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T02:12:51.596 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2024-04-01T01:55:47.163119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=1, tm_min=55, tm_sec=47, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=2, tm_min=12, tm_sec=46, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T02:12:51.596 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-01T01:55:48.172901+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=1, tm_min=55, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=2, tm_min=12, tm_sec=46, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T02:12:51.596 INFO:tasks.ceph:pgid 2.13 last_scrub_stamp 2024-04-01T01:55:47.163119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=1, tm_min=55, tm_sec=47, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=2, tm_min=12, tm_sec=46, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T02:12:51.597 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-01T01:55:48.172901+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=1, tm_min=55, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=2, tm_min=12, tm_sec=46, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T02:12:51.597 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-04-01T01:55:47.163119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=1, tm_min=55, tm_sec=47, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=2, tm_min=12, tm_sec=46, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T02:12:51.597 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-01T01:55:48.172901+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=1, tm_min=55, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=2, tm_min=12, tm_sec=46, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T02:12:51.597 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2024-04-01T01:55:47.163119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=1, tm_min=55, tm_sec=47, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=2, tm_min=12, tm_sec=46, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T02:12:51.597 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-01T01:55:48.172901+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=1, tm_min=55, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=2, tm_min=12, tm_sec=46, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T02:12:51.597 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2024-04-01T01:55:47.163119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=1, tm_min=55, tm_sec=47, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=2, tm_min=12, tm_sec=46, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T02:12:51.598 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-01T01:55:48.172901+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=1, tm_min=55, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=2, tm_min=12, tm_sec=46, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T02:12:51.598 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2024-04-01T01:55:47.163119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=1, tm_min=55, tm_sec=47, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=2, tm_min=12, tm_sec=46, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T02:12:51.598 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-01T01:55:48.172901+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=1, tm_min=55, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=2, tm_min=12, tm_sec=46, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T02:12:51.598 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2024-04-01T01:55:47.163119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=1, tm_min=55, tm_sec=47, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=2, tm_min=12, tm_sec=46, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T02:12:51.598 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-01T01:55:48.172901+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=1, tm_min=55, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=2, tm_min=12, tm_sec=46, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T02:12:51.598 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2024-04-01T01:55:47.163119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=1, tm_min=55, tm_sec=47, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=2, tm_min=12, tm_sec=46, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T02:12:51.599 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-01T01:55:48.172901+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=1, tm_min=55, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=2, tm_min=12, tm_sec=46, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T02:12:51.599 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2024-04-01T01:55:47.163119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=1, tm_min=55, tm_sec=47, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=2, tm_min=12, tm_sec=46, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T02:12:51.599 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-01T01:55:48.172901+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=1, tm_min=55, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=2, tm_min=12, tm_sec=46, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T02:12:51.599 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-01T01:55:42.134502+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=1, tm_min=55, tm_sec=42, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=2, tm_min=12, tm_sec=46, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T02:12:51.599 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-01T01:55:47.163119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=1, tm_min=55, tm_sec=47, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=2, tm_min=12, tm_sec=46, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T02:12:51.599 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-01T01:55:48.172901+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=1, tm_min=55, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=2, tm_min=12, tm_sec=46, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T02:12:51.600 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-01T01:55:47.163119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=1, tm_min=55, tm_sec=47, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=2, tm_min=12, tm_sec=46, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T02:12:51.600 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-01T01:55:48.172901+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=1, tm_min=55, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=2, tm_min=12, tm_sec=46, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T02:12:51.600 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-01T01:55:47.163119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=1, tm_min=55, tm_sec=47, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=2, tm_min=12, tm_sec=46, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T02:12:51.600 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-01T01:55:48.172901+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=1, tm_min=55, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=2, tm_min=12, tm_sec=46, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T02:12:51.600 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-01T01:55:47.163119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=1, tm_min=55, tm_sec=47, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=2, tm_min=12, tm_sec=46, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T02:12:51.600 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-01T01:55:48.172901+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=1, tm_min=55, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=2, tm_min=12, tm_sec=46, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T02:12:51.601 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-01T01:55:47.163119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=1, tm_min=55, tm_sec=47, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=2, tm_min=12, tm_sec=46, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T02:12:51.601 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-01T01:55:48.172901+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=1, tm_min=55, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=2, tm_min=12, tm_sec=46, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T02:12:51.601 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-01T01:55:47.163119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=1, tm_min=55, tm_sec=47, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=2, tm_min=12, tm_sec=46, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T02:12:51.601 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-01T01:55:48.172901+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=1, tm_min=55, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=2, tm_min=12, tm_sec=46, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T02:12:51.601 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-01T01:55:47.163119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=1, tm_min=55, tm_sec=47, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=2, tm_min=12, tm_sec=46, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T02:12:51.601 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-01T01:55:48.172901+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=1, tm_min=55, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=2, tm_min=12, tm_sec=46, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T02:12:51.602 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-01T01:55:47.163119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=1, tm_min=55, tm_sec=47, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=2, tm_min=12, tm_sec=46, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T02:12:51.602 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-01T01:55:48.172901+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=1, tm_min=55, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=2, tm_min=12, tm_sec=46, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T02:12:51.602 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-04-01T01:55:47.163119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=1, tm_min=55, tm_sec=47, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=2, tm_min=12, tm_sec=46, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T02:12:51.602 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-01T01:55:48.172901+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=1, tm_min=55, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=2, tm_min=12, tm_sec=46, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T02:12:51.602 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2024-04-01T01:55:47.163119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=1, tm_min=55, tm_sec=47, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=2, tm_min=12, tm_sec=46, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T02:12:51.602 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-01T01:55:48.172901+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=1, tm_min=55, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=2, tm_min=12, tm_sec=46, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T02:12:51.603 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2024-04-01T01:55:47.163119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=1, tm_min=55, tm_sec=47, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=2, tm_min=12, tm_sec=46, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T02:12:51.603 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-01T01:55:48.172901+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=1, tm_min=55, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=2, tm_min=12, tm_sec=46, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T02:12:51.603 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-04-01T01:55:47.163119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=1, tm_min=55, tm_sec=47, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=2, tm_min=12, tm_sec=46, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T02:12:51.603 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-01T01:55:48.172901+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=1, tm_min=55, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=2, tm_min=12, tm_sec=46, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T02:12:51.603 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-01T01:55:48.172901+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=1, tm_min=55, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=2, tm_min=12, tm_sec=46, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T02:12:51.603 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-04-01T01:55:47.163119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=1, tm_min=55, tm_sec=47, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=2, tm_min=12, tm_sec=46, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T02:12:51.604 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-01T01:55:48.172901+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=1, tm_min=55, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=2, tm_min=12, tm_sec=46, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T02:12:51.604 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-04-01T01:55:47.163119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=1, tm_min=55, tm_sec=47, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=2, tm_min=12, tm_sec=46, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T02:12:51.604 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-01T01:55:48.172901+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=1, tm_min=55, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=2, tm_min=12, tm_sec=46, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T02:12:51.604 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2024-04-01T01:55:47.163119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=1, tm_min=55, tm_sec=47, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=2, tm_min=12, tm_sec=46, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T02:12:51.604 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-01T01:55:48.172901+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=1, tm_min=55, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=2, tm_min=12, tm_sec=46, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T02:12:51.604 INFO:tasks.ceph:pgid 2.1f last_scrub_stamp 2024-04-01T01:55:47.163119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=1, tm_min=55, tm_sec=47, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=2, tm_min=12, tm_sec=46, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T02:12:51.604 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-01T02:13:08.353 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T02:13:08.356 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T02:13:11.605 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-01T02:13:11.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:11.748+0000 7f87fe85c640 1 Processor -- start 2024-04-01T02:13:11.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:11.748+0000 7f87fe85c640 1 -- start start 2024-04-01T02:13:11.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:11.748+0000 7f87fe85c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f87f8150e60 0x7f87f8072f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:13:11.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:11.748+0000 7f87fe85c640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87f8073470 con 0x7f87f80c73a0 2024-04-01T02:13:11.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:11.748+0000 7f87fe85c640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87f8156a20 con 0x7f87f80c77c0 2024-04-01T02:13:11.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:11.748+0000 7f87fe85c640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f87f81578f0 con 0x7f87f8150e60 2024-04-01T02:13:11.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:11.748+0000 7f87effff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f87f80c73a0 0x7f87f80c2900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:43644/0 (socket says 172.21.15.50:43644) 2024-04-01T02:13:11.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:11.748+0000 7f87effff640 1 -- 172.21.15.50:0/1157753049 learned_addr learned my addr 172.21.15.50:0/1157753049 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-04-01T02:13:11.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:11.748+0000 7f87f7fff640 1 --2- 172.21.15.50:0/1157753049 >> v2:172.21.15.97:3300/0 conn(0x7f87f8150e60 0x7f87f8072f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:13:11.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:11.748+0000 7f87f77fe640 1 -- 172.21.15.50:0/1157753049 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 910185361 0 0) 0x7f87f8073470 con 0x7f87f80c73a0 2024-04-01T02:13:11.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:11.748+0000 7f87f77fe640 1 -- 172.21.15.50:0/1157753049 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f87e4003530 con 0x7f87f80c73a0 2024-04-01T02:13:11.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:11.748+0000 7f87f77fe640 1 -- 172.21.15.50:0/1157753049 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1889619799 0 0) 0x7f87e4003530 con 0x7f87f80c73a0 2024-04-01T02:13:11.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:11.748+0000 7f87f77fe640 1 -- 172.21.15.50:0/1157753049 >> v2:172.21.15.97:3300/0 conn(0x7f87f8150e60 msgr2=0x7f87f8072f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T02:13:11.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:11.748+0000 7f87f77fe640 1 --2- 172.21.15.50:0/1157753049 >> v2:172.21.15.97:3300/0 conn(0x7f87f8150e60 0x7f87f8072f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:13:11.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:11.748+0000 7f87f77fe640 1 -- 172.21.15.50:0/1157753049 >> v1:172.21.15.97:6789/0 conn(0x7f87f80c77c0 legacy=0x7f87f815a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:13:11.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:11.748+0000 7f87f77fe640 1 -- 172.21.15.50:0/1157753049 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87f8156ce0 con 0x7f87f80c73a0 2024-04-01T02:13:11.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:11.748+0000 7f87f77fe640 1 -- 172.21.15.50:0/1157753049 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2779672543 0 0) 0x7f87e0001680 con 0x7f87f80c73a0 2024-04-01T02:13:11.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:11.748+0000 7f87f77fe640 1 -- 172.21.15.50:0/1157753049 >> v1:172.21.15.50:6789/0 conn(0x7f87f80c73a0 legacy=0x7f87f80c2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:13:11.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:11.748+0000 7f87f77fe640 1 --2- 172.21.15.50:0/1157753049 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f87e40039c0 0x7f87e4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:13:11.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:11.748+0000 7f87f77fe640 1 --2- 172.21.15.50:0/1157753049 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f87e4004810 0x7f87e4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:13:11.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:11.748+0000 7f87f77fe640 1 --2- 172.21.15.50:0/1157753049 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87e40051d0 0x7f87e400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:13:11.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:11.748+0000 7f87f77fe640 1 -- 172.21.15.50:0/1157753049 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f87f81578f0 con 0x7f87e40051d0 2024-04-01T02:13:11.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:11.748+0000 7f87f77fe640 1 -- 172.21.15.50:0/1157753049 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f87e400c080 con 0x7f87e40039c0 2024-04-01T02:13:11.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:11.748+0000 7f87f77fe640 1 -- 172.21.15.50:0/1157753049 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f87e400c280 con 0x7f87e4004810 2024-04-01T02:13:11.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:11.748+0000 7f87fcdf9640 1 --2- 172.21.15.50:0/1157753049 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87e40051d0 0x7f87e400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:13:11.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:11.748+0000 7f87f7fff640 1 --2- 172.21.15.50:0/1157753049 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f87e40039c0 0x7f87e4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:13:11.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:11.748+0000 7f87effff640 1 --2- 172.21.15.50:0/1157753049 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f87e4004810 0x7f87e4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:13:11.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:11.748+0000 7f87fcdf9640 1 -- 172.21.15.50:0/1157753049 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f87e4004810 msgr2=0x7f87e4004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T02:13:11.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:11.748+0000 7f87fcdf9640 1 --2- 172.21.15.50:0/1157753049 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f87e4004810 0x7f87e4004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:13:11.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:11.748+0000 7f87fcdf9640 1 -- 172.21.15.50:0/1157753049 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f87e40039c0 msgr2=0x7f87e4003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T02:13:11.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:11.748+0000 7f87fcdf9640 1 --2- 172.21.15.50:0/1157753049 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f87e40039c0 0x7f87e4003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:13:11.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:11.748+0000 7f87fcdf9640 1 -- 172.21.15.50:0/1157753049 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87e4003530 con 0x7f87e40051d0 2024-04-01T02:13:11.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:11.752+0000 7f87fcdf9640 1 -- 172.21.15.50:0/1157753049 reap_dead start 2024-04-01T02:13:11.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:11.752+0000 7f87fcdf9640 1 --2- 172.21.15.50:0/1157753049 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87e40051d0 0x7f87e400b9d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f87f8154580 tx=0x7f87f001c720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45046058b0927079 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:13:11.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:11.752+0000 7f87f77fe640 1 -- 172.21.15.50:0/1157753049 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87f0001a90 con 0x7f87e40051d0 2024-04-01T02:13:11.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:11.752+0000 7f87f77fe640 1 -- 172.21.15.50:0/1157753049 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87f0003b80 con 0x7f87e40051d0 2024-04-01T02:13:11.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:11.752+0000 7f87f77fe640 1 -- 172.21.15.50:0/1157753049 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87f0005020 con 0x7f87e40051d0 2024-04-01T02:13:11.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:11.752+0000 7f87fe85c640 1 -- 172.21.15.50:0/1157753049 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87e40051d0 msgr2=0x7f87e400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:13:11.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:11.752+0000 7f87fe85c640 1 --2- 172.21.15.50:0/1157753049 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87e40051d0 0x7f87e400b9d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f87f8154580 tx=0x7f87f001c720 comp rx=0 tx=0).stop 2024-04-01T02:13:11.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:11.752+0000 7f87fe85c640 1 -- 172.21.15.50:0/1157753049 shutdown_connections 2024-04-01T02:13:11.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:11.752+0000 7f87fe85c640 1 --2- 172.21.15.50:0/1157753049 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87e40051d0 0x7f87e400b9d0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:13:11.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:11.752+0000 7f87fe85c640 1 -- 172.21.15.50:0/1157753049 >> 172.21.15.50:0/1157753049 conn(0x7f87f8067560 msgr2=0x7f87f806b220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T02:13:11.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:11.752+0000 7f87fe85c640 1 -- 172.21.15.50:0/1157753049 shutdown_connections 2024-04-01T02:13:11.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:11.752+0000 7f87fe85c640 1 -- 172.21.15.50:0/1157753049 wait complete. 2024-04-01T02:13:11.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:11.752+0000 7f87fe85c640 1 Processor -- start 2024-04-01T02:13:11.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:11.752+0000 7f87fe85c640 1 -- start start 2024-04-01T02:13:11.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:11.752+0000 7f87fe85c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f87e40051d0 0x7f87f81ef6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:13:11.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:11.752+0000 7f87fe85c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87f814f750 0x7f87f8149fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:13:11.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:11.752+0000 7f87fe85c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f87f81e1700 0x7f87f814d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:13:11.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:11.752+0000 7f87fe85c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f87f8157580 con 0x7f87f814f750 2024-04-01T02:13:11.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:11.752+0000 7f87fe85c640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f87f81572a0 con 0x7f87e40051d0 2024-04-01T02:13:11.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:11.752+0000 7f87fe85c640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f87f8072f30 con 0x7f87f81e1700 2024-04-01T02:13:11.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:11.752+0000 7f87effff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87f814f750 0x7f87f8149fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:13:11.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:11.752+0000 7f87effff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87f814f750 0x7f87f8149fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37240/0 (socket says 172.21.15.50:37240) 2024-04-01T02:13:11.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:11.756+0000 7f87effff640 1 -- 172.21.15.50:0/3988756748 learned_addr learned my addr 172.21.15.50:0/3988756748 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T02:13:11.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:11.756+0000 7f87f7fff640 1 --2- 172.21.15.50:0/3988756748 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f87e40051d0 0x7f87f81ef6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:13:11.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:11.756+0000 7f87fcdf9640 1 --2- 172.21.15.50:0/3988756748 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f87f81e1700 0x7f87f814d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:13:11.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:11.756+0000 7f87effff640 1 -- 172.21.15.50:0/3988756748 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f87f81e1700 msgr2=0x7f87f814d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:13:11.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:11.756+0000 7f87effff640 1 --2- 172.21.15.50:0/3988756748 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f87f81e1700 0x7f87f814d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:13:11.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:11.756+0000 7f87effff640 1 -- 172.21.15.50:0/3988756748 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f87e40051d0 msgr2=0x7f87f81ef6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:13:11.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:11.756+0000 7f87effff640 1 --2- 172.21.15.50:0/3988756748 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f87e40051d0 0x7f87f81ef6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:13:11.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:11.756+0000 7f87effff640 1 -- 172.21.15.50:0/3988756748 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87f81efbe0 con 0x7f87f814f750 2024-04-01T02:13:11.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:11.756+0000 7f87fcdf9640 1 --2- 172.21.15.50:0/3988756748 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f87f81e1700 0x7f87f814d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T02:13:11.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:11.756+0000 7f87effff640 1 --2- 172.21.15.50:0/3988756748 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87f814f750 0x7f87f8149fd0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f87e0000fc0 tx=0x7f87e000ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:13:11.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:11.756+0000 7f87f57fa640 1 -- 172.21.15.50:0/3988756748 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87e000c630 con 0x7f87f814f750 2024-04-01T02:13:11.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:11.756+0000 7f87f57fa640 1 -- 172.21.15.50:0/3988756748 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87e0018070 con 0x7f87f814f750 2024-04-01T02:13:11.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:11.756+0000 7f87fe85c640 1 -- 172.21.15.50:0/3988756748 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87f81eb770 con 0x7f87f814f750 2024-04-01T02:13:11.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:11.756+0000 7f87f57fa640 1 -- 172.21.15.50:0/3988756748 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87e000ca50 con 0x7f87f814f750 2024-04-01T02:13:11.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:11.756+0000 7f87fe85c640 1 -- 172.21.15.50:0/3988756748 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87f814fc00 con 0x7f87f814f750 2024-04-01T02:13:11.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:11.756+0000 7f87fe85c640 1 -- 172.21.15.50:0/3988756748 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87f8068230 con 0x7f87f814f750 2024-04-01T02:13:11.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:11.756+0000 7f87f57fa640 1 -- 172.21.15.50:0/3988756748 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 87103+0+0 (secure 0 0 0) 0x7f87e000cbf0 con 0x7f87f814f750 2024-04-01T02:13:11.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:11.756+0000 7f87f57fa640 1 --2- 172.21.15.50:0/3988756748 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f87d8067450 0x7f87d8069910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:13:11.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:11.756+0000 7f87f57fa640 1 -- 172.21.15.50:0/3988756748 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5738+0+0 (secure 0 0 0) 0x7f87e00854e0 con 0x7f87f814f750 2024-04-01T02:13:11.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:11.756+0000 7f87f7fff640 1 --2- 172.21.15.50:0/3988756748 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f87d8067450 0x7f87d8069910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:13:11.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:11.756+0000 7f87f7fff640 1 --2- 172.21.15.50:0/3988756748 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f87d8067450 0x7f87d8069910 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f87e80099b0 tx=0x7f87e8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:13:11.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:11.760+0000 7f87f57fa640 1 -- 172.21.15.50:0/3988756748 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+176632 (secure 0 0 0) 0x7f87e00561d0 con 0x7f87f814f750 2024-04-01T02:13:11.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:11.920+0000 7f87fe85c640 1 -- 172.21.15.50:0/3988756748 --> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f87f814fee0 con 0x7f87d8067450 2024-04-01T02:13:11.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:11.936+0000 7f87f57fa640 1 -- 172.21.15.50:0/3988756748 <== mgr.4103 v2:172.21.15.97:6832/1677467570 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+255390 (secure 0 0 0) 0x7f87f814fee0 con 0x7f87d8067450 2024-04-01T02:13:11.933 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-01T02:13:11.936 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-04-01T02:13:11.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:11.940+0000 7f87fe85c640 1 -- 172.21.15.50:0/3988756748 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f87d8067450 msgr2=0x7f87d8069910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:13:11.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:11.940+0000 7f87fe85c640 1 --2- 172.21.15.50:0/3988756748 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f87d8067450 0x7f87d8069910 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f87e80099b0 tx=0x7f87e8008040 comp rx=0 tx=0).stop 2024-04-01T02:13:11.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:11.940+0000 7f87fe85c640 1 -- 172.21.15.50:0/3988756748 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87f814f750 msgr2=0x7f87f8149fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:13:11.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:11.940+0000 7f87fe85c640 1 --2- 172.21.15.50:0/3988756748 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87f814f750 0x7f87f8149fd0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f87e0000fc0 tx=0x7f87e000ec90 comp rx=0 tx=0).stop 2024-04-01T02:13:11.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:11.940+0000 7f87fe85c640 1 -- 172.21.15.50:0/3988756748 shutdown_connections 2024-04-01T02:13:11.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:11.940+0000 7f87fe85c640 1 --2- 172.21.15.50:0/3988756748 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f87d8067450 0x7f87d8069910 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:13:11.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:11.940+0000 7f87fe85c640 1 --2- 172.21.15.50:0/3988756748 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f87f81e1700 0x7f87f814d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:13:11.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:11.940+0000 7f87fe85c640 1 --2- 172.21.15.50:0/3988756748 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87f814f750 0x7f87f8149fd0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:13:11.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:11.940+0000 7f87fe85c640 1 --2- 172.21.15.50:0/3988756748 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f87e40051d0 0x7f87f81ef6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:13:11.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:11.940+0000 7f87fe85c640 1 -- 172.21.15.50:0/3988756748 >> 172.21.15.50:0/3988756748 conn(0x7f87f8067560 msgr2=0x7f87f80c5d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T02:13:11.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:11.940+0000 7f87fe85c640 1 -- 172.21.15.50:0/3988756748 shutdown_connections 2024-04-01T02:13:11.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:11.940+0000 7f87fe85c640 1 -- 172.21.15.50:0/3988756748 wait complete. 2024-04-01T02:13:11.953 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":541,"stamp":"2024-04-01T02:13:10.399179+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":415050366,"num_objects":742,"num_object_clones":0,"num_object_copies":1484,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":742,"num_whiteouts":0,"num_read":1875,"num_read_kb":2843,"num_write":56005,"num_write_kb":1354513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":63313,"ondisk_log_size":63313,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":997896,"kb_used_data":290376,"kb_used_omap":12,"kb_used_meta":707443,"kb_avail":753976824,"statfs":{"total":773094113280,"available":772072267776,"internally_reserved":0,"allocated":297345024,"data_stored":830767280,"data_compressed":57247476,"data_compressed_allocated":83542016,"data_compressed_original":620507992,"omap_allocated":12751,"internal_metadata":724422193},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1653,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004448"},"pg_stats":[{"pgid":"3.3f","version":"23'501","reported_seq":534,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:13:03.214025+0000","last_change":"2024-04-01T02:13:03.214212+0000","last_active":"2024-04-01T02:13:03.214025+0000","last_peered":"2024-04-01T02:13:03.214025+0000","last_clean":"2024-04-01T02:13:03.214025+0000","last_became_active":"2024-04-01T01:55:49.279011+0000","last_became_peered":"2024-04-01T01:55:49.279011+0000","last_unstale":"2024-04-01T02:13:03.214025+0000","last_undegraded":"2024-04-01T02:13:03.214025+0000","last_fullsized":"2024-04-01T02:13:03.214025+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'501","last_scrub_stamp":"2024-04-01T02:13:03.213802+0000","last_deep_scrub":"23'501","last_deep_scrub_stamp":"2024-04-01T02:13:03.213802+0000","last_clean_scrub_stamp":"2024-04-01T02:13:03.213802+0000","objects_scrubbed":16,"log_size":501,"log_dups_size":0,"ondisk_log_size":501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:58:12.518257+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4211749,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":345,"num_write_kb":18423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"23'570","reported_seq":603,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:59.852680+0000","last_change":"2024-04-01T02:12:59.852779+0000","last_active":"2024-04-01T02:12:59.852680+0000","last_peered":"2024-04-01T02:12:59.852680+0000","last_clean":"2024-04-01T02:12:59.852680+0000","last_became_active":"2024-04-01T01:55:49.246660+0000","last_became_peered":"2024-04-01T01:55:49.246660+0000","last_unstale":"2024-04-01T02:12:59.852680+0000","last_undegraded":"2024-04-01T02:12:59.852680+0000","last_fullsized":"2024-04-01T02:12:59.852680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'570","last_scrub_stamp":"2024-04-01T02:12:59.852537+0000","last_deep_scrub":"23'570","last_deep_scrub_stamp":"2024-04-01T02:12:59.852537+0000","last_clean_scrub_stamp":"2024-04-01T02:12:59.852537+0000","objects_scrubbed":15,"log_size":570,"log_dups_size":0,"ondisk_log_size":570,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:38:12.695043+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3694421,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":432,"num_write_kb":10812,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"23'538","reported_seq":571,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:54.914150+0000","last_change":"2024-04-01T02:12:54.914235+0000","last_active":"2024-04-01T02:12:54.914150+0000","last_peered":"2024-04-01T02:12:54.914150+0000","last_clean":"2024-04-01T02:12:54.914150+0000","last_became_active":"2024-04-01T01:55:49.239904+0000","last_became_peered":"2024-04-01T01:55:49.239904+0000","last_unstale":"2024-04-01T02:12:54.914150+0000","last_undegraded":"2024-04-01T02:12:54.914150+0000","last_fullsized":"2024-04-01T02:12:54.914150+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'538","last_scrub_stamp":"2024-04-01T02:12:54.913984+0000","last_deep_scrub":"23'538","last_deep_scrub_stamp":"2024-04-01T02:12:54.913984+0000","last_clean_scrub_stamp":"2024-04-01T02:12:54.913984+0000","objects_scrubbed":16,"log_size":538,"log_dups_size":0,"ondisk_log_size":538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:08:29.593745+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5131013,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":399,"num_write_kb":17827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"23'482","reported_seq":515,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:54.337981+0000","last_change":"2024-04-01T02:12:54.338052+0000","last_active":"2024-04-01T02:12:54.337981+0000","last_peered":"2024-04-01T02:12:54.337981+0000","last_clean":"2024-04-01T02:12:54.337981+0000","last_became_active":"2024-04-01T01:55:49.279041+0000","last_became_peered":"2024-04-01T01:55:49.279041+0000","last_unstale":"2024-04-01T02:12:54.337981+0000","last_undegraded":"2024-04-01T02:12:54.337981+0000","last_fullsized":"2024-04-01T02:12:54.337981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'482","last_scrub_stamp":"2024-04-01T02:12:54.337789+0000","last_deep_scrub":"23'482","last_deep_scrub_stamp":"2024-04-01T02:12:54.337789+0000","last_clean_scrub_stamp":"2024-04-01T02:12:54.337789+0000","objects_scrubbed":5,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:52:32.268814+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":658438,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":353,"num_write_kb":8202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"23'589","reported_seq":620,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:54.178446+0000","last_change":"2024-04-01T02:12:54.178525+0000","last_active":"2024-04-01T02:12:54.178446+0000","last_peered":"2024-04-01T02:12:54.178446+0000","last_clean":"2024-04-01T02:12:54.178446+0000","last_became_active":"2024-04-01T01:55:49.246152+0000","last_became_peered":"2024-04-01T01:55:49.246152+0000","last_unstale":"2024-04-01T02:12:54.178446+0000","last_undegraded":"2024-04-01T02:12:54.178446+0000","last_fullsized":"2024-04-01T02:12:54.178446+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'589","last_scrub_stamp":"2024-04-01T02:12:54.178272+0000","last_deep_scrub":"23'589","last_deep_scrub_stamp":"2024-04-01T02:12:54.178272+0000","last_clean_scrub_stamp":"2024-04-01T02:12:54.178272+0000","objects_scrubbed":14,"log_size":589,"log_dups_size":0,"ondisk_log_size":589,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:07:36.024323+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3987251,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":442,"num_write_kb":11887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"23'483","reported_seq":514,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:50.343742+0000","last_change":"2024-04-01T02:12:50.343847+0000","last_active":"2024-04-01T02:12:50.343742+0000","last_peered":"2024-04-01T02:12:50.343742+0000","last_clean":"2024-04-01T02:12:50.343742+0000","last_became_active":"2024-04-01T01:55:49.253348+0000","last_became_peered":"2024-04-01T01:55:49.253348+0000","last_unstale":"2024-04-01T02:12:50.343742+0000","last_undegraded":"2024-04-01T02:12:50.343742+0000","last_fullsized":"2024-04-01T02:12:50.343742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'483","last_scrub_stamp":"2024-04-01T02:12:50.343558+0000","last_deep_scrub":"23'483","last_deep_scrub_stamp":"2024-04-01T02:12:50.343558+0000","last_clean_scrub_stamp":"2024-04-01T02:12:50.343558+0000","objects_scrubbed":11,"log_size":483,"log_dups_size":0,"ondisk_log_size":483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:39:59.138321+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3474466,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":343,"num_write_kb":9649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"23'564","reported_seq":595,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:55.212048+0000","last_change":"2024-04-01T02:12:55.212119+0000","last_active":"2024-04-01T02:12:55.212048+0000","last_peered":"2024-04-01T02:12:55.212048+0000","last_clean":"2024-04-01T02:12:55.212048+0000","last_became_active":"2024-04-01T01:55:49.247373+0000","last_became_peered":"2024-04-01T01:55:49.247373+0000","last_unstale":"2024-04-01T02:12:55.212048+0000","last_undegraded":"2024-04-01T02:12:55.212048+0000","last_fullsized":"2024-04-01T02:12:55.212048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'564","last_scrub_stamp":"2024-04-01T02:12:55.211864+0000","last_deep_scrub":"23'564","last_deep_scrub_stamp":"2024-04-01T02:12:55.211864+0000","last_clean_scrub_stamp":"2024-04-01T02:12:55.211864+0000","objects_scrubbed":6,"log_size":564,"log_dups_size":0,"ondisk_log_size":564,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T13:39:59.482105+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2878976,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":421,"num_write_kb":10504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"23'488","reported_seq":519,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:13:05.831888+0000","last_change":"2024-04-01T02:13:05.831974+0000","last_active":"2024-04-01T02:13:05.831888+0000","last_peered":"2024-04-01T02:13:05.831888+0000","last_clean":"2024-04-01T02:13:05.831888+0000","last_became_active":"2024-04-01T01:55:49.262736+0000","last_became_peered":"2024-04-01T01:55:49.262736+0000","last_unstale":"2024-04-01T02:13:05.831888+0000","last_undegraded":"2024-04-01T02:13:05.831888+0000","last_fullsized":"2024-04-01T02:13:05.831888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'488","last_scrub_stamp":"2024-04-01T02:13:05.831707+0000","last_deep_scrub":"23'488","last_deep_scrub_stamp":"2024-04-01T02:13:05.831707+0000","last_clean_scrub_stamp":"2024-04-01T02:13:05.831707+0000","objects_scrubbed":9,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:10:44.985846+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3489692,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":346,"num_write_kb":10932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"23'519","reported_seq":551,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:53.978189+0000","last_change":"2024-04-01T02:12:53.978280+0000","last_active":"2024-04-01T02:12:53.978189+0000","last_peered":"2024-04-01T02:12:53.978189+0000","last_clean":"2024-04-01T02:12:53.978189+0000","last_became_active":"2024-04-01T01:55:49.259745+0000","last_became_peered":"2024-04-01T01:55:49.259745+0000","last_unstale":"2024-04-01T02:12:53.978189+0000","last_undegraded":"2024-04-01T02:12:53.978189+0000","last_fullsized":"2024-04-01T02:12:53.978189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'519","last_scrub_stamp":"2024-04-01T02:12:53.977995+0000","last_deep_scrub":"23'519","last_deep_scrub_stamp":"2024-04-01T02:12:53.977995+0000","last_clean_scrub_stamp":"2024-04-01T02:12:53.977995+0000","objects_scrubbed":12,"log_size":519,"log_dups_size":0,"ondisk_log_size":519,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:25:35.670815+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3721216,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":377,"num_write_kb":13356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"23'495","reported_seq":520,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:57.475587+0000","last_change":"2024-04-01T02:12:57.475656+0000","last_active":"2024-04-01T02:12:57.475587+0000","last_peered":"2024-04-01T02:12:57.475587+0000","last_clean":"2024-04-01T02:12:57.475587+0000","last_became_active":"2024-04-01T01:56:38.228548+0000","last_became_peered":"2024-04-01T01:56:38.228548+0000","last_unstale":"2024-04-01T02:12:57.475587+0000","last_undegraded":"2024-04-01T02:12:57.475587+0000","last_fullsized":"2024-04-01T02:12:57.475587+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'495","last_scrub_stamp":"2024-04-01T02:12:57.475422+0000","last_deep_scrub":"23'495","last_deep_scrub_stamp":"2024-04-01T02:12:57.475422+0000","last_clean_scrub_stamp":"2024-04-01T02:12:57.475422+0000","objects_scrubbed":6,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:50:45.915443+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2985236,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":363,"num_write_kb":27800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.35","version":"23'480","reported_seq":512,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:13:02.170082+0000","last_change":"2024-04-01T02:13:02.170164+0000","last_active":"2024-04-01T02:13:02.170082+0000","last_peered":"2024-04-01T02:13:02.170082+0000","last_clean":"2024-04-01T02:13:02.170082+0000","last_became_active":"2024-04-01T01:55:49.270877+0000","last_became_peered":"2024-04-01T01:55:49.270877+0000","last_unstale":"2024-04-01T02:13:02.170082+0000","last_undegraded":"2024-04-01T02:13:02.170082+0000","last_fullsized":"2024-04-01T02:13:02.170082+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'480","last_scrub_stamp":"2024-04-01T02:13:02.169918+0000","last_deep_scrub":"23'480","last_deep_scrub_stamp":"2024-04-01T02:13:02.169918+0000","last_clean_scrub_stamp":"2024-04-01T02:13:02.169918+0000","objects_scrubbed":12,"log_size":480,"log_dups_size":0,"ondisk_log_size":480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:03:41.008261+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3409567,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":12314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"23'419","reported_seq":451,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:13:00.215372+0000","last_change":"2024-04-01T02:13:00.215444+0000","last_active":"2024-04-01T02:13:00.215372+0000","last_peered":"2024-04-01T02:13:00.215372+0000","last_clean":"2024-04-01T02:13:00.215372+0000","last_became_active":"2024-04-01T01:55:49.259193+0000","last_became_peered":"2024-04-01T01:55:49.259193+0000","last_unstale":"2024-04-01T02:13:00.215372+0000","last_undegraded":"2024-04-01T02:13:00.215372+0000","last_fullsized":"2024-04-01T02:13:00.215372+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'419","last_scrub_stamp":"2024-04-01T02:13:00.215188+0000","last_deep_scrub":"23'419","last_deep_scrub_stamp":"2024-04-01T02:13:00.215188+0000","last_clean_scrub_stamp":"2024-04-01T02:13:00.215188+0000","objects_scrubbed":7,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:04:34.983783+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2357039,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":282,"num_write_kb":7635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"23'433","reported_seq":465,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:56.321662+0000","last_change":"2024-04-01T02:12:56.321795+0000","last_active":"2024-04-01T02:12:56.321662+0000","last_peered":"2024-04-01T02:12:56.321662+0000","last_clean":"2024-04-01T02:12:56.321662+0000","last_became_active":"2024-04-01T01:55:49.247436+0000","last_became_peered":"2024-04-01T01:55:49.247436+0000","last_unstale":"2024-04-01T02:12:56.321662+0000","last_undegraded":"2024-04-01T02:12:56.321662+0000","last_fullsized":"2024-04-01T02:12:56.321662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'433","last_scrub_stamp":"2024-04-01T02:12:56.321471+0000","last_deep_scrub":"23'433","last_deep_scrub_stamp":"2024-04-01T02:12:56.321471+0000","last_clean_scrub_stamp":"2024-04-01T02:12:56.321471+0000","objects_scrubbed":3,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:19:39.638577+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":608576,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":293,"num_write_kb":6624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"23'530","reported_seq":562,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:55.353048+0000","last_change":"2024-04-01T02:12:55.353112+0000","last_active":"2024-04-01T02:12:55.353048+0000","last_peered":"2024-04-01T02:12:55.353048+0000","last_clean":"2024-04-01T02:12:55.353048+0000","last_became_active":"2024-04-01T01:55:49.245650+0000","last_became_peered":"2024-04-01T01:55:49.245650+0000","last_unstale":"2024-04-01T02:12:55.353048+0000","last_undegraded":"2024-04-01T02:12:55.353048+0000","last_fullsized":"2024-04-01T02:12:55.353048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'530","last_scrub_stamp":"2024-04-01T02:12:55.352927+0000","last_deep_scrub":"23'530","last_deep_scrub_stamp":"2024-04-01T02:12:55.352927+0000","last_clean_scrub_stamp":"2024-04-01T02:12:55.352927+0000","objects_scrubbed":14,"log_size":530,"log_dups_size":0,"ondisk_log_size":530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:02:42.807922+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3014274,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":389,"num_write_kb":12247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"23'515","reported_seq":547,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:13:00.809612+0000","last_change":"2024-04-01T02:13:00.809765+0000","last_active":"2024-04-01T02:13:00.809612+0000","last_peered":"2024-04-01T02:13:00.809612+0000","last_clean":"2024-04-01T02:13:00.809612+0000","last_became_active":"2024-04-01T01:55:49.247662+0000","last_became_peered":"2024-04-01T01:55:49.247662+0000","last_unstale":"2024-04-01T02:13:00.809612+0000","last_undegraded":"2024-04-01T02:13:00.809612+0000","last_fullsized":"2024-04-01T02:13:00.809612+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'515","last_scrub_stamp":"2024-04-01T02:13:00.809370+0000","last_deep_scrub":"23'515","last_deep_scrub_stamp":"2024-04-01T02:13:00.809370+0000","last_clean_scrub_stamp":"2024-04-01T02:13:00.809370+0000","objects_scrubbed":9,"log_size":515,"log_dups_size":0,"ondisk_log_size":515,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:49:38.031822+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3985408,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":369,"num_write_kb":15794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"23'691","reported_seq":723,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:13:02.720046+0000","last_change":"2024-04-01T02:13:02.720221+0000","last_active":"2024-04-01T02:13:02.720046+0000","last_peered":"2024-04-01T02:13:02.720046+0000","last_clean":"2024-04-01T02:13:02.720046+0000","last_became_active":"2024-04-01T01:55:49.261839+0000","last_became_peered":"2024-04-01T01:55:49.261839+0000","last_unstale":"2024-04-01T02:13:02.720046+0000","last_undegraded":"2024-04-01T02:13:02.720046+0000","last_fullsized":"2024-04-01T02:13:02.720046+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'691","last_scrub_stamp":"2024-04-01T02:13:02.719780+0000","last_deep_scrub":"23'691","last_deep_scrub_stamp":"2024-04-01T02:13:02.719780+0000","last_clean_scrub_stamp":"2024-04-01T02:13:02.719780+0000","objects_scrubbed":12,"log_size":691,"log_dups_size":0,"ondisk_log_size":691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:58:12.024236+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6390669,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":553,"num_write_kb":46118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"23'595","reported_seq":619,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.735012+0000","last_change":"2024-04-01T01:55:49.276113+0000","last_active":"2024-04-01T02:12:38.735012+0000","last_peered":"2024-04-01T02:12:38.735012+0000","last_clean":"2024-04-01T02:12:38.735012+0000","last_became_active":"2024-04-01T01:55:49.275727+0000","last_became_peered":"2024-04-01T01:55:49.275727+0000","last_unstale":"2024-04-01T02:12:38.735012+0000","last_undegraded":"2024-04-01T02:12:38.735012+0000","last_fullsized":"2024-04-01T02:12:38.735012+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":595,"log_dups_size":0,"ondisk_log_size":595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1955840,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":457,"num_write_kb":17131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"23'511","reported_seq":543,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:55.445905+0000","last_change":"2024-04-01T02:12:55.445943+0000","last_active":"2024-04-01T02:12:55.445905+0000","last_peered":"2024-04-01T02:12:55.445905+0000","last_clean":"2024-04-01T02:12:55.445905+0000","last_became_active":"2024-04-01T01:55:49.252553+0000","last_became_peered":"2024-04-01T01:55:49.252553+0000","last_unstale":"2024-04-01T02:12:55.445905+0000","last_undegraded":"2024-04-01T02:12:55.445905+0000","last_fullsized":"2024-04-01T02:12:55.445905+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'511","last_scrub_stamp":"2024-04-01T02:12:55.445834+0000","last_deep_scrub":"23'511","last_deep_scrub_stamp":"2024-04-01T02:12:55.445834+0000","last_clean_scrub_stamp":"2024-04-01T02:12:55.445834+0000","objects_scrubbed":9,"log_size":511,"log_dups_size":0,"ondisk_log_size":511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:04:46.977716+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5136348,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":357,"num_write_kb":34023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"23'532","reported_seq":564,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:49.583659+0000","last_change":"2024-04-01T02:12:49.583709+0000","last_active":"2024-04-01T02:12:49.583659+0000","last_peered":"2024-04-01T02:12:49.583659+0000","last_clean":"2024-04-01T02:12:49.583659+0000","last_became_active":"2024-04-01T01:55:49.259935+0000","last_became_peered":"2024-04-01T01:55:49.259935+0000","last_unstale":"2024-04-01T02:12:49.583659+0000","last_undegraded":"2024-04-01T02:12:49.583659+0000","last_fullsized":"2024-04-01T02:12:49.583659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'532","last_scrub_stamp":"2024-04-01T02:12:49.583545+0000","last_deep_scrub":"23'532","last_deep_scrub_stamp":"2024-04-01T02:12:49.583545+0000","last_clean_scrub_stamp":"2024-04-01T02:12:49.583545+0000","objects_scrubbed":10,"log_size":532,"log_dups_size":0,"ondisk_log_size":532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:15:49.640682+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6314527,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":390,"num_write_kb":35275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"23'666","reported_seq":698,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:59.220607+0000","last_change":"2024-04-01T02:12:59.220694+0000","last_active":"2024-04-01T02:12:59.220607+0000","last_peered":"2024-04-01T02:12:59.220607+0000","last_clean":"2024-04-01T02:12:59.220607+0000","last_became_active":"2024-04-01T01:55:49.258670+0000","last_became_peered":"2024-04-01T01:55:49.258670+0000","last_unstale":"2024-04-01T02:12:59.220607+0000","last_undegraded":"2024-04-01T02:12:59.220607+0000","last_fullsized":"2024-04-01T02:12:59.220607+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'666","last_scrub_stamp":"2024-04-01T02:12:59.220432+0000","last_deep_scrub":"23'666","last_deep_scrub_stamp":"2024-04-01T02:12:59.220432+0000","last_clean_scrub_stamp":"2024-04-01T02:12:59.220432+0000","objects_scrubbed":12,"log_size":666,"log_dups_size":0,"ondisk_log_size":666,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:28:39.699162+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3478562,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":525,"num_write_kb":13686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"23'534","reported_seq":566,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:56.376176+0000","last_change":"2024-04-01T02:12:56.376258+0000","last_active":"2024-04-01T02:12:56.376176+0000","last_peered":"2024-04-01T02:12:56.376176+0000","last_clean":"2024-04-01T02:12:56.376176+0000","last_became_active":"2024-04-01T01:55:49.243518+0000","last_became_peered":"2024-04-01T01:55:49.243518+0000","last_unstale":"2024-04-01T02:12:56.376176+0000","last_undegraded":"2024-04-01T02:12:56.376176+0000","last_fullsized":"2024-04-01T02:12:56.376176+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'534","last_scrub_stamp":"2024-04-01T02:12:56.376001+0000","last_deep_scrub":"23'534","last_deep_scrub_stamp":"2024-04-01T02:12:56.376001+0000","last_clean_scrub_stamp":"2024-04-01T02:12:56.376001+0000","objects_scrubbed":8,"log_size":534,"log_dups_size":0,"ondisk_log_size":534,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:15:56.433138+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1873749,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":387,"num_write_kb":9989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"23'563","reported_seq":595,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:52.983392+0000","last_change":"2024-04-01T02:12:52.983487+0000","last_active":"2024-04-01T02:12:52.983392+0000","last_peered":"2024-04-01T02:12:52.983392+0000","last_clean":"2024-04-01T02:12:52.983392+0000","last_became_active":"2024-04-01T01:55:49.257576+0000","last_became_peered":"2024-04-01T01:55:49.257576+0000","last_unstale":"2024-04-01T02:12:52.983392+0000","last_undegraded":"2024-04-01T02:12:52.983392+0000","last_fullsized":"2024-04-01T02:12:52.983392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'563","last_scrub_stamp":"2024-04-01T02:12:52.983187+0000","last_deep_scrub":"23'563","last_deep_scrub_stamp":"2024-04-01T02:12:52.983187+0000","last_clean_scrub_stamp":"2024-04-01T02:12:52.983187+0000","objects_scrubbed":10,"log_size":563,"log_dups_size":0,"ondisk_log_size":563,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:04:44.515070+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3745621,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":429,"num_write_kb":26683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"23'505","reported_seq":537,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:13:01.836024+0000","last_change":"2024-04-01T02:13:01.836110+0000","last_active":"2024-04-01T02:13:01.836024+0000","last_peered":"2024-04-01T02:13:01.836024+0000","last_clean":"2024-04-01T02:13:01.836024+0000","last_became_active":"2024-04-01T01:55:49.250522+0000","last_became_peered":"2024-04-01T01:55:49.250522+0000","last_unstale":"2024-04-01T02:13:01.836024+0000","last_undegraded":"2024-04-01T02:13:01.836024+0000","last_fullsized":"2024-04-01T02:13:01.836024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'505","last_scrub_stamp":"2024-04-01T02:13:01.835865+0000","last_deep_scrub":"23'505","last_deep_scrub_stamp":"2024-04-01T02:13:01.835865+0000","last_clean_scrub_stamp":"2024-04-01T02:13:01.835865+0000","objects_scrubbed":10,"log_size":505,"log_dups_size":0,"ondisk_log_size":505,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:54:23.522856+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1694624,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":361,"num_write_kb":9747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"23'531","reported_seq":563,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:13:03.711985+0000","last_change":"2024-04-01T02:13:03.712068+0000","last_active":"2024-04-01T02:13:03.711985+0000","last_peered":"2024-04-01T02:13:03.711985+0000","last_clean":"2024-04-01T02:13:03.711985+0000","last_became_active":"2024-04-01T01:55:49.269694+0000","last_became_peered":"2024-04-01T01:55:49.269694+0000","last_unstale":"2024-04-01T02:13:03.711985+0000","last_undegraded":"2024-04-01T02:13:03.711985+0000","last_fullsized":"2024-04-01T02:13:03.711985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'531","last_scrub_stamp":"2024-04-01T02:13:03.711820+0000","last_deep_scrub":"23'531","last_deep_scrub_stamp":"2024-04-01T02:13:03.711820+0000","last_clean_scrub_stamp":"2024-04-01T02:13:03.711820+0000","objects_scrubbed":13,"log_size":531,"log_dups_size":0,"ondisk_log_size":531,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:39:43.896810+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4783138,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384,"num_write_kb":12273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"23'564","reported_seq":596,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:56.878238+0000","last_change":"2024-04-01T02:12:56.878323+0000","last_active":"2024-04-01T02:12:56.878238+0000","last_peered":"2024-04-01T02:12:56.878238+0000","last_clean":"2024-04-01T02:12:56.878238+0000","last_became_active":"2024-04-01T01:55:49.243017+0000","last_became_peered":"2024-04-01T01:55:49.243017+0000","last_unstale":"2024-04-01T02:12:56.878238+0000","last_undegraded":"2024-04-01T02:12:56.878238+0000","last_fullsized":"2024-04-01T02:12:56.878238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'564","last_scrub_stamp":"2024-04-01T02:12:56.878071+0000","last_deep_scrub":"23'564","last_deep_scrub_stamp":"2024-04-01T02:12:56.878071+0000","last_clean_scrub_stamp":"2024-04-01T02:12:56.878071+0000","objects_scrubbed":13,"log_size":564,"log_dups_size":0,"ondisk_log_size":564,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:51:00.730669+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3977024,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":423,"num_write_kb":11436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"23'590","reported_seq":622,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:56.409791+0000","last_change":"2024-04-01T02:12:56.409956+0000","last_active":"2024-04-01T02:12:56.409791+0000","last_peered":"2024-04-01T02:12:56.409791+0000","last_clean":"2024-04-01T02:12:56.409791+0000","last_became_active":"2024-04-01T01:55:49.279882+0000","last_became_peered":"2024-04-01T01:55:49.279882+0000","last_unstale":"2024-04-01T02:12:56.409791+0000","last_undegraded":"2024-04-01T02:12:56.409791+0000","last_fullsized":"2024-04-01T02:12:56.409791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'590","last_scrub_stamp":"2024-04-01T02:12:56.409551+0000","last_deep_scrub":"23'590","last_deep_scrub_stamp":"2024-04-01T02:12:56.409551+0000","last_clean_scrub_stamp":"2024-04-01T02:12:56.409551+0000","objects_scrubbed":13,"log_size":590,"log_dups_size":0,"ondisk_log_size":590,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:18:07.908024+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8142848,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":413,"num_write_kb":37888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"23'776","reported_seq":808,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:57.394225+0000","last_change":"2024-04-01T02:12:57.394305+0000","last_active":"2024-04-01T02:12:57.394225+0000","last_peered":"2024-04-01T02:12:57.394225+0000","last_clean":"2024-04-01T02:12:57.394225+0000","last_became_active":"2024-04-01T01:55:49.249588+0000","last_became_peered":"2024-04-01T01:55:49.249588+0000","last_unstale":"2024-04-01T02:12:57.394225+0000","last_undegraded":"2024-04-01T02:12:57.394225+0000","last_fullsized":"2024-04-01T02:12:57.394225+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'776","last_scrub_stamp":"2024-04-01T02:12:57.394131+0000","last_deep_scrub":"23'776","last_deep_scrub_stamp":"2024-04-01T02:12:57.394131+0000","last_clean_scrub_stamp":"2024-04-01T02:12:57.394131+0000","objects_scrubbed":14,"log_size":776,"log_dups_size":0,"ondisk_log_size":776,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T13:01:20.431518+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4497408,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":644,"num_write_kb":39031,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"23'445","reported_seq":477,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:58.334922+0000","last_change":"2024-04-01T02:12:58.334986+0000","last_active":"2024-04-01T02:12:58.334922+0000","last_peered":"2024-04-01T02:12:58.334922+0000","last_clean":"2024-04-01T02:12:58.334922+0000","last_became_active":"2024-04-01T01:55:49.253726+0000","last_became_peered":"2024-04-01T01:55:49.253726+0000","last_unstale":"2024-04-01T02:12:58.334922+0000","last_undegraded":"2024-04-01T02:12:58.334922+0000","last_fullsized":"2024-04-01T02:12:58.334922+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'445","last_scrub_stamp":"2024-04-01T02:12:58.334824+0000","last_deep_scrub":"23'445","last_deep_scrub_stamp":"2024-04-01T02:12:58.334824+0000","last_clean_scrub_stamp":"2024-04-01T02:12:58.334824+0000","objects_scrubbed":8,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:15:58.391962+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2117070,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":308,"num_write_kb":8584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"23'494","reported_seq":527,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:13:02.849551+0000","last_change":"2024-04-01T02:13:02.849630+0000","last_active":"2024-04-01T02:13:02.849551+0000","last_peered":"2024-04-01T02:13:02.849551+0000","last_clean":"2024-04-01T02:13:02.849551+0000","last_became_active":"2024-04-01T01:55:49.251760+0000","last_became_peered":"2024-04-01T01:55:49.251760+0000","last_unstale":"2024-04-01T02:13:02.849551+0000","last_undegraded":"2024-04-01T02:13:02.849551+0000","last_fullsized":"2024-04-01T02:13:02.849551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'494","last_scrub_stamp":"2024-04-01T02:13:02.849371+0000","last_deep_scrub":"23'494","last_deep_scrub_stamp":"2024-04-01T02:13:02.849371+0000","last_clean_scrub_stamp":"2024-04-01T02:13:02.849371+0000","objects_scrubbed":9,"log_size":494,"log_dups_size":0,"ondisk_log_size":494,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:44:18.665097+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1909794,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":354,"num_write_kb":10727,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"23'896","reported_seq":929,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:13:04.745135+0000","last_change":"2024-04-01T02:13:04.745321+0000","last_active":"2024-04-01T02:13:04.745135+0000","last_peered":"2024-04-01T02:13:04.745135+0000","last_clean":"2024-04-01T02:13:04.745135+0000","last_became_active":"2024-04-01T01:55:49.269636+0000","last_became_peered":"2024-04-01T01:55:49.269636+0000","last_unstale":"2024-04-01T02:13:04.745135+0000","last_undegraded":"2024-04-01T02:13:04.745135+0000","last_fullsized":"2024-04-01T02:13:04.745135+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'896","last_scrub_stamp":"2024-04-01T02:13:04.744922+0000","last_deep_scrub":"23'896","last_deep_scrub_stamp":"2024-04-01T02:13:04.744922+0000","last_clean_scrub_stamp":"2024-04-01T02:13:04.744922+0000","objects_scrubbed":14,"log_size":896,"log_dups_size":0,"ondisk_log_size":896,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:37:37.802059+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6037504,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":748,"num_write_kb":31167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"23'566","reported_seq":599,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:56.476406+0000","last_change":"2024-04-01T02:12:56.476485+0000","last_active":"2024-04-01T02:12:56.476406+0000","last_peered":"2024-04-01T02:12:56.476406+0000","last_clean":"2024-04-01T02:12:56.476406+0000","last_became_active":"2024-04-01T01:55:49.265946+0000","last_became_peered":"2024-04-01T01:55:49.265946+0000","last_unstale":"2024-04-01T02:12:56.476406+0000","last_undegraded":"2024-04-01T02:12:56.476406+0000","last_fullsized":"2024-04-01T02:12:56.476406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'566","last_scrub_stamp":"2024-04-01T02:12:56.476248+0000","last_deep_scrub":"23'566","last_deep_scrub_stamp":"2024-04-01T02:12:56.476248+0000","last_clean_scrub_stamp":"2024-04-01T02:12:56.476248+0000","objects_scrubbed":14,"log_size":566,"log_dups_size":0,"ondisk_log_size":566,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:25:38.169067+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4188782,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":415,"num_write_kb":13639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"23'525","reported_seq":558,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:53.322084+0000","last_change":"2024-04-01T02:12:53.322166+0000","last_active":"2024-04-01T02:12:53.322084+0000","last_peered":"2024-04-01T02:12:53.322084+0000","last_clean":"2024-04-01T02:12:53.322084+0000","last_became_active":"2024-04-01T01:55:49.272742+0000","last_became_peered":"2024-04-01T01:55:49.272742+0000","last_unstale":"2024-04-01T02:12:53.322084+0000","last_undegraded":"2024-04-01T02:12:53.322084+0000","last_fullsized":"2024-04-01T02:12:53.322084+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'525","last_scrub_stamp":"2024-04-01T02:12:53.321915+0000","last_deep_scrub":"23'525","last_deep_scrub_stamp":"2024-04-01T02:12:53.321915+0000","last_clean_scrub_stamp":"2024-04-01T02:12:53.321915+0000","objects_scrubbed":8,"log_size":525,"log_dups_size":0,"ondisk_log_size":525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:25:35.014734+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2869248,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":375,"num_write_kb":19168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"23'547","reported_seq":578,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:51.976588+0000","last_change":"2024-04-01T02:12:51.976674+0000","last_active":"2024-04-01T02:12:51.976588+0000","last_peered":"2024-04-01T02:12:51.976588+0000","last_clean":"2024-04-01T02:12:51.976588+0000","last_became_active":"2024-04-01T01:55:49.238286+0000","last_became_peered":"2024-04-01T01:55:49.238286+0000","last_unstale":"2024-04-01T02:12:51.976588+0000","last_undegraded":"2024-04-01T02:12:51.976588+0000","last_fullsized":"2024-04-01T02:12:51.976588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'547","last_scrub_stamp":"2024-04-01T02:12:51.976395+0000","last_deep_scrub":"23'547","last_deep_scrub_stamp":"2024-04-01T02:12:51.976395+0000","last_clean_scrub_stamp":"2024-04-01T02:12:51.976395+0000","objects_scrubbed":20,"log_size":547,"log_dups_size":0,"ondisk_log_size":547,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:19:19.704349+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6652831,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":403,"num_write_kb":17955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"23'645","reported_seq":678,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:52.933130+0000","last_change":"2024-04-01T02:12:52.933193+0000","last_active":"2024-04-01T02:12:52.933130+0000","last_peered":"2024-04-01T02:12:52.933130+0000","last_clean":"2024-04-01T02:12:52.933130+0000","last_became_active":"2024-04-01T01:55:48.224408+0000","last_became_peered":"2024-04-01T01:55:48.224408+0000","last_unstale":"2024-04-01T02:12:52.933130+0000","last_undegraded":"2024-04-01T02:12:52.933130+0000","last_fullsized":"2024-04-01T02:12:52.933130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'645","last_scrub_stamp":"2024-04-01T02:12:52.932978+0000","last_deep_scrub":"23'645","last_deep_scrub_stamp":"2024-04-01T02:12:52.932978+0000","last_clean_scrub_stamp":"2024-04-01T02:12:52.932978+0000","objects_scrubbed":1,"log_size":645,"log_dups_size":0,"ondisk_log_size":645,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:13:16.895151+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":643,"num_write_kb":4346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"23'485","reported_seq":516,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:59.355642+0000","last_change":"2024-04-01T02:12:59.355771+0000","last_active":"2024-04-01T02:12:59.355642+0000","last_peered":"2024-04-01T02:12:59.355642+0000","last_clean":"2024-04-01T02:12:59.355642+0000","last_became_active":"2024-04-01T01:55:49.247496+0000","last_became_peered":"2024-04-01T01:55:49.247496+0000","last_unstale":"2024-04-01T02:12:59.355642+0000","last_undegraded":"2024-04-01T02:12:59.355642+0000","last_fullsized":"2024-04-01T02:12:59.355642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'485","last_scrub_stamp":"2024-04-01T02:12:59.355453+0000","last_deep_scrub":"23'485","last_deep_scrub_stamp":"2024-04-01T02:12:59.355453+0000","last_clean_scrub_stamp":"2024-04-01T02:12:59.355453+0000","objects_scrubbed":11,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T13:15:33.679492+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3922463,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":358,"num_write_kb":10126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"23'1949","reported_seq":1982,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:59.818084+0000","last_change":"2024-04-01T02:12:59.818084+0000","last_active":"2024-04-01T02:12:59.818084+0000","last_peered":"2024-04-01T02:12:59.818084+0000","last_clean":"2024-04-01T02:12:59.818084+0000","last_became_active":"2024-04-01T01:55:48.221614+0000","last_became_peered":"2024-04-01T01:55:48.221614+0000","last_unstale":"2024-04-01T02:12:59.818084+0000","last_undegraded":"2024-04-01T02:12:59.818084+0000","last_fullsized":"2024-04-01T02:12:59.818084+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1948","last_scrub_stamp":"2024-04-01T02:12:59.817816+0000","last_deep_scrub":"23'1948","last_deep_scrub_stamp":"2024-04-01T02:12:59.817816+0000","last_clean_scrub_stamp":"2024-04-01T02:12:59.817816+0000","objects_scrubbed":4,"log_size":1949,"log_dups_size":0,"ondisk_log_size":1949,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:04:34.586412+0000","scrub_duration":111,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16749926,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1942,"num_write_kb":17243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"23'394","reported_seq":428,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:51.302147+0000","last_change":"2024-04-01T02:12:51.302147+0000","last_active":"2024-04-01T02:12:51.302147+0000","last_peered":"2024-04-01T02:12:51.302147+0000","last_clean":"2024-04-01T02:12:51.302147+0000","last_became_active":"2024-04-01T01:55:48.216141+0000","last_became_peered":"2024-04-01T01:55:48.216141+0000","last_unstale":"2024-04-01T02:12:51.302147+0000","last_undegraded":"2024-04-01T02:12:51.302147+0000","last_fullsized":"2024-04-01T02:12:51.302147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'394","last_scrub_stamp":"2024-04-01T02:12:51.301900+0000","last_deep_scrub":"23'394","last_deep_scrub_stamp":"2024-04-01T02:12:51.301900+0000","last_clean_scrub_stamp":"2024-04-01T02:12:51.301900+0000","objects_scrubbed":1,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:19:19.029853+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":392,"num_write_kb":4245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"23'564","reported_seq":596,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:57.844702+0000","last_change":"2024-04-01T02:12:57.844781+0000","last_active":"2024-04-01T02:12:57.844702+0000","last_peered":"2024-04-01T02:12:57.844702+0000","last_clean":"2024-04-01T02:12:57.844702+0000","last_became_active":"2024-04-01T01:55:49.243823+0000","last_became_peered":"2024-04-01T01:55:49.243823+0000","last_unstale":"2024-04-01T02:12:57.844702+0000","last_undegraded":"2024-04-01T02:12:57.844702+0000","last_fullsized":"2024-04-01T02:12:57.844702+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'564","last_scrub_stamp":"2024-04-01T02:12:57.844573+0000","last_deep_scrub":"23'564","last_deep_scrub_stamp":"2024-04-01T02:12:57.844573+0000","last_clean_scrub_stamp":"2024-04-01T02:12:57.844573+0000","objects_scrubbed":14,"log_size":564,"log_dups_size":0,"ondisk_log_size":564,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:20:11.627917+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3965184,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":412,"num_write_kb":14098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"23'1755","reported_seq":1789,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:13:00.757453+0000","last_change":"2024-04-01T02:13:00.757527+0000","last_active":"2024-04-01T02:13:00.757453+0000","last_peered":"2024-04-01T02:13:00.757453+0000","last_clean":"2024-04-01T02:13:00.757453+0000","last_became_active":"2024-04-01T01:55:48.222535+0000","last_became_peered":"2024-04-01T01:55:48.222535+0000","last_unstale":"2024-04-01T02:13:00.757453+0000","last_undegraded":"2024-04-01T02:13:00.757453+0000","last_fullsized":"2024-04-01T02:13:00.757453+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1755","last_scrub_stamp":"2024-04-01T02:13:00.757279+0000","last_deep_scrub":"23'1755","last_deep_scrub_stamp":"2024-04-01T02:13:00.757279+0000","last_clean_scrub_stamp":"2024-04-01T02:13:00.757279+0000","objects_scrubbed":3,"log_size":1755,"log_dups_size":0,"ondisk_log_size":1755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:24:58.684456+0000","scrub_duration":83,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1749,"num_write_kb":12993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"23'546","reported_seq":578,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:55.402113+0000","last_change":"2024-04-01T02:12:55.402199+0000","last_active":"2024-04-01T02:12:55.402113+0000","last_peered":"2024-04-01T02:12:55.402113+0000","last_clean":"2024-04-01T02:12:55.402113+0000","last_became_active":"2024-04-01T01:55:49.230659+0000","last_became_peered":"2024-04-01T01:55:49.230659+0000","last_unstale":"2024-04-01T02:12:55.402113+0000","last_undegraded":"2024-04-01T02:12:55.402113+0000","last_fullsized":"2024-04-01T02:12:55.402113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'546","last_scrub_stamp":"2024-04-01T02:12:55.401927+0000","last_deep_scrub":"23'546","last_deep_scrub_stamp":"2024-04-01T02:12:55.401927+0000","last_clean_scrub_stamp":"2024-04-01T02:12:55.401927+0000","objects_scrubbed":15,"log_size":546,"log_dups_size":0,"ondisk_log_size":546,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T13:01:18.439313+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3477908,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":407,"num_write_kb":10690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"23'1","reported_seq":35,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:49.919410+0000","last_change":"2024-04-01T02:12:49.919432+0000","last_active":"2024-04-01T02:12:49.919410+0000","last_peered":"2024-04-01T02:12:49.919410+0000","last_clean":"2024-04-01T02:12:49.919410+0000","last_became_active":"2024-04-01T01:55:48.216318+0000","last_became_peered":"2024-04-01T01:55:48.216318+0000","last_unstale":"2024-04-01T02:12:49.919410+0000","last_undegraded":"2024-04-01T02:12:49.919410+0000","last_fullsized":"2024-04-01T02:12:49.919410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1","last_scrub_stamp":"2024-04-01T02:12:49.919321+0000","last_deep_scrub":"23'1","last_deep_scrub_stamp":"2024-04-01T02:12:49.919321+0000","last_clean_scrub_stamp":"2024-04-01T02:12:49.919321+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:31:46.335059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"23'559","reported_seq":591,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:55.343722+0000","last_change":"2024-04-01T02:12:55.343811+0000","last_active":"2024-04-01T02:12:55.343722+0000","last_peered":"2024-04-01T02:12:55.343722+0000","last_clean":"2024-04-01T02:12:55.343722+0000","last_became_active":"2024-04-01T01:55:49.279866+0000","last_became_peered":"2024-04-01T01:55:49.279866+0000","last_unstale":"2024-04-01T02:12:55.343722+0000","last_undegraded":"2024-04-01T02:12:55.343722+0000","last_fullsized":"2024-04-01T02:12:55.343722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'559","last_scrub_stamp":"2024-04-01T02:12:55.343514+0000","last_deep_scrub":"23'559","last_deep_scrub_stamp":"2024-04-01T02:12:55.343514+0000","last_clean_scrub_stamp":"2024-04-01T02:12:55.343514+0000","objects_scrubbed":9,"log_size":559,"log_dups_size":0,"ondisk_log_size":559,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:53:23.721280+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2636189,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":401,"num_write_kb":10506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"23'495","reported_seq":529,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:51.196591+0000","last_change":"2024-04-01T02:12:51.196661+0000","last_active":"2024-04-01T02:12:51.196591+0000","last_peered":"2024-04-01T02:12:51.196591+0000","last_clean":"2024-04-01T02:12:51.196591+0000","last_became_active":"2024-04-01T01:55:48.213610+0000","last_became_peered":"2024-04-01T01:55:48.213610+0000","last_unstale":"2024-04-01T02:12:51.196591+0000","last_undegraded":"2024-04-01T02:12:51.196591+0000","last_fullsized":"2024-04-01T02:12:51.196591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'495","last_scrub_stamp":"2024-04-01T02:12:51.196405+0000","last_deep_scrub":"23'495","last_deep_scrub_stamp":"2024-04-01T02:12:51.196405+0000","last_clean_scrub_stamp":"2024-04-01T02:12:51.196405+0000","objects_scrubbed":1,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:54:22.076959+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":490,"num_write_kb":4342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"23'516","reported_seq":548,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:13:04.855666+0000","last_change":"2024-04-01T02:13:04.855806+0000","last_active":"2024-04-01T02:13:04.855666+0000","last_peered":"2024-04-01T02:13:04.855666+0000","last_clean":"2024-04-01T02:13:04.855666+0000","last_became_active":"2024-04-01T01:55:49.261260+0000","last_became_peered":"2024-04-01T01:55:49.261260+0000","last_unstale":"2024-04-01T02:13:04.855666+0000","last_undegraded":"2024-04-01T02:13:04.855666+0000","last_fullsized":"2024-04-01T02:13:04.855666+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'516","last_scrub_stamp":"2024-04-01T02:13:04.855462+0000","last_deep_scrub":"23'516","last_deep_scrub_stamp":"2024-04-01T02:13:04.855462+0000","last_clean_scrub_stamp":"2024-04-01T02:13:04.855462+0000","objects_scrubbed":9,"log_size":516,"log_dups_size":0,"ondisk_log_size":516,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:10:20.047447+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2169152,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":377,"num_write_kb":10428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"23'1319","reported_seq":1353,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:53.479499+0000","last_change":"2024-04-01T02:12:53.479528+0000","last_active":"2024-04-01T02:12:53.479499+0000","last_peered":"2024-04-01T02:12:53.479499+0000","last_clean":"2024-04-01T02:12:53.479499+0000","last_became_active":"2024-04-01T01:55:48.226061+0000","last_became_peered":"2024-04-01T01:55:48.226061+0000","last_unstale":"2024-04-01T02:12:53.479499+0000","last_undegraded":"2024-04-01T02:12:53.479499+0000","last_fullsized":"2024-04-01T02:12:53.479499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1319","last_scrub_stamp":"2024-04-01T02:12:53.479431+0000","last_deep_scrub":"23'1319","last_deep_scrub_stamp":"2024-04-01T02:12:53.479431+0000","last_clean_scrub_stamp":"2024-04-01T02:12:53.479431+0000","objects_scrubbed":3,"log_size":1319,"log_dups_size":0,"ondisk_log_size":1319,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:57:47.002964+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1316,"num_write_kb":5169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"23'652","reported_seq":684,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:50.601666+0000","last_change":"2024-04-01T02:12:50.601722+0000","last_active":"2024-04-01T02:12:50.601666+0000","last_peered":"2024-04-01T02:12:50.601666+0000","last_clean":"2024-04-01T02:12:50.601666+0000","last_became_active":"2024-04-01T01:55:49.261286+0000","last_became_peered":"2024-04-01T01:55:49.261286+0000","last_unstale":"2024-04-01T02:12:50.601666+0000","last_undegraded":"2024-04-01T02:12:50.601666+0000","last_fullsized":"2024-04-01T02:12:50.601666+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'652","last_scrub_stamp":"2024-04-01T02:12:50.601555+0000","last_deep_scrub":"23'652","last_deep_scrub_stamp":"2024-04-01T02:12:50.601555+0000","last_clean_scrub_stamp":"2024-04-01T02:12:50.601555+0000","objects_scrubbed":10,"log_size":652,"log_dups_size":0,"ondisk_log_size":652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:09:44.845580+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3031627,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":532,"num_write_kb":22303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"23'1660","reported_seq":1694,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:49.438804+0000","last_change":"2024-04-01T02:12:49.438804+0000","last_active":"2024-04-01T02:12:49.438804+0000","last_peered":"2024-04-01T02:12:49.438804+0000","last_clean":"2024-04-01T02:12:49.438804+0000","last_became_active":"2024-04-01T01:55:48.219107+0000","last_became_peered":"2024-04-01T01:55:48.219107+0000","last_unstale":"2024-04-01T02:12:49.438804+0000","last_undegraded":"2024-04-01T02:12:49.438804+0000","last_fullsized":"2024-04-01T02:12:49.438804+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1659","last_scrub_stamp":"2024-04-01T02:12:49.438628+0000","last_deep_scrub":"23'1659","last_deep_scrub_stamp":"2024-04-01T02:12:49.438628+0000","last_clean_scrub_stamp":"2024-04-01T02:12:49.438628+0000","objects_scrubbed":6,"log_size":1660,"log_dups_size":0,"ondisk_log_size":1660,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:23:33.089557+0000","scrub_duration":79,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1652,"num_write_kb":13026,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"23'485","reported_seq":517,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:57.175832+0000","last_change":"2024-04-01T02:12:57.175902+0000","last_active":"2024-04-01T02:12:57.175832+0000","last_peered":"2024-04-01T02:12:57.175832+0000","last_clean":"2024-04-01T02:12:57.175832+0000","last_became_active":"2024-04-01T01:55:49.247910+0000","last_became_peered":"2024-04-01T01:55:49.247910+0000","last_unstale":"2024-04-01T02:12:57.175832+0000","last_undegraded":"2024-04-01T02:12:57.175832+0000","last_fullsized":"2024-04-01T02:12:57.175832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'485","last_scrub_stamp":"2024-04-01T02:12:57.175667+0000","last_deep_scrub":"23'485","last_deep_scrub_stamp":"2024-04-01T02:12:57.175667+0000","last_clean_scrub_stamp":"2024-04-01T02:12:57.175667+0000","objects_scrubbed":7,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:59:00.273204+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3214612,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":324,"num_write_kb":15075,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"23'1310","reported_seq":1344,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:51.459075+0000","last_change":"2024-04-01T02:12:51.459151+0000","last_active":"2024-04-01T02:12:51.459075+0000","last_peered":"2024-04-01T02:12:51.459075+0000","last_clean":"2024-04-01T02:12:51.459075+0000","last_became_active":"2024-04-01T01:55:48.214669+0000","last_became_peered":"2024-04-01T01:55:48.214669+0000","last_unstale":"2024-04-01T02:12:51.459075+0000","last_undegraded":"2024-04-01T02:12:51.459075+0000","last_fullsized":"2024-04-01T02:12:51.459075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1310","last_scrub_stamp":"2024-04-01T02:12:51.458907+0000","last_deep_scrub":"23'1310","last_deep_scrub_stamp":"2024-04-01T02:12:51.458907+0000","last_clean_scrub_stamp":"2024-04-01T02:12:51.458907+0000","objects_scrubbed":4,"log_size":1310,"log_dups_size":0,"ondisk_log_size":1310,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:13:21.121375+0000","scrub_duration":55,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1305,"num_write_kb":8736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"23'512","reported_seq":544,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:59.354764+0000","last_change":"2024-04-01T02:12:59.354857+0000","last_active":"2024-04-01T02:12:59.354764+0000","last_peered":"2024-04-01T02:12:59.354764+0000","last_clean":"2024-04-01T02:12:59.354764+0000","last_became_active":"2024-04-01T01:55:49.269840+0000","last_became_peered":"2024-04-01T01:55:49.269840+0000","last_unstale":"2024-04-01T02:12:59.354764+0000","last_undegraded":"2024-04-01T02:12:59.354764+0000","last_fullsized":"2024-04-01T02:12:59.354764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'512","last_scrub_stamp":"2024-04-01T02:12:59.354603+0000","last_deep_scrub":"23'512","last_deep_scrub_stamp":"2024-04-01T02:12:59.354603+0000","last_clean_scrub_stamp":"2024-04-01T02:12:59.354603+0000","objects_scrubbed":10,"log_size":512,"log_dups_size":0,"ondisk_log_size":512,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:09:53.598628+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2873887,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":372,"num_write_kb":10690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":34,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:56.673956+0000","last_change":"2024-04-01T02:12:56.674010+0000","last_active":"2024-04-01T02:12:56.673956+0000","last_peered":"2024-04-01T02:12:56.673956+0000","last_clean":"2024-04-01T02:12:56.673956+0000","last_became_active":"2024-04-01T01:55:48.213463+0000","last_became_peered":"2024-04-01T01:55:48.213463+0000","last_unstale":"2024-04-01T02:12:56.673956+0000","last_undegraded":"2024-04-01T02:12:56.673956+0000","last_fullsized":"2024-04-01T02:12:56.673956+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T02:12:56.673768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T02:12:56.673768+0000","last_clean_scrub_stamp":"2024-04-01T02:12:56.673768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:58:59.771305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"23'705","reported_seq":737,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:13:06.789872+0000","last_change":"2024-04-01T02:13:06.789954+0000","last_active":"2024-04-01T02:13:06.789872+0000","last_peered":"2024-04-01T02:13:06.789872+0000","last_clean":"2024-04-01T02:13:06.789872+0000","last_became_active":"2024-04-01T01:55:49.274430+0000","last_became_peered":"2024-04-01T01:55:49.274430+0000","last_unstale":"2024-04-01T02:13:06.789872+0000","last_undegraded":"2024-04-01T02:13:06.789872+0000","last_fullsized":"2024-04-01T02:13:06.789872+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'705","last_scrub_stamp":"2024-04-01T02:13:06.789692+0000","last_deep_scrub":"23'705","last_deep_scrub_stamp":"2024-04-01T02:13:06.789692+0000","last_clean_scrub_stamp":"2024-04-01T02:13:06.789692+0000","objects_scrubbed":11,"log_size":705,"log_dups_size":0,"ondisk_log_size":705,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:59:40.095890+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1869911,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":559,"num_write_kb":109429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":34,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:50.202973+0000","last_change":"2024-04-01T02:12:50.203026+0000","last_active":"2024-04-01T02:12:50.202973+0000","last_peered":"2024-04-01T02:12:50.202973+0000","last_clean":"2024-04-01T02:12:50.202973+0000","last_became_active":"2024-04-01T01:55:48.210616+0000","last_became_peered":"2024-04-01T01:55:48.210616+0000","last_unstale":"2024-04-01T02:12:50.202973+0000","last_undegraded":"2024-04-01T02:12:50.202973+0000","last_fullsized":"2024-04-01T02:12:50.202973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T02:12:50.202776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T02:12:50.202776+0000","last_clean_scrub_stamp":"2024-04-01T02:12:50.202776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:12:40.918668+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"23'519","reported_seq":551,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:50.933021+0000","last_change":"2024-04-01T02:12:50.933055+0000","last_active":"2024-04-01T02:12:50.933021+0000","last_peered":"2024-04-01T02:12:50.933021+0000","last_clean":"2024-04-01T02:12:50.933021+0000","last_became_active":"2024-04-01T01:55:49.238805+0000","last_became_peered":"2024-04-01T01:55:49.238805+0000","last_unstale":"2024-04-01T02:12:50.933021+0000","last_undegraded":"2024-04-01T02:12:50.933021+0000","last_fullsized":"2024-04-01T02:12:50.933021+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'519","last_scrub_stamp":"2024-04-01T02:12:50.932942+0000","last_deep_scrub":"23'519","last_deep_scrub_stamp":"2024-04-01T02:12:50.932942+0000","last_clean_scrub_stamp":"2024-04-01T02:12:50.932942+0000","objects_scrubbed":8,"log_size":519,"log_dups_size":0,"ondisk_log_size":519,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:57:44.456475+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1821215,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":368,"num_write_kb":8386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"23'822","reported_seq":856,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:52.506276+0000","last_change":"2024-04-01T02:12:52.506342+0000","last_active":"2024-04-01T02:12:52.506276+0000","last_peered":"2024-04-01T02:12:52.506276+0000","last_clean":"2024-04-01T02:12:52.506276+0000","last_became_active":"2024-04-01T01:55:48.210893+0000","last_became_peered":"2024-04-01T01:55:48.210893+0000","last_unstale":"2024-04-01T02:12:52.506276+0000","last_undegraded":"2024-04-01T02:12:52.506276+0000","last_fullsized":"2024-04-01T02:12:52.506276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'822","last_scrub_stamp":"2024-04-01T02:12:52.506140+0000","last_deep_scrub":"23'822","last_deep_scrub_stamp":"2024-04-01T02:12:52.506140+0000","last_clean_scrub_stamp":"2024-04-01T02:12:52.506140+0000","objects_scrubbed":6,"log_size":822,"log_dups_size":0,"ondisk_log_size":822,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:48:46.795985+0000","scrub_duration":59,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":818,"num_write_kb":8585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"23'615","reported_seq":647,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:52.646996+0000","last_change":"2024-04-01T02:12:52.647079+0000","last_active":"2024-04-01T02:12:52.646996+0000","last_peered":"2024-04-01T02:12:52.646996+0000","last_clean":"2024-04-01T02:12:52.646996+0000","last_became_active":"2024-04-01T01:55:49.261517+0000","last_became_peered":"2024-04-01T01:55:49.261517+0000","last_unstale":"2024-04-01T02:12:52.646996+0000","last_undegraded":"2024-04-01T02:12:52.646996+0000","last_fullsized":"2024-04-01T02:12:52.646996+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'615","last_scrub_stamp":"2024-04-01T02:12:52.646822+0000","last_deep_scrub":"23'615","last_deep_scrub_stamp":"2024-04-01T02:12:52.646822+0000","last_clean_scrub_stamp":"2024-04-01T02:12:52.646822+0000","objects_scrubbed":11,"log_size":615,"log_dups_size":0,"ondisk_log_size":615,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:42:59.363957+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5805184,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":464,"num_write_kb":32813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"23'424","reported_seq":458,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:48.292847+0000","last_change":"2024-04-01T02:12:48.292898+0000","last_active":"2024-04-01T02:12:48.292847+0000","last_peered":"2024-04-01T02:12:48.292847+0000","last_clean":"2024-04-01T02:12:48.292847+0000","last_became_active":"2024-04-01T01:55:48.198319+0000","last_became_peered":"2024-04-01T01:55:48.198319+0000","last_unstale":"2024-04-01T02:12:48.292847+0000","last_undegraded":"2024-04-01T02:12:48.292847+0000","last_fullsized":"2024-04-01T02:12:48.292847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'424","last_scrub_stamp":"2024-04-01T02:12:48.292738+0000","last_deep_scrub":"23'424","last_deep_scrub_stamp":"2024-04-01T02:12:48.292738+0000","last_clean_scrub_stamp":"2024-04-01T02:12:48.292738+0000","objects_scrubbed":2,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:02:35.747733+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":421,"num_write_kb":4293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"23'527","reported_seq":559,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:52.362312+0000","last_change":"2024-04-01T02:12:52.362466+0000","last_active":"2024-04-01T02:12:52.362312+0000","last_peered":"2024-04-01T02:12:52.362312+0000","last_clean":"2024-04-01T02:12:52.362312+0000","last_became_active":"2024-04-01T01:55:49.265670+0000","last_became_peered":"2024-04-01T01:55:49.265670+0000","last_unstale":"2024-04-01T02:12:52.362312+0000","last_undegraded":"2024-04-01T02:12:52.362312+0000","last_fullsized":"2024-04-01T02:12:52.362312+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'527","last_scrub_stamp":"2024-04-01T02:12:52.362098+0000","last_deep_scrub":"23'527","last_deep_scrub_stamp":"2024-04-01T02:12:52.362098+0000","last_clean_scrub_stamp":"2024-04-01T02:12:52.362098+0000","objects_scrubbed":13,"log_size":527,"log_dups_size":0,"ondisk_log_size":527,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:04:43.893980+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4958208,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":395,"num_write_kb":11184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"23'502","reported_seq":536,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:53.460616+0000","last_change":"2024-04-01T02:12:53.460647+0000","last_active":"2024-04-01T02:12:53.460616+0000","last_peered":"2024-04-01T02:12:53.460616+0000","last_clean":"2024-04-01T02:12:53.460616+0000","last_became_active":"2024-04-01T01:55:48.218562+0000","last_became_peered":"2024-04-01T01:55:48.218562+0000","last_unstale":"2024-04-01T02:12:53.460616+0000","last_undegraded":"2024-04-01T02:12:53.460616+0000","last_fullsized":"2024-04-01T02:12:53.460616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'502","last_scrub_stamp":"2024-04-01T02:12:53.460542+0000","last_deep_scrub":"23'502","last_deep_scrub_stamp":"2024-04-01T02:12:53.460542+0000","last_clean_scrub_stamp":"2024-04-01T02:12:53.460542+0000","objects_scrubbed":2,"log_size":502,"log_dups_size":0,"ondisk_log_size":502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:02:40.915537+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":500,"num_write_kb":4281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"23'496","reported_seq":528,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:13:01.210631+0000","last_change":"2024-04-01T02:13:01.210709+0000","last_active":"2024-04-01T02:13:01.210631+0000","last_peered":"2024-04-01T02:13:01.210631+0000","last_clean":"2024-04-01T02:13:01.210631+0000","last_became_active":"2024-04-01T01:55:49.267502+0000","last_became_peered":"2024-04-01T01:55:49.267502+0000","last_unstale":"2024-04-01T02:13:01.210631+0000","last_undegraded":"2024-04-01T02:13:01.210631+0000","last_fullsized":"2024-04-01T02:13:01.210631+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'496","last_scrub_stamp":"2024-04-01T02:13:01.210465+0000","last_deep_scrub":"23'496","last_deep_scrub_stamp":"2024-04-01T02:13:01.210465+0000","last_clean_scrub_stamp":"2024-04-01T02:13:01.210465+0000","objects_scrubbed":7,"log_size":496,"log_dups_size":0,"ondisk_log_size":496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:24:59.137641+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2609152,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":355,"num_write_kb":9167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"23'654","reported_seq":688,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:51.957278+0000","last_change":"2024-04-01T02:12:51.957405+0000","last_active":"2024-04-01T02:12:51.957278+0000","last_peered":"2024-04-01T02:12:51.957278+0000","last_clean":"2024-04-01T02:12:51.957278+0000","last_became_active":"2024-04-01T01:55:48.215852+0000","last_became_peered":"2024-04-01T01:55:48.215852+0000","last_unstale":"2024-04-01T02:12:51.957278+0000","last_undegraded":"2024-04-01T02:12:51.957278+0000","last_fullsized":"2024-04-01T02:12:51.957278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'654","last_scrub_stamp":"2024-04-01T02:12:51.957066+0000","last_deep_scrub":"23'654","last_deep_scrub_stamp":"2024-04-01T02:12:51.957066+0000","last_clean_scrub_stamp":"2024-04-01T02:12:51.957066+0000","objects_scrubbed":2,"log_size":654,"log_dups_size":0,"ondisk_log_size":654,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:07:45.968003+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":651,"num_write_kb":4358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"23'543","reported_seq":575,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:58.223071+0000","last_change":"2024-04-01T02:12:58.223217+0000","last_active":"2024-04-01T02:12:58.223071+0000","last_peered":"2024-04-01T02:12:58.223071+0000","last_clean":"2024-04-01T02:12:58.223071+0000","last_became_active":"2024-04-01T01:55:49.255781+0000","last_became_peered":"2024-04-01T01:55:49.255781+0000","last_unstale":"2024-04-01T02:12:58.223071+0000","last_undegraded":"2024-04-01T02:12:58.223071+0000","last_fullsized":"2024-04-01T02:12:58.223071+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'543","last_scrub_stamp":"2024-04-01T02:12:58.222869+0000","last_deep_scrub":"23'543","last_deep_scrub_stamp":"2024-04-01T02:12:58.222869+0000","last_clean_scrub_stamp":"2024-04-01T02:12:58.222869+0000","objects_scrubbed":12,"log_size":543,"log_dups_size":0,"ondisk_log_size":543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:36:47.435317+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3486100,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384,"num_write_kb":10452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"23'483","reported_seq":517,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:52.290471+0000","last_change":"2024-04-01T02:12:52.290542+0000","last_active":"2024-04-01T02:12:52.290471+0000","last_peered":"2024-04-01T02:12:52.290471+0000","last_clean":"2024-04-01T02:12:52.290471+0000","last_became_active":"2024-04-01T01:55:48.215898+0000","last_became_peered":"2024-04-01T01:55:48.215898+0000","last_unstale":"2024-04-01T02:12:52.290471+0000","last_undegraded":"2024-04-01T02:12:52.290471+0000","last_fullsized":"2024-04-01T02:12:52.290471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'483","last_scrub_stamp":"2024-04-01T02:12:52.290324+0000","last_deep_scrub":"23'483","last_deep_scrub_stamp":"2024-04-01T02:12:52.290324+0000","last_clean_scrub_stamp":"2024-04-01T02:12:52.290324+0000","objects_scrubbed":1,"log_size":483,"log_dups_size":0,"ondisk_log_size":483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:04:43.822206+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":481,"num_write_kb":4326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"23'556","reported_seq":588,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:13:07.763836+0000","last_change":"2024-04-01T02:13:07.763935+0000","last_active":"2024-04-01T02:13:07.763836+0000","last_peered":"2024-04-01T02:13:07.763836+0000","last_clean":"2024-04-01T02:13:07.763836+0000","last_became_active":"2024-04-01T01:55:49.274600+0000","last_became_peered":"2024-04-01T01:55:49.274600+0000","last_unstale":"2024-04-01T02:13:07.763836+0000","last_undegraded":"2024-04-01T02:13:07.763836+0000","last_fullsized":"2024-04-01T02:13:07.763836+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'556","last_scrub_stamp":"2024-04-01T02:13:07.763649+0000","last_deep_scrub":"23'556","last_deep_scrub_stamp":"2024-04-01T02:13:07.763649+0000","last_clean_scrub_stamp":"2024-04-01T02:13:07.763649+0000","objects_scrubbed":13,"log_size":556,"log_dups_size":0,"ondisk_log_size":556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:02:29.383992+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3740270,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":421,"num_write_kb":13583,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"23'119","reported_seq":193,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:48.921533+0000","last_change":"2024-04-01T02:12:48.921568+0000","last_active":"2024-04-01T02:12:48.921533+0000","last_peered":"2024-04-01T02:12:48.921533+0000","last_clean":"2024-04-01T02:12:48.921533+0000","last_became_active":"2024-04-01T01:55:43.144882+0000","last_became_peered":"2024-04-01T01:55:43.144882+0000","last_unstale":"2024-04-01T02:12:48.921533+0000","last_undegraded":"2024-04-01T02:12:48.921533+0000","last_fullsized":"2024-04-01T02:12:48.921533+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'119","last_scrub_stamp":"2024-04-01T02:12:48.921455+0000","last_deep_scrub":"23'119","last_deep_scrub_stamp":"2024-04-01T02:12:48.921455+0000","last_clean_scrub_stamp":"2024-04-01T02:12:48.921455+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:13:18.583922+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"23'540","reported_seq":575,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:54.701297+0000","last_change":"2024-04-01T02:12:54.701365+0000","last_active":"2024-04-01T02:12:54.701297+0000","last_peered":"2024-04-01T02:12:54.701297+0000","last_clean":"2024-04-01T02:12:54.701297+0000","last_became_active":"2024-04-01T01:55:48.206293+0000","last_became_peered":"2024-04-01T01:55:48.206293+0000","last_unstale":"2024-04-01T02:12:54.701297+0000","last_undegraded":"2024-04-01T02:12:54.701297+0000","last_fullsized":"2024-04-01T02:12:54.701297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'540","last_scrub_stamp":"2024-04-01T02:12:54.701088+0000","last_deep_scrub":"23'540","last_deep_scrub_stamp":"2024-04-01T02:12:54.701088+0000","last_clean_scrub_stamp":"2024-04-01T02:12:54.701088+0000","objects_scrubbed":1,"log_size":540,"log_dups_size":0,"ondisk_log_size":540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T13:39:58.971329+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":538,"num_write_kb":4366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"23'483","reported_seq":516,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:13:01.338499+0000","last_change":"2024-04-01T02:13:01.338607+0000","last_active":"2024-04-01T02:13:01.338499+0000","last_peered":"2024-04-01T02:13:01.338499+0000","last_clean":"2024-04-01T02:13:01.338499+0000","last_became_active":"2024-04-01T01:55:49.273197+0000","last_became_peered":"2024-04-01T01:55:49.273197+0000","last_unstale":"2024-04-01T02:13:01.338499+0000","last_undegraded":"2024-04-01T02:13:01.338499+0000","last_fullsized":"2024-04-01T02:13:01.338499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'483","last_scrub_stamp":"2024-04-01T02:13:01.338312+0000","last_deep_scrub":"23'483","last_deep_scrub_stamp":"2024-04-01T02:13:01.338312+0000","last_clean_scrub_stamp":"2024-04-01T02:13:01.338312+0000","objects_scrubbed":9,"log_size":483,"log_dups_size":0,"ondisk_log_size":483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T13:40:05.608553+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2100352,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":362,"num_write_kb":7512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"23'1727","reported_seq":1762,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:57.758281+0000","last_change":"2024-04-01T02:12:57.758352+0000","last_active":"2024-04-01T02:12:57.758281+0000","last_peered":"2024-04-01T02:12:57.758281+0000","last_clean":"2024-04-01T02:12:57.758281+0000","last_became_active":"2024-04-01T01:55:48.213914+0000","last_became_peered":"2024-04-01T01:55:48.213914+0000","last_unstale":"2024-04-01T02:12:57.758281+0000","last_undegraded":"2024-04-01T02:12:57.758281+0000","last_fullsized":"2024-04-01T02:12:57.758281+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1727","last_scrub_stamp":"2024-04-01T02:12:57.758101+0000","last_deep_scrub":"23'1727","last_deep_scrub_stamp":"2024-04-01T02:12:57.758101+0000","last_clean_scrub_stamp":"2024-04-01T02:12:57.758101+0000","objects_scrubbed":3,"log_size":1727,"log_dups_size":0,"ondisk_log_size":1727,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:36:46.970549+0000","scrub_duration":79,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1721,"num_write_kb":12994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"23'532","reported_seq":565,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:13:00.349200+0000","last_change":"2024-04-01T02:13:00.349287+0000","last_active":"2024-04-01T02:13:00.349200+0000","last_peered":"2024-04-01T02:13:00.349200+0000","last_clean":"2024-04-01T02:13:00.349200+0000","last_became_active":"2024-04-01T01:55:49.271821+0000","last_became_peered":"2024-04-01T01:55:49.271821+0000","last_unstale":"2024-04-01T02:13:00.349200+0000","last_undegraded":"2024-04-01T02:13:00.349200+0000","last_fullsized":"2024-04-01T02:13:00.349200+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'532","last_scrub_stamp":"2024-04-01T02:13:00.349025+0000","last_deep_scrub":"23'532","last_deep_scrub_stamp":"2024-04-01T02:13:00.349025+0000","last_clean_scrub_stamp":"2024-04-01T02:13:00.349025+0000","objects_scrubbed":12,"log_size":532,"log_dups_size":0,"ondisk_log_size":532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:30:19.146214+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2398580,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":392,"num_write_kb":9213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"23'1760","reported_seq":3554,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:52.420558+0000","last_change":"2024-04-01T02:12:52.420629+0000","last_active":"2024-04-01T02:12:52.420558+0000","last_peered":"2024-04-01T02:12:52.420558+0000","last_clean":"2024-04-01T02:12:52.420558+0000","last_became_active":"2024-04-01T01:55:48.217516+0000","last_became_peered":"2024-04-01T01:55:48.217516+0000","last_unstale":"2024-04-01T02:12:52.420558+0000","last_undegraded":"2024-04-01T02:12:52.420558+0000","last_fullsized":"2024-04-01T02:12:52.420558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1760","last_scrub_stamp":"2024-04-01T02:12:52.420382+0000","last_deep_scrub":"23'1760","last_deep_scrub_stamp":"2024-04-01T02:12:52.420382+0000","last_clean_scrub_stamp":"2024-04-01T02:12:52.420382+0000","objects_scrubbed":1,"log_size":1760,"log_dups_size":0,"ondisk_log_size":1760,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:31:48.836121+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1520757,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1759,"num_read_kb":2743,"num_write":1759,"num_write_kb":2743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"23'587","reported_seq":620,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:58.859714+0000","last_change":"2024-04-01T02:12:58.859795+0000","last_active":"2024-04-01T02:12:58.859714+0000","last_peered":"2024-04-01T02:12:58.859714+0000","last_clean":"2024-04-01T02:12:58.859714+0000","last_became_active":"2024-04-01T01:55:49.246152+0000","last_became_peered":"2024-04-01T01:55:49.246152+0000","last_unstale":"2024-04-01T02:12:58.859714+0000","last_undegraded":"2024-04-01T02:12:58.859714+0000","last_fullsized":"2024-04-01T02:12:58.859714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'587","last_scrub_stamp":"2024-04-01T02:12:58.859539+0000","last_deep_scrub":"23'587","last_deep_scrub_stamp":"2024-04-01T02:12:58.859539+0000","last_clean_scrub_stamp":"2024-04-01T02:12:58.859539+0000","objects_scrubbed":12,"log_size":587,"log_dups_size":0,"ondisk_log_size":587,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:27:36.969086+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4683946,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":447,"num_write_kb":12840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"23'1296","reported_seq":1331,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:13:01.702366+0000","last_change":"2024-04-01T02:13:01.702436+0000","last_active":"2024-04-01T02:13:01.702366+0000","last_peered":"2024-04-01T02:13:01.702366+0000","last_clean":"2024-04-01T02:13:01.702366+0000","last_became_active":"2024-04-01T01:55:48.222414+0000","last_became_peered":"2024-04-01T01:55:48.222414+0000","last_unstale":"2024-04-01T02:13:01.702366+0000","last_undegraded":"2024-04-01T02:13:01.702366+0000","last_fullsized":"2024-04-01T02:13:01.702366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1296","last_scrub_stamp":"2024-04-01T02:13:01.702176+0000","last_deep_scrub":"23'1296","last_deep_scrub_stamp":"2024-04-01T02:13:01.702176+0000","last_clean_scrub_stamp":"2024-04-01T02:13:01.702176+0000","objects_scrubbed":2,"log_size":1296,"log_dups_size":0,"ondisk_log_size":1296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:03:40.540519+0000","scrub_duration":59,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1292,"num_write_kb":8711,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"23'515","reported_seq":548,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:56.180611+0000","last_change":"2024-04-01T02:12:56.180748+0000","last_active":"2024-04-01T02:12:56.180611+0000","last_peered":"2024-04-01T02:12:56.180611+0000","last_clean":"2024-04-01T02:12:56.180611+0000","last_became_active":"2024-04-01T01:55:49.247285+0000","last_became_peered":"2024-04-01T01:55:49.247285+0000","last_unstale":"2024-04-01T02:12:56.180611+0000","last_undegraded":"2024-04-01T02:12:56.180611+0000","last_fullsized":"2024-04-01T02:12:56.180611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'515","last_scrub_stamp":"2024-04-01T02:12:56.180390+0000","last_deep_scrub":"23'515","last_deep_scrub_stamp":"2024-04-01T02:12:56.180390+0000","last_clean_scrub_stamp":"2024-04-01T02:12:56.180390+0000","objects_scrubbed":8,"log_size":515,"log_dups_size":0,"ondisk_log_size":515,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T13:01:35.714931+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1905973,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":374,"num_write_kb":9925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"23'412","reported_seq":447,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:53.911067+0000","last_change":"2024-04-01T02:12:53.911111+0000","last_active":"2024-04-01T02:12:53.911067+0000","last_peered":"2024-04-01T02:12:53.911067+0000","last_clean":"2024-04-01T02:12:53.911067+0000","last_became_active":"2024-04-01T01:55:48.225487+0000","last_became_peered":"2024-04-01T01:55:48.225487+0000","last_unstale":"2024-04-01T02:12:53.911067+0000","last_undegraded":"2024-04-01T02:12:53.911067+0000","last_fullsized":"2024-04-01T02:12:53.911067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'412","last_scrub_stamp":"2024-04-01T02:12:53.910989+0000","last_deep_scrub":"23'412","last_deep_scrub_stamp":"2024-04-01T02:12:53.910989+0000","last_clean_scrub_stamp":"2024-04-01T02:12:53.910989+0000","objects_scrubbed":1,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:28:25.775332+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":410,"num_write_kb":4283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"23'568","reported_seq":601,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:51.364949+0000","last_change":"2024-04-01T02:12:51.364997+0000","last_active":"2024-04-01T02:12:51.364949+0000","last_peered":"2024-04-01T02:12:51.364949+0000","last_clean":"2024-04-01T02:12:51.364949+0000","last_became_active":"2024-04-01T01:55:49.264914+0000","last_became_peered":"2024-04-01T01:55:49.264914+0000","last_unstale":"2024-04-01T02:12:51.364949+0000","last_undegraded":"2024-04-01T02:12:51.364949+0000","last_fullsized":"2024-04-01T02:12:51.364949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'568","last_scrub_stamp":"2024-04-01T02:12:51.364864+0000","last_deep_scrub":"23'568","last_deep_scrub_stamp":"2024-04-01T02:12:51.364864+0000","last_clean_scrub_stamp":"2024-04-01T02:12:51.364864+0000","objects_scrubbed":12,"log_size":568,"log_dups_size":0,"ondisk_log_size":568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:19:19.092817+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3471816,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":416,"num_write_kb":10624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"23'811","reported_seq":846,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:53.680626+0000","last_change":"2024-04-01T02:12:53.680705+0000","last_active":"2024-04-01T02:12:53.680626+0000","last_peered":"2024-04-01T02:12:53.680626+0000","last_clean":"2024-04-01T02:12:53.680626+0000","last_became_active":"2024-04-01T01:55:48.226948+0000","last_became_peered":"2024-04-01T01:55:48.226948+0000","last_unstale":"2024-04-01T02:12:53.680626+0000","last_undegraded":"2024-04-01T02:12:53.680626+0000","last_fullsized":"2024-04-01T02:12:53.680626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'811","last_scrub_stamp":"2024-04-01T02:12:53.680443+0000","last_deep_scrub":"23'811","last_deep_scrub_stamp":"2024-04-01T02:12:53.680443+0000","last_clean_scrub_stamp":"2024-04-01T02:12:53.680443+0000","objects_scrubbed":2,"log_size":811,"log_dups_size":0,"ondisk_log_size":811,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:07:35.526494+0000","scrub_duration":63,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":807,"num_write_kb":8573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"23'586","reported_seq":619,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:54.302864+0000","last_change":"2024-04-01T02:12:54.302926+0000","last_active":"2024-04-01T02:12:54.302864+0000","last_peered":"2024-04-01T02:12:54.302864+0000","last_clean":"2024-04-01T02:12:54.302864+0000","last_became_active":"2024-04-01T01:55:49.241632+0000","last_became_peered":"2024-04-01T01:55:49.241632+0000","last_unstale":"2024-04-01T02:12:54.302864+0000","last_undegraded":"2024-04-01T02:12:54.302864+0000","last_fullsized":"2024-04-01T02:12:54.302864+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'586","last_scrub_stamp":"2024-04-01T02:12:54.302738+0000","last_deep_scrub":"23'586","last_deep_scrub_stamp":"2024-04-01T02:12:54.302738+0000","last_clean_scrub_stamp":"2024-04-01T02:12:54.302738+0000","objects_scrubbed":8,"log_size":586,"log_dups_size":0,"ondisk_log_size":586,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:50:42.742758+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1649698,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":453,"num_write_kb":12096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"23'923","reported_seq":958,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:50.504306+0000","last_change":"2024-04-01T02:12:50.504306+0000","last_active":"2024-04-01T02:12:50.504306+0000","last_peered":"2024-04-01T02:12:50.504306+0000","last_clean":"2024-04-01T02:12:50.504306+0000","last_became_active":"2024-04-01T01:55:48.203576+0000","last_became_peered":"2024-04-01T01:55:48.203576+0000","last_unstale":"2024-04-01T02:12:50.504306+0000","last_undegraded":"2024-04-01T02:12:50.504306+0000","last_fullsized":"2024-04-01T02:12:50.504306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'923","last_scrub_stamp":"2024-04-01T02:12:50.503868+0000","last_deep_scrub":"23'923","last_deep_scrub_stamp":"2024-04-01T02:12:50.503868+0000","last_clean_scrub_stamp":"2024-04-01T02:12:50.503868+0000","objects_scrubbed":1,"log_size":923,"log_dups_size":0,"ondisk_log_size":923,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:04:42.035750+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2724,"num_write_kb":1428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"23'524","reported_seq":556,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:57.394684+0000","last_change":"2024-04-01T02:12:57.394753+0000","last_active":"2024-04-01T02:12:57.394684+0000","last_peered":"2024-04-01T02:12:57.394684+0000","last_clean":"2024-04-01T02:12:57.394684+0000","last_became_active":"2024-04-01T01:55:49.244632+0000","last_became_peered":"2024-04-01T01:55:49.244632+0000","last_unstale":"2024-04-01T02:12:57.394684+0000","last_undegraded":"2024-04-01T02:12:57.394684+0000","last_fullsized":"2024-04-01T02:12:57.394684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'524","last_scrub_stamp":"2024-04-01T02:12:57.394554+0000","last_deep_scrub":"23'524","last_deep_scrub_stamp":"2024-04-01T02:12:57.394554+0000","last_clean_scrub_stamp":"2024-04-01T02:12:57.394554+0000","objects_scrubbed":12,"log_size":524,"log_dups_size":0,"ondisk_log_size":524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:56:47.093266+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2231074,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":416,"num_write_kb":11781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"23'453","reported_seq":488,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:58.735951+0000","last_change":"2024-04-01T02:12:58.735951+0000","last_active":"2024-04-01T02:12:58.735951+0000","last_peered":"2024-04-01T02:12:58.735951+0000","last_clean":"2024-04-01T02:12:58.735951+0000","last_became_active":"2024-04-01T01:55:48.220889+0000","last_became_peered":"2024-04-01T01:55:48.220889+0000","last_unstale":"2024-04-01T02:12:58.735951+0000","last_undegraded":"2024-04-01T02:12:58.735951+0000","last_fullsized":"2024-04-01T02:12:58.735951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'453","last_scrub_stamp":"2024-04-01T02:12:58.735529+0000","last_deep_scrub":"23'453","last_deep_scrub_stamp":"2024-04-01T02:12:58.735529+0000","last_clean_scrub_stamp":"2024-04-01T02:12:58.735529+0000","objects_scrubbed":2,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:16:25.878981+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":451,"num_write_kb":4303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"23'580","reported_seq":612,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:13:00.297734+0000","last_change":"2024-04-01T02:13:00.297813+0000","last_active":"2024-04-01T02:13:00.297734+0000","last_peered":"2024-04-01T02:13:00.297734+0000","last_clean":"2024-04-01T02:13:00.297734+0000","last_became_active":"2024-04-01T01:55:49.251641+0000","last_became_peered":"2024-04-01T01:55:49.251641+0000","last_unstale":"2024-04-01T02:13:00.297734+0000","last_undegraded":"2024-04-01T02:13:00.297734+0000","last_fullsized":"2024-04-01T02:13:00.297734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'580","last_scrub_stamp":"2024-04-01T02:13:00.297565+0000","last_deep_scrub":"23'580","last_deep_scrub_stamp":"2024-04-01T02:13:00.297565+0000","last_clean_scrub_stamp":"2024-04-01T02:13:00.297565+0000","objects_scrubbed":6,"log_size":580,"log_dups_size":0,"ondisk_log_size":580,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:07:42.143616+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1372160,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":436,"num_write_kb":14438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"23'657","reported_seq":692,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:49.249951+0000","last_change":"2024-04-01T02:12:49.249951+0000","last_active":"2024-04-01T02:12:49.249951+0000","last_peered":"2024-04-01T02:12:49.249951+0000","last_clean":"2024-04-01T02:12:49.249951+0000","last_became_active":"2024-04-01T01:55:48.203828+0000","last_became_peered":"2024-04-01T01:55:48.203828+0000","last_unstale":"2024-04-01T02:12:49.249951+0000","last_undegraded":"2024-04-01T02:12:49.249951+0000","last_fullsized":"2024-04-01T02:12:49.249951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'657","last_scrub_stamp":"2024-04-01T02:12:49.249724+0000","last_deep_scrub":"23'657","last_deep_scrub_stamp":"2024-04-01T02:12:49.249724+0000","last_clean_scrub_stamp":"2024-04-01T02:12:49.249724+0000","objects_scrubbed":1,"log_size":657,"log_dups_size":0,"ondisk_log_size":657,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:19:32.566830+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":655,"num_write_kb":4360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"23'542","reported_seq":574,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:51.612149+0000","last_change":"2024-04-01T02:12:51.612177+0000","last_active":"2024-04-01T02:12:51.612149+0000","last_peered":"2024-04-01T02:12:51.612149+0000","last_clean":"2024-04-01T02:12:51.612149+0000","last_became_active":"2024-04-01T01:55:49.259332+0000","last_became_peered":"2024-04-01T01:55:49.259332+0000","last_unstale":"2024-04-01T02:12:51.612149+0000","last_undegraded":"2024-04-01T02:12:51.612149+0000","last_fullsized":"2024-04-01T02:12:51.612149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'542","last_scrub_stamp":"2024-04-01T02:12:51.612090+0000","last_deep_scrub":"23'542","last_deep_scrub_stamp":"2024-04-01T02:12:51.612090+0000","last_clean_scrub_stamp":"2024-04-01T02:12:51.612090+0000","objects_scrubbed":8,"log_size":542,"log_dups_size":0,"ondisk_log_size":542,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:30:10.409279+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2628206,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":12728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"23'522","reported_seq":557,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:51.522928+0000","last_change":"2024-04-01T02:12:51.522928+0000","last_active":"2024-04-01T02:12:51.522928+0000","last_peered":"2024-04-01T02:12:51.522928+0000","last_clean":"2024-04-01T02:12:51.522928+0000","last_became_active":"2024-04-01T01:55:48.206027+0000","last_became_peered":"2024-04-01T01:55:48.206027+0000","last_unstale":"2024-04-01T02:12:51.522928+0000","last_undegraded":"2024-04-01T02:12:51.522928+0000","last_fullsized":"2024-04-01T02:12:51.522928+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'522","last_scrub_stamp":"2024-04-01T02:12:51.522525+0000","last_deep_scrub":"23'522","last_deep_scrub_stamp":"2024-04-01T02:12:51.522525+0000","last_clean_scrub_stamp":"2024-04-01T02:12:51.522525+0000","objects_scrubbed":1,"log_size":522,"log_dups_size":0,"ondisk_log_size":522,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:25:33.215345+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":520,"num_write_kb":4323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"23'500","reported_seq":532,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:58.363713+0000","last_change":"2024-04-01T02:12:58.363788+0000","last_active":"2024-04-01T02:12:58.363713+0000","last_peered":"2024-04-01T02:12:58.363713+0000","last_clean":"2024-04-01T02:12:58.363713+0000","last_became_active":"2024-04-01T01:55:49.245774+0000","last_became_peered":"2024-04-01T01:55:49.245774+0000","last_unstale":"2024-04-01T02:12:58.363713+0000","last_undegraded":"2024-04-01T02:12:58.363713+0000","last_fullsized":"2024-04-01T02:12:58.363713+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'500","last_scrub_stamp":"2024-04-01T02:12:58.363552+0000","last_deep_scrub":"23'500","last_deep_scrub_stamp":"2024-04-01T02:12:58.363552+0000","last_clean_scrub_stamp":"2024-04-01T02:12:58.363552+0000","objects_scrubbed":10,"log_size":500,"log_dups_size":0,"ondisk_log_size":500,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:28:49.320418+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2457258,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":347,"num_write_kb":7703,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"23'733","reported_seq":767,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:53.354430+0000","last_change":"2024-04-01T02:12:53.354490+0000","last_active":"2024-04-01T02:12:53.354430+0000","last_peered":"2024-04-01T02:12:53.354430+0000","last_clean":"2024-04-01T02:12:53.354430+0000","last_became_active":"2024-04-01T01:55:48.221148+0000","last_became_peered":"2024-04-01T01:55:48.221148+0000","last_unstale":"2024-04-01T02:12:53.354430+0000","last_undegraded":"2024-04-01T02:12:53.354430+0000","last_fullsized":"2024-04-01T02:12:53.354430+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'733","last_scrub_stamp":"2024-04-01T02:12:53.354291+0000","last_deep_scrub":"23'733","last_deep_scrub_stamp":"2024-04-01T02:12:53.354291+0000","last_clean_scrub_stamp":"2024-04-01T02:12:53.354291+0000","objects_scrubbed":2,"log_size":733,"log_dups_size":0,"ondisk_log_size":733,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:25:35.047111+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":729,"num_write_kb":8526,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"23'580","reported_seq":612,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:54.471168+0000","last_change":"2024-04-01T02:12:54.471204+0000","last_active":"2024-04-01T02:12:54.471168+0000","last_peered":"2024-04-01T02:12:54.471168+0000","last_clean":"2024-04-01T02:12:54.471168+0000","last_became_active":"2024-04-01T01:55:49.248925+0000","last_became_peered":"2024-04-01T01:55:49.248925+0000","last_unstale":"2024-04-01T02:12:54.471168+0000","last_undegraded":"2024-04-01T02:12:54.471168+0000","last_fullsized":"2024-04-01T02:12:54.471168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'580","last_scrub_stamp":"2024-04-01T02:12:54.471099+0000","last_deep_scrub":"23'580","last_deep_scrub_stamp":"2024-04-01T02:12:54.471099+0000","last_clean_scrub_stamp":"2024-04-01T02:12:54.471099+0000","objects_scrubbed":9,"log_size":580,"log_dups_size":0,"ondisk_log_size":580,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:39:03.226786+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4491912,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":426,"num_write_kb":28953,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"23'1473","reported_seq":1507,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:55.793973+0000","last_change":"2024-04-01T02:12:55.794098+0000","last_active":"2024-04-01T02:12:55.793973+0000","last_peered":"2024-04-01T02:12:55.793973+0000","last_clean":"2024-04-01T02:12:55.793973+0000","last_became_active":"2024-04-01T01:55:48.206856+0000","last_became_peered":"2024-04-01T01:55:48.206856+0000","last_unstale":"2024-04-01T02:12:55.793973+0000","last_undegraded":"2024-04-01T02:12:55.793973+0000","last_fullsized":"2024-04-01T02:12:55.793973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1473","last_scrub_stamp":"2024-04-01T02:12:55.793793+0000","last_deep_scrub":"23'1473","last_deep_scrub_stamp":"2024-04-01T02:12:55.793793+0000","last_clean_scrub_stamp":"2024-04-01T02:12:55.793793+0000","objects_scrubbed":4,"log_size":1473,"log_dups_size":0,"ondisk_log_size":1473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T13:01:35.328335+0000","scrub_duration":87,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1465,"num_write_kb":12919,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"23'568","reported_seq":600,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:13:05.762080+0000","last_change":"2024-04-01T02:13:05.762228+0000","last_active":"2024-04-01T02:13:05.762080+0000","last_peered":"2024-04-01T02:13:05.762080+0000","last_clean":"2024-04-01T02:13:05.762080+0000","last_became_active":"2024-04-01T01:55:49.270254+0000","last_became_peered":"2024-04-01T01:55:49.270254+0000","last_unstale":"2024-04-01T02:13:05.762080+0000","last_undegraded":"2024-04-01T02:13:05.762080+0000","last_fullsized":"2024-04-01T02:13:05.762080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'568","last_scrub_stamp":"2024-04-01T02:13:05.761852+0000","last_deep_scrub":"23'568","last_deep_scrub_stamp":"2024-04-01T02:13:05.761852+0000","last_clean_scrub_stamp":"2024-04-01T02:13:05.761852+0000","objects_scrubbed":9,"log_size":568,"log_dups_size":0,"ondisk_log_size":568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:16:20.516938+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5269504,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":425,"num_write_kb":26844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"23'507","reported_seq":530,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:38.733918+0000","last_change":"2024-04-01T01:55:49.275782+0000","last_active":"2024-04-01T02:12:38.733918+0000","last_peered":"2024-04-01T02:12:38.733918+0000","last_clean":"2024-04-01T02:12:38.733918+0000","last_became_active":"2024-04-01T01:55:49.275050+0000","last_became_peered":"2024-04-01T01:55:49.275050+0000","last_unstale":"2024-04-01T02:12:38.733918+0000","last_undegraded":"2024-04-01T02:12:38.733918+0000","last_fullsized":"2024-04-01T02:12:38.733918+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T01:55:48.172901+0000","last_clean_scrub_stamp":"2024-04-01T01:55:48.172901+0000","objects_scrubbed":0,"log_size":507,"log_dups_size":0,"ondisk_log_size":507,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1932316,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":383,"num_write_kb":9512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"23'406","reported_seq":439,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:53.166248+0000","last_change":"2024-04-01T02:12:53.166388+0000","last_active":"2024-04-01T02:12:53.166248+0000","last_peered":"2024-04-01T02:12:53.166248+0000","last_clean":"2024-04-01T02:12:53.166248+0000","last_became_active":"2024-04-01T01:55:48.223220+0000","last_became_peered":"2024-04-01T01:55:48.223220+0000","last_unstale":"2024-04-01T02:12:53.166248+0000","last_undegraded":"2024-04-01T02:12:53.166248+0000","last_fullsized":"2024-04-01T02:12:53.166248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'406","last_scrub_stamp":"2024-04-01T02:12:53.166028+0000","last_deep_scrub":"23'406","last_deep_scrub_stamp":"2024-04-01T02:12:53.166028+0000","last_clean_scrub_stamp":"2024-04-01T02:12:53.166028+0000","objects_scrubbed":2,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:28:44.122893+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":404,"num_write_kb":4216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"23'484","reported_seq":515,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:55.014132+0000","last_change":"2024-04-01T02:12:55.014221+0000","last_active":"2024-04-01T02:12:55.014132+0000","last_peered":"2024-04-01T02:12:55.014132+0000","last_clean":"2024-04-01T02:12:55.014132+0000","last_became_active":"2024-04-01T01:55:49.258478+0000","last_became_peered":"2024-04-01T01:55:49.258478+0000","last_unstale":"2024-04-01T02:12:55.014132+0000","last_undegraded":"2024-04-01T02:12:55.014132+0000","last_fullsized":"2024-04-01T02:12:55.014132+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'484","last_scrub_stamp":"2024-04-01T02:12:55.013953+0000","last_deep_scrub":"23'484","last_deep_scrub_stamp":"2024-04-01T02:12:55.013953+0000","last_clean_scrub_stamp":"2024-04-01T02:12:55.013953+0000","objects_scrubbed":10,"log_size":484,"log_dups_size":0,"ondisk_log_size":484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:52:32.944978+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2118876,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":354,"num_write_kb":10865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"23'1766","reported_seq":1799,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:52.214793+0000","last_change":"2024-04-01T02:12:52.214872+0000","last_active":"2024-04-01T02:12:52.214793+0000","last_peered":"2024-04-01T02:12:52.214793+0000","last_clean":"2024-04-01T02:12:52.214793+0000","last_became_active":"2024-04-01T01:55:48.217755+0000","last_became_peered":"2024-04-01T01:55:48.217755+0000","last_unstale":"2024-04-01T02:12:52.214793+0000","last_undegraded":"2024-04-01T02:12:52.214793+0000","last_fullsized":"2024-04-01T02:12:52.214793+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1766","last_scrub_stamp":"2024-04-01T02:12:52.214626+0000","last_deep_scrub":"23'1766","last_deep_scrub_stamp":"2024-04-01T02:12:52.214626+0000","last_clean_scrub_stamp":"2024-04-01T02:12:52.214626+0000","objects_scrubbed":4,"log_size":1766,"log_dups_size":0,"ondisk_log_size":1766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:56:41.913339+0000","scrub_duration":87,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1758,"num_write_kb":13032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"23'616","reported_seq":649,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:55.879877+0000","last_change":"2024-04-01T02:12:55.879959+0000","last_active":"2024-04-01T02:12:55.879877+0000","last_peered":"2024-04-01T02:12:55.879877+0000","last_clean":"2024-04-01T02:12:55.879877+0000","last_became_active":"2024-04-01T01:55:49.242851+0000","last_became_peered":"2024-04-01T01:55:49.242851+0000","last_unstale":"2024-04-01T02:12:55.879877+0000","last_undegraded":"2024-04-01T02:12:55.879877+0000","last_fullsized":"2024-04-01T02:12:55.879877+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'616","last_scrub_stamp":"2024-04-01T02:12:55.879721+0000","last_deep_scrub":"23'616","last_deep_scrub_stamp":"2024-04-01T02:12:55.879721+0000","last_clean_scrub_stamp":"2024-04-01T02:12:55.879721+0000","objects_scrubbed":12,"log_size":616,"log_dups_size":0,"ondisk_log_size":616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:17:16.477687+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2501666,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":481,"num_write_kb":61542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"23'1143","reported_seq":1178,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:50.936804+0000","last_change":"2024-04-01T02:12:50.936836+0000","last_active":"2024-04-01T02:12:50.936804+0000","last_peered":"2024-04-01T02:12:50.936804+0000","last_clean":"2024-04-01T02:12:50.936804+0000","last_became_active":"2024-04-01T01:55:48.213122+0000","last_became_peered":"2024-04-01T01:55:48.213122+0000","last_unstale":"2024-04-01T02:12:50.936804+0000","last_undegraded":"2024-04-01T02:12:50.936804+0000","last_fullsized":"2024-04-01T02:12:50.936804+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1143","last_scrub_stamp":"2024-04-01T02:12:50.936731+0000","last_deep_scrub":"23'1143","last_deep_scrub_stamp":"2024-04-01T02:12:50.936731+0000","last_clean_scrub_stamp":"2024-04-01T02:12:50.936731+0000","objects_scrubbed":2,"log_size":1143,"log_dups_size":0,"ondisk_log_size":1143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:14:23.878647+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1140,"num_write_kb":8675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"23'572","reported_seq":605,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:13:03.844980+0000","last_change":"2024-04-01T02:13:03.845048+0000","last_active":"2024-04-01T02:13:03.844980+0000","last_peered":"2024-04-01T02:13:03.844980+0000","last_clean":"2024-04-01T02:13:03.844980+0000","last_became_active":"2024-04-01T01:55:49.251963+0000","last_became_peered":"2024-04-01T01:55:49.251963+0000","last_unstale":"2024-04-01T02:13:03.844980+0000","last_undegraded":"2024-04-01T02:13:03.844980+0000","last_fullsized":"2024-04-01T02:13:03.844980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'572","last_scrub_stamp":"2024-04-01T02:13:03.844810+0000","last_deep_scrub":"23'572","last_deep_scrub_stamp":"2024-04-01T02:13:03.844810+0000","last_clean_scrub_stamp":"2024-04-01T02:13:03.844810+0000","objects_scrubbed":5,"log_size":572,"log_dups_size":0,"ondisk_log_size":572,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:43:17.057627+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1665465,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":447,"num_write_kb":10082,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"23'998","reported_seq":1033,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:54.461524+0000","last_change":"2024-04-01T02:12:54.461653+0000","last_active":"2024-04-01T02:12:54.461524+0000","last_peered":"2024-04-01T02:12:54.461524+0000","last_clean":"2024-04-01T02:12:54.461524+0000","last_became_active":"2024-04-01T01:55:48.224494+0000","last_became_peered":"2024-04-01T01:55:48.224494+0000","last_unstale":"2024-04-01T02:12:54.461524+0000","last_undegraded":"2024-04-01T02:12:54.461524+0000","last_fullsized":"2024-04-01T02:12:54.461524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'998","last_scrub_stamp":"2024-04-01T02:12:54.461311+0000","last_deep_scrub":"23'998","last_deep_scrub_stamp":"2024-04-01T02:12:54.461311+0000","last_clean_scrub_stamp":"2024-04-01T02:12:54.461311+0000","objects_scrubbed":4,"log_size":998,"log_dups_size":0,"ondisk_log_size":998,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:19:37.778417+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389190,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":993,"num_write_kb":8588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":215832773,"num_objects":671,"num_object_clones":0,"num_object_copies":1342,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":671,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26120,"num_write_kb":1144114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":33914880,"data_stored":431659406,"data_compressed":20248526,"data_compressed_allocated":27738112,"data_compressed_original":427758424,"omap_allocated":0,"internal_metadata":0},"log_size":35161,"ondisk_log_size":35161,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":198627225,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":1759,"num_read_kb":2743,"num_write":29726,"num_write_kb":207983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":261431296,"data_stored":397254450,"data_compressed":36932112,"data_compressed_allocated":55713792,"data_compressed_original":191602688,"omap_allocated":0,"internal_metadata":0},"log_size":28033,"ondisk_log_size":28033,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66838,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509653,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":103636,"kb_used_data":23884,"kb_used_omap":1,"kb_used_meta":79742,"kb_avail":94268204,"statfs":{"total":96636764160,"available":96530640896,"internally_reserved":0,"allocated":24457216,"data_stored":69188313,"data_compressed":4487044,"data_compressed_allocated":6590464,"data_compressed_original":51672926,"omap_allocated":1590,"internal_metadata":81656266},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509654,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":119288,"kb_used_data":33968,"kb_used_omap":1,"kb_used_meta":85310,"kb_avail":94252552,"statfs":{"total":96636764160,"available":96514613248,"internally_reserved":0,"allocated":34783232,"data_stored":88936133,"data_compressed":7023647,"data_compressed_allocated":10317824,"data_compressed_original":64849434,"omap_allocated":1595,"internal_metadata":87357893},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509652,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":184340,"kb_used_data":62924,"kb_used_omap":1,"kb_used_meta":121406,"kb_avail":94187500,"statfs":{"total":96636764160,"available":96448000000,"internally_reserved":0,"allocated":64434176,"data_stored":165059531,"data_compressed":11682465,"data_compressed_allocated":17096704,"data_compressed_original":118219990,"omap_allocated":1592,"internal_metadata":124320200},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509653,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":93932,"kb_used_data":26660,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94277908,"statfs":{"total":96636764160,"available":96540577792,"internally_reserved":0,"allocated":27299840,"data_stored":94836675,"data_compressed":5914255,"data_compressed_allocated":8593408,"data_compressed_original":76574396,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509653,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":96400,"kb_used_data":29128,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94275440,"statfs":{"total":96636764160,"available":96538050560,"internally_reserved":0,"allocated":29827072,"data_stored":88082926,"data_compressed":5618475,"data_compressed_allocated":8155136,"data_compressed_original":66844186,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509652,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":166152,"kb_used_data":50304,"kb_used_omap":1,"kb_used_meta":115838,"kb_avail":94205688,"statfs":{"total":96636764160,"available":96466624512,"internally_reserved":0,"allocated":51511296,"data_stored":133601447,"data_compressed":9646909,"data_compressed_allocated":14168064,"data_compressed_original":96757598,"omap_allocated":1595,"internal_metadata":118618565},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542356,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":95764,"kb_used_data":24332,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94276076,"statfs":{"total":96636764160,"available":96538701824,"internally_reserved":0,"allocated":24915968,"data_stored":74736278,"data_compressed":5225453,"data_compressed_allocated":7524352,"data_compressed_original":57747294,"omap_allocated":1594,"internal_metadata":73136582},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575061,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":138384,"kb_used_data":39176,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":94233456,"statfs":{"total":96636764160,"available":96495058944,"internally_reserved":0,"allocated":40116224,"data_stored":116325977,"data_compressed":7649228,"data_compressed_allocated":11096064,"data_compressed_original":87842168,"omap_allocated":1595,"internal_metadata":101579205},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33419,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33419,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":46329856,"data_stored":71275934,"data_compressed":6727789,"data_compressed_allocated":10149888,"data_compressed_original":35106816,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":25587712,"data_stored":37748806,"data_compressed":3257537,"data_compressed_allocated":4939776,"data_compressed_original":17104896,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":22360064,"data_stored":33555104,"data_compressed":3040138,"data_compressed_allocated":4640768,"data_compressed_original":15843328,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":58339328,"data_stored":88053676,"data_compressed":8070060,"data_compressed_allocated":12161024,"data_compressed_original":41881600,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":31485952,"data_stored":50332992,"data_compressed":5217803,"data_compressed_allocated":7843840,"data_compressed_original":26705920,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":34701312,"data_stored":51852497,"data_compressed":4625369,"data_compressed_allocated":6967296,"data_compressed_original":24129536,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":21364736,"data_stored":33554432,"data_compressed":3299283,"data_compressed_allocated":4878336,"data_compressed_original":17068032,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":21262336,"data_stored":30881009,"data_compressed":2694133,"data_compressed_allocated":4132864,"data_compressed_original":13762560,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4947968,"data_stored":62241427,"data_compressed":2919120,"data_compressed_allocated":4018176,"data_compressed_original":61650782,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3940352,"data_stored":49659666,"data_compressed":2327519,"data_compressed_allocated":3170304,"data_compressed_original":49165850,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4706304,"data_stored":61197485,"data_compressed":2874117,"data_compressed_allocated":3952640,"data_compressed_original":60731068,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":5861376,"data_stored":76921769,"data_compressed":3612405,"data_compressed_allocated":4935680,"data_compressed_original":76338390,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":3063808,"data_stored":38519055,"data_compressed":1805844,"data_compressed_allocated":2473984,"data_compressed_original":38143514,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":5115904,"data_stored":63799026,"data_compressed":2990440,"data_compressed_allocated":4083712,"data_compressed_original":63139192,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":3317760,"data_stored":41097760,"data_compressed":1926170,"data_compressed_allocated":2646016,"data_compressed_original":40679262,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":2961408,"data_stored":38223218,"data_compressed":1792911,"data_compressed_allocated":2457600,"data_compressed_original":37910366,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-01T02:13:11.958 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-04-01T01:55:48.172901+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=1, tm_min=55, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=2, tm_min=12, tm_sec=46, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T02:13:11.959 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-01T01:55:48.172901+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=1, tm_min=55, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=2, tm_min=12, tm_sec=46, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T02:13:11.959 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-01T02:13:31.960 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-01T02:13:32.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.099+0000 7f20a9dde640 1 Processor -- start 2024-04-01T02:13:32.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.099+0000 7f20a9dde640 1 -- start start 2024-04-01T02:13:32.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.103+0000 7f20a9dde640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f20a4150e60 0x7f20a4072f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:13:32.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.103+0000 7f20a9dde640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f20a40c77c0 0x7f20a415a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:13:32.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.103+0000 7f20a9dde640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20a4073470 con 0x7f20a40c73a0 2024-04-01T02:13:32.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.103+0000 7f20a9dde640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f20a41578f0 con 0x7f20a4150e60 2024-04-01T02:13:32.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.103+0000 7f20a9dde640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f20a4156a20 con 0x7f20a40c77c0 2024-04-01T02:13:32.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.103+0000 7f20a37fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f20a4150e60 0x7f20a4072f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:13:32.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.103+0000 7f20a3fff640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f20a40c77c0 0x7f20a415a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:13:32.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.103+0000 7f20a2ffd640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f20a40c73a0 0x7f20a40c2900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.50:35408/0 (socket says 172.21.15.50:35408) 2024-04-01T02:13:32.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.103+0000 7f20a2ffd640 1 -- 172.21.15.50:0/2245133760 learned_addr learned my addr 172.21.15.50:0/2245133760 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-04-01T02:13:32.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.103+0000 7f20a37fe640 1 -- 172.21.15.50:0/2245133760 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f20a40c77c0 msgr2=0x7f20a415a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T02:13:32.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.103+0000 7f20a37fe640 1 --2- 172.21.15.50:0/2245133760 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f20a40c77c0 0x7f20a415a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:13:32.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.103+0000 7f20a37fe640 1 -- 172.21.15.50:0/2245133760 >> v1:172.21.15.97:6789/0 conn(0x7f20a40c73a0 legacy=0x7f20a40c2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:13:32.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.103+0000 7f20a37fe640 1 -- 172.21.15.50:0/2245133760 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20a4156ce0 con 0x7f20a4150e60 2024-04-01T02:13:32.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.107+0000 7f20a37fe640 1 --2- 172.21.15.50:0/2245133760 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f20a4150e60 0x7f20a4072f30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f20940097c0 tx=0x7f209401ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d1a89198dd3ec8c6 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:13:32.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.107+0000 7f20a27fc640 1 -- 172.21.15.50:0/2245133760 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20940b5070 con 0x7f20a4150e60 2024-04-01T02:13:32.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.107+0000 7f20a27fc640 1 -- 172.21.15.50:0/2245133760 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20940a8990 con 0x7f20a4150e60 2024-04-01T02:13:32.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.107+0000 7f20a27fc640 1 -- 172.21.15.50:0/2245133760 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20940a8d60 con 0x7f20a4150e60 2024-04-01T02:13:32.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.107+0000 7f20a9dde640 1 -- 172.21.15.50:0/2245133760 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f20a4150e60 msgr2=0x7f20a4072f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:13:32.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.107+0000 7f20a9dde640 1 --2- 172.21.15.50:0/2245133760 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f20a4150e60 0x7f20a4072f30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f20940097c0 tx=0x7f209401ec90 comp rx=0 tx=0).stop 2024-04-01T02:13:32.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.107+0000 7f20a9dde640 1 -- 172.21.15.50:0/2245133760 shutdown_connections 2024-04-01T02:13:32.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.107+0000 7f20a9dde640 1 --2- 172.21.15.50:0/2245133760 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f20a40c77c0 0x7f20a415a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:13:32.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.107+0000 7f20a9dde640 1 --2- 172.21.15.50:0/2245133760 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f20a4150e60 0x7f20a4072f30 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:13:32.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.107+0000 7f20a9dde640 1 -- 172.21.15.50:0/2245133760 >> 172.21.15.50:0/2245133760 conn(0x7f20a4067560 msgr2=0x7f20a406b220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T02:13:32.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.107+0000 7f20a9dde640 1 -- 172.21.15.50:0/2245133760 shutdown_connections 2024-04-01T02:13:32.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.107+0000 7f20a9dde640 1 -- 172.21.15.50:0/2245133760 wait complete. 2024-04-01T02:13:32.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.107+0000 7f20a9dde640 1 Processor -- start 2024-04-01T02:13:32.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.107+0000 7f20a9dde640 1 -- start start 2024-04-01T02:13:32.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.111+0000 7f20a9dde640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20a40c73a0 0x7f20a40c9440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:13:32.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.111+0000 7f20a9dde640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f20a4150e60 0x7f20a40c9980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:13:32.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.111+0000 7f20a9dde640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f20a40caea0 0x7f20a40ca2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:13:32.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.111+0000 7f20a9dde640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f20a4157580 con 0x7f20a40c73a0 2024-04-01T02:13:32.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.111+0000 7f20a9dde640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f20a41572a0 con 0x7f20a4150e60 2024-04-01T02:13:32.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.111+0000 7f20a9dde640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f20a40c3010 con 0x7f20a40caea0 2024-04-01T02:13:32.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.111+0000 7f20a37fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20a40c73a0 0x7f20a40c9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:13:32.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.111+0000 7f20a37fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20a40c73a0 0x7f20a40c9440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56218/0 (socket says 172.21.15.50:56218) 2024-04-01T02:13:32.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.111+0000 7f20a37fe640 1 -- 172.21.15.50:0/3831299505 learned_addr learned my addr 172.21.15.50:0/3831299505 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T02:13:32.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.111+0000 7f20a3fff640 1 --2- 172.21.15.50:0/3831299505 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f20a40caea0 0x7f20a40ca2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:13:32.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.111+0000 7f20a2ffd640 1 --2- 172.21.15.50:0/3831299505 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f20a4150e60 0x7f20a40c9980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:13:32.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.111+0000 7f20a37fe640 1 -- 172.21.15.50:0/3831299505 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f20a40caea0 msgr2=0x7f20a40ca2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:13:32.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.111+0000 7f20a37fe640 1 --2- 172.21.15.50:0/3831299505 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f20a40caea0 0x7f20a40ca2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:13:32.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.111+0000 7f20a37fe640 1 -- 172.21.15.50:0/3831299505 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f20a4150e60 msgr2=0x7f20a40c9980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:13:32.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.111+0000 7f20a37fe640 1 --2- 172.21.15.50:0/3831299505 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f20a4150e60 0x7f20a40c9980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:13:32.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.111+0000 7f20a37fe640 1 -- 172.21.15.50:0/3831299505 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20a40c5b80 con 0x7f20a40c73a0 2024-04-01T02:13:32.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.111+0000 7f20a37fe640 1 --2- 172.21.15.50:0/3831299505 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20a40c73a0 0x7f20a40c9440 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f20940b3040 tx=0x7f209401ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:13:32.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.111+0000 7f208bfff640 1 -- 172.21.15.50:0/3831299505 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20940bf070 con 0x7f20a40c73a0 2024-04-01T02:13:32.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.111+0000 7f20a9dde640 1 -- 172.21.15.50:0/3831299505 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20a414e8e0 con 0x7f20a40c73a0 2024-04-01T02:13:32.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.111+0000 7f208bfff640 1 -- 172.21.15.50:0/3831299505 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20940b0680 con 0x7f20a40c73a0 2024-04-01T02:13:32.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.111+0000 7f208bfff640 1 -- 172.21.15.50:0/3831299505 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20940b5040 con 0x7f20a40c73a0 2024-04-01T02:13:32.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.111+0000 7f20a9dde640 1 -- 172.21.15.50:0/3831299505 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20a414fd00 con 0x7f20a40c73a0 2024-04-01T02:13:32.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.111+0000 7f20a9dde640 1 -- 172.21.15.50:0/3831299505 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20a41506a0 con 0x7f20a40c73a0 2024-04-01T02:13:32.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.111+0000 7f208bfff640 1 -- 172.21.15.50:0/3831299505 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 87103+0+0 (secure 0 0 0) 0x7f20940b0a70 con 0x7f20a40c73a0 2024-04-01T02:13:32.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.111+0000 7f208bfff640 1 --2- 172.21.15.50:0/3831299505 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f2090067420 0x7f20900698e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:13:32.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.111+0000 7f208bfff640 1 -- 172.21.15.50:0/3831299505 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5738+0+0 (secure 0 0 0) 0x7f2094121e40 con 0x7f20a40c73a0 2024-04-01T02:13:32.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.115+0000 7f20a2ffd640 1 --2- 172.21.15.50:0/3831299505 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f2090067420 0x7f20900698e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:13:32.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.115+0000 7f20a2ffd640 1 --2- 172.21.15.50:0/3831299505 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f2090067420 0x7f20900698e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f20a414d7a0 tx=0x7f2098007e90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:13:32.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.119+0000 7f208bfff640 1 -- 172.21.15.50:0/3831299505 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+176632 (secure 0 0 0) 0x7f20a41506a0 con 0x7f20a40c73a0 2024-04-01T02:13:32.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.275+0000 7f20a9dde640 1 -- 172.21.15.50:0/3831299505 --> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f20a414e690 con 0x7f2090067420 2024-04-01T02:13:32.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.295+0000 7f208bfff640 1 -- 172.21.15.50:0/3831299505 <== mgr.4103 v2:172.21.15.97:6832/1677467570 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+255476 (secure 0 0 0) 0x7f20a414e690 con 0x7f2090067420 2024-04-01T02:13:32.293 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-01T02:13:32.294 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-04-01T02:13:32.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.295+0000 7f20a9dde640 1 -- 172.21.15.50:0/3831299505 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f2090067420 msgr2=0x7f20900698e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:13:32.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.295+0000 7f20a9dde640 1 --2- 172.21.15.50:0/3831299505 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f2090067420 0x7f20900698e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f20a414d7a0 tx=0x7f2098007e90 comp rx=0 tx=0).stop 2024-04-01T02:13:32.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.295+0000 7f20a9dde640 1 -- 172.21.15.50:0/3831299505 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20a40c73a0 msgr2=0x7f20a40c9440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:13:32.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.295+0000 7f20a9dde640 1 --2- 172.21.15.50:0/3831299505 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20a40c73a0 0x7f20a40c9440 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f20940b3040 tx=0x7f209401ba30 comp rx=0 tx=0).stop 2024-04-01T02:13:32.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.295+0000 7f20a9dde640 1 -- 172.21.15.50:0/3831299505 shutdown_connections 2024-04-01T02:13:32.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.295+0000 7f20a9dde640 1 --2- 172.21.15.50:0/3831299505 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f2090067420 0x7f20900698e0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:13:32.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.295+0000 7f20a9dde640 1 --2- 172.21.15.50:0/3831299505 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f20a40caea0 0x7f20a40ca2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:13:32.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.295+0000 7f20a9dde640 1 --2- 172.21.15.50:0/3831299505 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f20a4150e60 0x7f20a40c9980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:13:32.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.295+0000 7f20a9dde640 1 --2- 172.21.15.50:0/3831299505 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20a40c73a0 0x7f20a40c9440 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:13:32.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.299+0000 7f20a9dde640 1 -- 172.21.15.50:0/3831299505 >> 172.21.15.50:0/3831299505 conn(0x7f20a4067560 msgr2=0x7f20a415a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T02:13:32.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.299+0000 7f20a9dde640 1 -- 172.21.15.50:0/3831299505 shutdown_connections 2024-04-01T02:13:32.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.299+0000 7f20a9dde640 1 -- 172.21.15.50:0/3831299505 wait complete. 2024-04-01T02:13:32.311 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":551,"stamp":"2024-04-01T02:13:30.405847+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":415050366,"num_objects":742,"num_object_clones":0,"num_object_copies":1484,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":742,"num_whiteouts":0,"num_read":1875,"num_read_kb":2843,"num_write":56005,"num_write_kb":1354513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":63330,"ondisk_log_size":63330,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":997896,"kb_used_data":290376,"kb_used_omap":12,"kb_used_meta":707443,"kb_avail":753976824,"statfs":{"total":773094113280,"available":772072267776,"internally_reserved":0,"allocated":297345024,"data_stored":830767280,"data_compressed":57247476,"data_compressed_allocated":83542016,"data_compressed_original":620507992,"omap_allocated":12751,"internal_metadata":724422193},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004124"},"pg_stats":[{"pgid":"3.3f","version":"23'501","reported_seq":534,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:13:03.214025+0000","last_change":"2024-04-01T02:13:03.214212+0000","last_active":"2024-04-01T02:13:03.214025+0000","last_peered":"2024-04-01T02:13:03.214025+0000","last_clean":"2024-04-01T02:13:03.214025+0000","last_became_active":"2024-04-01T01:55:49.279011+0000","last_became_peered":"2024-04-01T01:55:49.279011+0000","last_unstale":"2024-04-01T02:13:03.214025+0000","last_undegraded":"2024-04-01T02:13:03.214025+0000","last_fullsized":"2024-04-01T02:13:03.214025+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'501","last_scrub_stamp":"2024-04-01T02:13:03.213802+0000","last_deep_scrub":"23'501","last_deep_scrub_stamp":"2024-04-01T02:13:03.213802+0000","last_clean_scrub_stamp":"2024-04-01T02:13:03.213802+0000","objects_scrubbed":16,"log_size":501,"log_dups_size":0,"ondisk_log_size":501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:58:12.518257+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4211749,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":345,"num_write_kb":18423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"23'570","reported_seq":603,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:59.852680+0000","last_change":"2024-04-01T02:12:59.852779+0000","last_active":"2024-04-01T02:12:59.852680+0000","last_peered":"2024-04-01T02:12:59.852680+0000","last_clean":"2024-04-01T02:12:59.852680+0000","last_became_active":"2024-04-01T01:55:49.246660+0000","last_became_peered":"2024-04-01T01:55:49.246660+0000","last_unstale":"2024-04-01T02:12:59.852680+0000","last_undegraded":"2024-04-01T02:12:59.852680+0000","last_fullsized":"2024-04-01T02:12:59.852680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'570","last_scrub_stamp":"2024-04-01T02:12:59.852537+0000","last_deep_scrub":"23'570","last_deep_scrub_stamp":"2024-04-01T02:12:59.852537+0000","last_clean_scrub_stamp":"2024-04-01T02:12:59.852537+0000","objects_scrubbed":15,"log_size":570,"log_dups_size":0,"ondisk_log_size":570,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:38:12.695043+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3694421,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":432,"num_write_kb":10812,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"23'538","reported_seq":571,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:54.914150+0000","last_change":"2024-04-01T02:12:54.914235+0000","last_active":"2024-04-01T02:12:54.914150+0000","last_peered":"2024-04-01T02:12:54.914150+0000","last_clean":"2024-04-01T02:12:54.914150+0000","last_became_active":"2024-04-01T01:55:49.239904+0000","last_became_peered":"2024-04-01T01:55:49.239904+0000","last_unstale":"2024-04-01T02:12:54.914150+0000","last_undegraded":"2024-04-01T02:12:54.914150+0000","last_fullsized":"2024-04-01T02:12:54.914150+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'538","last_scrub_stamp":"2024-04-01T02:12:54.913984+0000","last_deep_scrub":"23'538","last_deep_scrub_stamp":"2024-04-01T02:12:54.913984+0000","last_clean_scrub_stamp":"2024-04-01T02:12:54.913984+0000","objects_scrubbed":16,"log_size":538,"log_dups_size":0,"ondisk_log_size":538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:08:29.593745+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5131013,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":399,"num_write_kb":17827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"23'482","reported_seq":515,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:54.337981+0000","last_change":"2024-04-01T02:12:54.338052+0000","last_active":"2024-04-01T02:12:54.337981+0000","last_peered":"2024-04-01T02:12:54.337981+0000","last_clean":"2024-04-01T02:12:54.337981+0000","last_became_active":"2024-04-01T01:55:49.279041+0000","last_became_peered":"2024-04-01T01:55:49.279041+0000","last_unstale":"2024-04-01T02:12:54.337981+0000","last_undegraded":"2024-04-01T02:12:54.337981+0000","last_fullsized":"2024-04-01T02:12:54.337981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'482","last_scrub_stamp":"2024-04-01T02:12:54.337789+0000","last_deep_scrub":"23'482","last_deep_scrub_stamp":"2024-04-01T02:12:54.337789+0000","last_clean_scrub_stamp":"2024-04-01T02:12:54.337789+0000","objects_scrubbed":5,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:52:32.268814+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":658438,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":353,"num_write_kb":8202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"23'589","reported_seq":621,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:54.178525+0000","last_change":"2024-04-01T02:12:54.178525+0000","last_active":"2024-04-01T02:12:54.178525+0000","last_peered":"2024-04-01T02:12:54.178525+0000","last_clean":"2024-04-01T02:12:54.178525+0000","last_became_active":"2024-04-01T01:55:49.246152+0000","last_became_peered":"2024-04-01T01:55:49.246152+0000","last_unstale":"2024-04-01T02:12:54.178525+0000","last_undegraded":"2024-04-01T02:12:54.178525+0000","last_fullsized":"2024-04-01T02:12:54.178525+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'589","last_scrub_stamp":"2024-04-01T02:12:54.178272+0000","last_deep_scrub":"23'589","last_deep_scrub_stamp":"2024-04-01T02:12:54.178272+0000","last_clean_scrub_stamp":"2024-04-01T02:12:54.178272+0000","objects_scrubbed":14,"log_size":589,"log_dups_size":0,"ondisk_log_size":589,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:07:36.024323+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3987251,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":442,"num_write_kb":11887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"23'483","reported_seq":515,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:50.343847+0000","last_change":"2024-04-01T02:12:50.343847+0000","last_active":"2024-04-01T02:12:50.343847+0000","last_peered":"2024-04-01T02:12:50.343847+0000","last_clean":"2024-04-01T02:12:50.343847+0000","last_became_active":"2024-04-01T01:55:49.253348+0000","last_became_peered":"2024-04-01T01:55:49.253348+0000","last_unstale":"2024-04-01T02:12:50.343847+0000","last_undegraded":"2024-04-01T02:12:50.343847+0000","last_fullsized":"2024-04-01T02:12:50.343847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'483","last_scrub_stamp":"2024-04-01T02:12:50.343558+0000","last_deep_scrub":"23'483","last_deep_scrub_stamp":"2024-04-01T02:12:50.343558+0000","last_clean_scrub_stamp":"2024-04-01T02:12:50.343558+0000","objects_scrubbed":11,"log_size":483,"log_dups_size":0,"ondisk_log_size":483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:39:59.138321+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3474466,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":343,"num_write_kb":9649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"23'564","reported_seq":596,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:55.212119+0000","last_change":"2024-04-01T02:12:55.212119+0000","last_active":"2024-04-01T02:12:55.212119+0000","last_peered":"2024-04-01T02:12:55.212119+0000","last_clean":"2024-04-01T02:12:55.212119+0000","last_became_active":"2024-04-01T01:55:49.247373+0000","last_became_peered":"2024-04-01T01:55:49.247373+0000","last_unstale":"2024-04-01T02:12:55.212119+0000","last_undegraded":"2024-04-01T02:12:55.212119+0000","last_fullsized":"2024-04-01T02:12:55.212119+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'564","last_scrub_stamp":"2024-04-01T02:12:55.211864+0000","last_deep_scrub":"23'564","last_deep_scrub_stamp":"2024-04-01T02:12:55.211864+0000","last_clean_scrub_stamp":"2024-04-01T02:12:55.211864+0000","objects_scrubbed":6,"log_size":564,"log_dups_size":0,"ondisk_log_size":564,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T13:39:59.482105+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2878976,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":421,"num_write_kb":10504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"23'488","reported_seq":520,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:13:05.831974+0000","last_change":"2024-04-01T02:13:05.831974+0000","last_active":"2024-04-01T02:13:05.831974+0000","last_peered":"2024-04-01T02:13:05.831974+0000","last_clean":"2024-04-01T02:13:05.831974+0000","last_became_active":"2024-04-01T01:55:49.262736+0000","last_became_peered":"2024-04-01T01:55:49.262736+0000","last_unstale":"2024-04-01T02:13:05.831974+0000","last_undegraded":"2024-04-01T02:13:05.831974+0000","last_fullsized":"2024-04-01T02:13:05.831974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'488","last_scrub_stamp":"2024-04-01T02:13:05.831707+0000","last_deep_scrub":"23'488","last_deep_scrub_stamp":"2024-04-01T02:13:05.831707+0000","last_clean_scrub_stamp":"2024-04-01T02:13:05.831707+0000","objects_scrubbed":9,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:10:44.985846+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3489692,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":346,"num_write_kb":10932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"23'519","reported_seq":551,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:53.978189+0000","last_change":"2024-04-01T02:12:53.978280+0000","last_active":"2024-04-01T02:12:53.978189+0000","last_peered":"2024-04-01T02:12:53.978189+0000","last_clean":"2024-04-01T02:12:53.978189+0000","last_became_active":"2024-04-01T01:55:49.259745+0000","last_became_peered":"2024-04-01T01:55:49.259745+0000","last_unstale":"2024-04-01T02:12:53.978189+0000","last_undegraded":"2024-04-01T02:12:53.978189+0000","last_fullsized":"2024-04-01T02:12:53.978189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'519","last_scrub_stamp":"2024-04-01T02:12:53.977995+0000","last_deep_scrub":"23'519","last_deep_scrub_stamp":"2024-04-01T02:12:53.977995+0000","last_clean_scrub_stamp":"2024-04-01T02:12:53.977995+0000","objects_scrubbed":12,"log_size":519,"log_dups_size":0,"ondisk_log_size":519,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:25:35.670815+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3721216,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":377,"num_write_kb":13356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"23'495","reported_seq":520,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:57.475587+0000","last_change":"2024-04-01T02:12:57.475656+0000","last_active":"2024-04-01T02:12:57.475587+0000","last_peered":"2024-04-01T02:12:57.475587+0000","last_clean":"2024-04-01T02:12:57.475587+0000","last_became_active":"2024-04-01T01:56:38.228548+0000","last_became_peered":"2024-04-01T01:56:38.228548+0000","last_unstale":"2024-04-01T02:12:57.475587+0000","last_undegraded":"2024-04-01T02:12:57.475587+0000","last_fullsized":"2024-04-01T02:12:57.475587+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'495","last_scrub_stamp":"2024-04-01T02:12:57.475422+0000","last_deep_scrub":"23'495","last_deep_scrub_stamp":"2024-04-01T02:12:57.475422+0000","last_clean_scrub_stamp":"2024-04-01T02:12:57.475422+0000","objects_scrubbed":6,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:50:45.915443+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2985236,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":363,"num_write_kb":27800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.35","version":"23'480","reported_seq":512,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:13:02.170082+0000","last_change":"2024-04-01T02:13:02.170164+0000","last_active":"2024-04-01T02:13:02.170082+0000","last_peered":"2024-04-01T02:13:02.170082+0000","last_clean":"2024-04-01T02:13:02.170082+0000","last_became_active":"2024-04-01T01:55:49.270877+0000","last_became_peered":"2024-04-01T01:55:49.270877+0000","last_unstale":"2024-04-01T02:13:02.170082+0000","last_undegraded":"2024-04-01T02:13:02.170082+0000","last_fullsized":"2024-04-01T02:13:02.170082+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'480","last_scrub_stamp":"2024-04-01T02:13:02.169918+0000","last_deep_scrub":"23'480","last_deep_scrub_stamp":"2024-04-01T02:13:02.169918+0000","last_clean_scrub_stamp":"2024-04-01T02:13:02.169918+0000","objects_scrubbed":12,"log_size":480,"log_dups_size":0,"ondisk_log_size":480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:03:41.008261+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3409567,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":12314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"23'419","reported_seq":451,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:13:00.215372+0000","last_change":"2024-04-01T02:13:00.215444+0000","last_active":"2024-04-01T02:13:00.215372+0000","last_peered":"2024-04-01T02:13:00.215372+0000","last_clean":"2024-04-01T02:13:00.215372+0000","last_became_active":"2024-04-01T01:55:49.259193+0000","last_became_peered":"2024-04-01T01:55:49.259193+0000","last_unstale":"2024-04-01T02:13:00.215372+0000","last_undegraded":"2024-04-01T02:13:00.215372+0000","last_fullsized":"2024-04-01T02:13:00.215372+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'419","last_scrub_stamp":"2024-04-01T02:13:00.215188+0000","last_deep_scrub":"23'419","last_deep_scrub_stamp":"2024-04-01T02:13:00.215188+0000","last_clean_scrub_stamp":"2024-04-01T02:13:00.215188+0000","objects_scrubbed":7,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:04:34.983783+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2357039,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":282,"num_write_kb":7635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"23'433","reported_seq":465,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:56.321662+0000","last_change":"2024-04-01T02:12:56.321795+0000","last_active":"2024-04-01T02:12:56.321662+0000","last_peered":"2024-04-01T02:12:56.321662+0000","last_clean":"2024-04-01T02:12:56.321662+0000","last_became_active":"2024-04-01T01:55:49.247436+0000","last_became_peered":"2024-04-01T01:55:49.247436+0000","last_unstale":"2024-04-01T02:12:56.321662+0000","last_undegraded":"2024-04-01T02:12:56.321662+0000","last_fullsized":"2024-04-01T02:12:56.321662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'433","last_scrub_stamp":"2024-04-01T02:12:56.321471+0000","last_deep_scrub":"23'433","last_deep_scrub_stamp":"2024-04-01T02:12:56.321471+0000","last_clean_scrub_stamp":"2024-04-01T02:12:56.321471+0000","objects_scrubbed":3,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:19:39.638577+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":608576,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":293,"num_write_kb":6624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"23'530","reported_seq":562,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:55.353048+0000","last_change":"2024-04-01T02:12:55.353112+0000","last_active":"2024-04-01T02:12:55.353048+0000","last_peered":"2024-04-01T02:12:55.353048+0000","last_clean":"2024-04-01T02:12:55.353048+0000","last_became_active":"2024-04-01T01:55:49.245650+0000","last_became_peered":"2024-04-01T01:55:49.245650+0000","last_unstale":"2024-04-01T02:12:55.353048+0000","last_undegraded":"2024-04-01T02:12:55.353048+0000","last_fullsized":"2024-04-01T02:12:55.353048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'530","last_scrub_stamp":"2024-04-01T02:12:55.352927+0000","last_deep_scrub":"23'530","last_deep_scrub_stamp":"2024-04-01T02:12:55.352927+0000","last_clean_scrub_stamp":"2024-04-01T02:12:55.352927+0000","objects_scrubbed":14,"log_size":530,"log_dups_size":0,"ondisk_log_size":530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:02:42.807922+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3014274,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":389,"num_write_kb":12247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"23'515","reported_seq":547,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:13:00.809612+0000","last_change":"2024-04-01T02:13:00.809765+0000","last_active":"2024-04-01T02:13:00.809612+0000","last_peered":"2024-04-01T02:13:00.809612+0000","last_clean":"2024-04-01T02:13:00.809612+0000","last_became_active":"2024-04-01T01:55:49.247662+0000","last_became_peered":"2024-04-01T01:55:49.247662+0000","last_unstale":"2024-04-01T02:13:00.809612+0000","last_undegraded":"2024-04-01T02:13:00.809612+0000","last_fullsized":"2024-04-01T02:13:00.809612+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'515","last_scrub_stamp":"2024-04-01T02:13:00.809370+0000","last_deep_scrub":"23'515","last_deep_scrub_stamp":"2024-04-01T02:13:00.809370+0000","last_clean_scrub_stamp":"2024-04-01T02:13:00.809370+0000","objects_scrubbed":9,"log_size":515,"log_dups_size":0,"ondisk_log_size":515,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:49:38.031822+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3985408,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":369,"num_write_kb":15794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"23'691","reported_seq":723,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:13:02.720046+0000","last_change":"2024-04-01T02:13:02.720221+0000","last_active":"2024-04-01T02:13:02.720046+0000","last_peered":"2024-04-01T02:13:02.720046+0000","last_clean":"2024-04-01T02:13:02.720046+0000","last_became_active":"2024-04-01T01:55:49.261839+0000","last_became_peered":"2024-04-01T01:55:49.261839+0000","last_unstale":"2024-04-01T02:13:02.720046+0000","last_undegraded":"2024-04-01T02:13:02.720046+0000","last_fullsized":"2024-04-01T02:13:02.720046+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'691","last_scrub_stamp":"2024-04-01T02:13:02.719780+0000","last_deep_scrub":"23'691","last_deep_scrub_stamp":"2024-04-01T02:13:02.719780+0000","last_clean_scrub_stamp":"2024-04-01T02:13:02.719780+0000","objects_scrubbed":12,"log_size":691,"log_dups_size":0,"ondisk_log_size":691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:58:12.024236+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6390669,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":553,"num_write_kb":46118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"23'602","reported_seq":634,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:13:09.713690+0000","last_change":"2024-04-01T02:13:09.713764+0000","last_active":"2024-04-01T02:13:09.713690+0000","last_peered":"2024-04-01T02:13:09.713690+0000","last_clean":"2024-04-01T02:13:09.713690+0000","last_became_active":"2024-04-01T01:55:49.275727+0000","last_became_peered":"2024-04-01T01:55:49.275727+0000","last_unstale":"2024-04-01T02:13:09.713690+0000","last_undegraded":"2024-04-01T02:13:09.713690+0000","last_fullsized":"2024-04-01T02:13:09.713690+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'602","last_scrub_stamp":"2024-04-01T02:13:09.713523+0000","last_deep_scrub":"23'602","last_deep_scrub_stamp":"2024-04-01T02:13:09.713523+0000","last_clean_scrub_stamp":"2024-04-01T02:13:09.713523+0000","objects_scrubbed":7,"log_size":602,"log_dups_size":0,"ondisk_log_size":602,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:53:02.384030+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1955840,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":457,"num_write_kb":17131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"23'511","reported_seq":543,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:55.445905+0000","last_change":"2024-04-01T02:12:55.445943+0000","last_active":"2024-04-01T02:12:55.445905+0000","last_peered":"2024-04-01T02:12:55.445905+0000","last_clean":"2024-04-01T02:12:55.445905+0000","last_became_active":"2024-04-01T01:55:49.252553+0000","last_became_peered":"2024-04-01T01:55:49.252553+0000","last_unstale":"2024-04-01T02:12:55.445905+0000","last_undegraded":"2024-04-01T02:12:55.445905+0000","last_fullsized":"2024-04-01T02:12:55.445905+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'511","last_scrub_stamp":"2024-04-01T02:12:55.445834+0000","last_deep_scrub":"23'511","last_deep_scrub_stamp":"2024-04-01T02:12:55.445834+0000","last_clean_scrub_stamp":"2024-04-01T02:12:55.445834+0000","objects_scrubbed":9,"log_size":511,"log_dups_size":0,"ondisk_log_size":511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:04:46.977716+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5136348,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":357,"num_write_kb":34023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"23'532","reported_seq":564,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:49.583659+0000","last_change":"2024-04-01T02:12:49.583709+0000","last_active":"2024-04-01T02:12:49.583659+0000","last_peered":"2024-04-01T02:12:49.583659+0000","last_clean":"2024-04-01T02:12:49.583659+0000","last_became_active":"2024-04-01T01:55:49.259935+0000","last_became_peered":"2024-04-01T01:55:49.259935+0000","last_unstale":"2024-04-01T02:12:49.583659+0000","last_undegraded":"2024-04-01T02:12:49.583659+0000","last_fullsized":"2024-04-01T02:12:49.583659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'532","last_scrub_stamp":"2024-04-01T02:12:49.583545+0000","last_deep_scrub":"23'532","last_deep_scrub_stamp":"2024-04-01T02:12:49.583545+0000","last_clean_scrub_stamp":"2024-04-01T02:12:49.583545+0000","objects_scrubbed":10,"log_size":532,"log_dups_size":0,"ondisk_log_size":532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:15:49.640682+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6314527,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":390,"num_write_kb":35275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"23'666","reported_seq":698,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:59.220607+0000","last_change":"2024-04-01T02:12:59.220694+0000","last_active":"2024-04-01T02:12:59.220607+0000","last_peered":"2024-04-01T02:12:59.220607+0000","last_clean":"2024-04-01T02:12:59.220607+0000","last_became_active":"2024-04-01T01:55:49.258670+0000","last_became_peered":"2024-04-01T01:55:49.258670+0000","last_unstale":"2024-04-01T02:12:59.220607+0000","last_undegraded":"2024-04-01T02:12:59.220607+0000","last_fullsized":"2024-04-01T02:12:59.220607+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'666","last_scrub_stamp":"2024-04-01T02:12:59.220432+0000","last_deep_scrub":"23'666","last_deep_scrub_stamp":"2024-04-01T02:12:59.220432+0000","last_clean_scrub_stamp":"2024-04-01T02:12:59.220432+0000","objects_scrubbed":12,"log_size":666,"log_dups_size":0,"ondisk_log_size":666,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:28:39.699162+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3478562,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":525,"num_write_kb":13686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"23'534","reported_seq":566,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:56.376176+0000","last_change":"2024-04-01T02:12:56.376258+0000","last_active":"2024-04-01T02:12:56.376176+0000","last_peered":"2024-04-01T02:12:56.376176+0000","last_clean":"2024-04-01T02:12:56.376176+0000","last_became_active":"2024-04-01T01:55:49.243518+0000","last_became_peered":"2024-04-01T01:55:49.243518+0000","last_unstale":"2024-04-01T02:12:56.376176+0000","last_undegraded":"2024-04-01T02:12:56.376176+0000","last_fullsized":"2024-04-01T02:12:56.376176+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'534","last_scrub_stamp":"2024-04-01T02:12:56.376001+0000","last_deep_scrub":"23'534","last_deep_scrub_stamp":"2024-04-01T02:12:56.376001+0000","last_clean_scrub_stamp":"2024-04-01T02:12:56.376001+0000","objects_scrubbed":8,"log_size":534,"log_dups_size":0,"ondisk_log_size":534,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:15:56.433138+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1873749,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":387,"num_write_kb":9989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"23'563","reported_seq":595,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:52.983392+0000","last_change":"2024-04-01T02:12:52.983487+0000","last_active":"2024-04-01T02:12:52.983392+0000","last_peered":"2024-04-01T02:12:52.983392+0000","last_clean":"2024-04-01T02:12:52.983392+0000","last_became_active":"2024-04-01T01:55:49.257576+0000","last_became_peered":"2024-04-01T01:55:49.257576+0000","last_unstale":"2024-04-01T02:12:52.983392+0000","last_undegraded":"2024-04-01T02:12:52.983392+0000","last_fullsized":"2024-04-01T02:12:52.983392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'563","last_scrub_stamp":"2024-04-01T02:12:52.983187+0000","last_deep_scrub":"23'563","last_deep_scrub_stamp":"2024-04-01T02:12:52.983187+0000","last_clean_scrub_stamp":"2024-04-01T02:12:52.983187+0000","objects_scrubbed":10,"log_size":563,"log_dups_size":0,"ondisk_log_size":563,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:04:44.515070+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3745621,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":429,"num_write_kb":26683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"23'505","reported_seq":537,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:13:01.836024+0000","last_change":"2024-04-01T02:13:01.836110+0000","last_active":"2024-04-01T02:13:01.836024+0000","last_peered":"2024-04-01T02:13:01.836024+0000","last_clean":"2024-04-01T02:13:01.836024+0000","last_became_active":"2024-04-01T01:55:49.250522+0000","last_became_peered":"2024-04-01T01:55:49.250522+0000","last_unstale":"2024-04-01T02:13:01.836024+0000","last_undegraded":"2024-04-01T02:13:01.836024+0000","last_fullsized":"2024-04-01T02:13:01.836024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'505","last_scrub_stamp":"2024-04-01T02:13:01.835865+0000","last_deep_scrub":"23'505","last_deep_scrub_stamp":"2024-04-01T02:13:01.835865+0000","last_clean_scrub_stamp":"2024-04-01T02:13:01.835865+0000","objects_scrubbed":10,"log_size":505,"log_dups_size":0,"ondisk_log_size":505,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:54:23.522856+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1694624,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":361,"num_write_kb":9747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"23'531","reported_seq":564,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:13:03.712068+0000","last_change":"2024-04-01T02:13:03.712068+0000","last_active":"2024-04-01T02:13:03.712068+0000","last_peered":"2024-04-01T02:13:03.712068+0000","last_clean":"2024-04-01T02:13:03.712068+0000","last_became_active":"2024-04-01T01:55:49.269694+0000","last_became_peered":"2024-04-01T01:55:49.269694+0000","last_unstale":"2024-04-01T02:13:03.712068+0000","last_undegraded":"2024-04-01T02:13:03.712068+0000","last_fullsized":"2024-04-01T02:13:03.712068+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'531","last_scrub_stamp":"2024-04-01T02:13:03.711820+0000","last_deep_scrub":"23'531","last_deep_scrub_stamp":"2024-04-01T02:13:03.711820+0000","last_clean_scrub_stamp":"2024-04-01T02:13:03.711820+0000","objects_scrubbed":13,"log_size":531,"log_dups_size":0,"ondisk_log_size":531,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:39:43.896810+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4783138,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384,"num_write_kb":12273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"23'564","reported_seq":597,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:56.878323+0000","last_change":"2024-04-01T02:12:56.878323+0000","last_active":"2024-04-01T02:12:56.878323+0000","last_peered":"2024-04-01T02:12:56.878323+0000","last_clean":"2024-04-01T02:12:56.878323+0000","last_became_active":"2024-04-01T01:55:49.243017+0000","last_became_peered":"2024-04-01T01:55:49.243017+0000","last_unstale":"2024-04-01T02:12:56.878323+0000","last_undegraded":"2024-04-01T02:12:56.878323+0000","last_fullsized":"2024-04-01T02:12:56.878323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'564","last_scrub_stamp":"2024-04-01T02:12:56.878071+0000","last_deep_scrub":"23'564","last_deep_scrub_stamp":"2024-04-01T02:12:56.878071+0000","last_clean_scrub_stamp":"2024-04-01T02:12:56.878071+0000","objects_scrubbed":13,"log_size":564,"log_dups_size":0,"ondisk_log_size":564,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:51:00.730669+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3977024,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":423,"num_write_kb":11436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"23'590","reported_seq":623,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:56.409956+0000","last_change":"2024-04-01T02:12:56.409956+0000","last_active":"2024-04-01T02:12:56.409956+0000","last_peered":"2024-04-01T02:12:56.409956+0000","last_clean":"2024-04-01T02:12:56.409956+0000","last_became_active":"2024-04-01T01:55:49.279882+0000","last_became_peered":"2024-04-01T01:55:49.279882+0000","last_unstale":"2024-04-01T02:12:56.409956+0000","last_undegraded":"2024-04-01T02:12:56.409956+0000","last_fullsized":"2024-04-01T02:12:56.409956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'590","last_scrub_stamp":"2024-04-01T02:12:56.409551+0000","last_deep_scrub":"23'590","last_deep_scrub_stamp":"2024-04-01T02:12:56.409551+0000","last_clean_scrub_stamp":"2024-04-01T02:12:56.409551+0000","objects_scrubbed":13,"log_size":590,"log_dups_size":0,"ondisk_log_size":590,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:18:07.908024+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8142848,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":413,"num_write_kb":37888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"23'776","reported_seq":809,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:57.394305+0000","last_change":"2024-04-01T02:12:57.394305+0000","last_active":"2024-04-01T02:12:57.394305+0000","last_peered":"2024-04-01T02:12:57.394305+0000","last_clean":"2024-04-01T02:12:57.394305+0000","last_became_active":"2024-04-01T01:55:49.249588+0000","last_became_peered":"2024-04-01T01:55:49.249588+0000","last_unstale":"2024-04-01T02:12:57.394305+0000","last_undegraded":"2024-04-01T02:12:57.394305+0000","last_fullsized":"2024-04-01T02:12:57.394305+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'776","last_scrub_stamp":"2024-04-01T02:12:57.394131+0000","last_deep_scrub":"23'776","last_deep_scrub_stamp":"2024-04-01T02:12:57.394131+0000","last_clean_scrub_stamp":"2024-04-01T02:12:57.394131+0000","objects_scrubbed":14,"log_size":776,"log_dups_size":0,"ondisk_log_size":776,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T13:01:20.431518+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4497408,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":644,"num_write_kb":39031,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"23'445","reported_seq":478,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:58.334986+0000","last_change":"2024-04-01T02:12:58.334986+0000","last_active":"2024-04-01T02:12:58.334986+0000","last_peered":"2024-04-01T02:12:58.334986+0000","last_clean":"2024-04-01T02:12:58.334986+0000","last_became_active":"2024-04-01T01:55:49.253726+0000","last_became_peered":"2024-04-01T01:55:49.253726+0000","last_unstale":"2024-04-01T02:12:58.334986+0000","last_undegraded":"2024-04-01T02:12:58.334986+0000","last_fullsized":"2024-04-01T02:12:58.334986+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'445","last_scrub_stamp":"2024-04-01T02:12:58.334824+0000","last_deep_scrub":"23'445","last_deep_scrub_stamp":"2024-04-01T02:12:58.334824+0000","last_clean_scrub_stamp":"2024-04-01T02:12:58.334824+0000","objects_scrubbed":8,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:15:58.391962+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2117070,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":308,"num_write_kb":8584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"23'494","reported_seq":527,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:13:02.849551+0000","last_change":"2024-04-01T02:13:02.849630+0000","last_active":"2024-04-01T02:13:02.849551+0000","last_peered":"2024-04-01T02:13:02.849551+0000","last_clean":"2024-04-01T02:13:02.849551+0000","last_became_active":"2024-04-01T01:55:49.251760+0000","last_became_peered":"2024-04-01T01:55:49.251760+0000","last_unstale":"2024-04-01T02:13:02.849551+0000","last_undegraded":"2024-04-01T02:13:02.849551+0000","last_fullsized":"2024-04-01T02:13:02.849551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'494","last_scrub_stamp":"2024-04-01T02:13:02.849371+0000","last_deep_scrub":"23'494","last_deep_scrub_stamp":"2024-04-01T02:13:02.849371+0000","last_clean_scrub_stamp":"2024-04-01T02:13:02.849371+0000","objects_scrubbed":9,"log_size":494,"log_dups_size":0,"ondisk_log_size":494,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:44:18.665097+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1909794,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":354,"num_write_kb":10727,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"23'896","reported_seq":929,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:13:04.745135+0000","last_change":"2024-04-01T02:13:04.745321+0000","last_active":"2024-04-01T02:13:04.745135+0000","last_peered":"2024-04-01T02:13:04.745135+0000","last_clean":"2024-04-01T02:13:04.745135+0000","last_became_active":"2024-04-01T01:55:49.269636+0000","last_became_peered":"2024-04-01T01:55:49.269636+0000","last_unstale":"2024-04-01T02:13:04.745135+0000","last_undegraded":"2024-04-01T02:13:04.745135+0000","last_fullsized":"2024-04-01T02:13:04.745135+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'896","last_scrub_stamp":"2024-04-01T02:13:04.744922+0000","last_deep_scrub":"23'896","last_deep_scrub_stamp":"2024-04-01T02:13:04.744922+0000","last_clean_scrub_stamp":"2024-04-01T02:13:04.744922+0000","objects_scrubbed":14,"log_size":896,"log_dups_size":0,"ondisk_log_size":896,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:37:37.802059+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6037504,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":748,"num_write_kb":31167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"23'566","reported_seq":599,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:56.476406+0000","last_change":"2024-04-01T02:12:56.476485+0000","last_active":"2024-04-01T02:12:56.476406+0000","last_peered":"2024-04-01T02:12:56.476406+0000","last_clean":"2024-04-01T02:12:56.476406+0000","last_became_active":"2024-04-01T01:55:49.265946+0000","last_became_peered":"2024-04-01T01:55:49.265946+0000","last_unstale":"2024-04-01T02:12:56.476406+0000","last_undegraded":"2024-04-01T02:12:56.476406+0000","last_fullsized":"2024-04-01T02:12:56.476406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'566","last_scrub_stamp":"2024-04-01T02:12:56.476248+0000","last_deep_scrub":"23'566","last_deep_scrub_stamp":"2024-04-01T02:12:56.476248+0000","last_clean_scrub_stamp":"2024-04-01T02:12:56.476248+0000","objects_scrubbed":14,"log_size":566,"log_dups_size":0,"ondisk_log_size":566,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:25:38.169067+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4188782,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":415,"num_write_kb":13639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"23'525","reported_seq":558,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:53.322084+0000","last_change":"2024-04-01T02:12:53.322166+0000","last_active":"2024-04-01T02:12:53.322084+0000","last_peered":"2024-04-01T02:12:53.322084+0000","last_clean":"2024-04-01T02:12:53.322084+0000","last_became_active":"2024-04-01T01:55:49.272742+0000","last_became_peered":"2024-04-01T01:55:49.272742+0000","last_unstale":"2024-04-01T02:12:53.322084+0000","last_undegraded":"2024-04-01T02:12:53.322084+0000","last_fullsized":"2024-04-01T02:12:53.322084+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'525","last_scrub_stamp":"2024-04-01T02:12:53.321915+0000","last_deep_scrub":"23'525","last_deep_scrub_stamp":"2024-04-01T02:12:53.321915+0000","last_clean_scrub_stamp":"2024-04-01T02:12:53.321915+0000","objects_scrubbed":8,"log_size":525,"log_dups_size":0,"ondisk_log_size":525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:25:35.014734+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2869248,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":375,"num_write_kb":19168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"23'547","reported_seq":579,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:51.976674+0000","last_change":"2024-04-01T02:12:51.976674+0000","last_active":"2024-04-01T02:12:51.976674+0000","last_peered":"2024-04-01T02:12:51.976674+0000","last_clean":"2024-04-01T02:12:51.976674+0000","last_became_active":"2024-04-01T01:55:49.238286+0000","last_became_peered":"2024-04-01T01:55:49.238286+0000","last_unstale":"2024-04-01T02:12:51.976674+0000","last_undegraded":"2024-04-01T02:12:51.976674+0000","last_fullsized":"2024-04-01T02:12:51.976674+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'547","last_scrub_stamp":"2024-04-01T02:12:51.976395+0000","last_deep_scrub":"23'547","last_deep_scrub_stamp":"2024-04-01T02:12:51.976395+0000","last_clean_scrub_stamp":"2024-04-01T02:12:51.976395+0000","objects_scrubbed":20,"log_size":547,"log_dups_size":0,"ondisk_log_size":547,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:19:19.704349+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6652831,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":403,"num_write_kb":17955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"23'645","reported_seq":679,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:52.933193+0000","last_change":"2024-04-01T02:12:52.933193+0000","last_active":"2024-04-01T02:12:52.933193+0000","last_peered":"2024-04-01T02:12:52.933193+0000","last_clean":"2024-04-01T02:12:52.933193+0000","last_became_active":"2024-04-01T01:55:48.224408+0000","last_became_peered":"2024-04-01T01:55:48.224408+0000","last_unstale":"2024-04-01T02:12:52.933193+0000","last_undegraded":"2024-04-01T02:12:52.933193+0000","last_fullsized":"2024-04-01T02:12:52.933193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'645","last_scrub_stamp":"2024-04-01T02:12:52.932978+0000","last_deep_scrub":"23'645","last_deep_scrub_stamp":"2024-04-01T02:12:52.932978+0000","last_clean_scrub_stamp":"2024-04-01T02:12:52.932978+0000","objects_scrubbed":1,"log_size":645,"log_dups_size":0,"ondisk_log_size":645,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:13:16.895151+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":643,"num_write_kb":4346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"23'485","reported_seq":517,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:59.355771+0000","last_change":"2024-04-01T02:12:59.355771+0000","last_active":"2024-04-01T02:12:59.355771+0000","last_peered":"2024-04-01T02:12:59.355771+0000","last_clean":"2024-04-01T02:12:59.355771+0000","last_became_active":"2024-04-01T01:55:49.247496+0000","last_became_peered":"2024-04-01T01:55:49.247496+0000","last_unstale":"2024-04-01T02:12:59.355771+0000","last_undegraded":"2024-04-01T02:12:59.355771+0000","last_fullsized":"2024-04-01T02:12:59.355771+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'485","last_scrub_stamp":"2024-04-01T02:12:59.355453+0000","last_deep_scrub":"23'485","last_deep_scrub_stamp":"2024-04-01T02:12:59.355453+0000","last_clean_scrub_stamp":"2024-04-01T02:12:59.355453+0000","objects_scrubbed":11,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T13:15:33.679492+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3922463,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":358,"num_write_kb":10126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"23'1949","reported_seq":1983,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:13:07.509737+0000","last_change":"2024-04-01T02:12:59.818084+0000","last_active":"2024-04-01T02:13:07.509737+0000","last_peered":"2024-04-01T02:13:07.509737+0000","last_clean":"2024-04-01T02:13:07.509737+0000","last_became_active":"2024-04-01T01:55:48.221614+0000","last_became_peered":"2024-04-01T01:55:48.221614+0000","last_unstale":"2024-04-01T02:13:07.509737+0000","last_undegraded":"2024-04-01T02:13:07.509737+0000","last_fullsized":"2024-04-01T02:13:07.509737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1948","last_scrub_stamp":"2024-04-01T02:12:59.817816+0000","last_deep_scrub":"23'1948","last_deep_scrub_stamp":"2024-04-01T02:12:59.817816+0000","last_clean_scrub_stamp":"2024-04-01T02:12:59.817816+0000","objects_scrubbed":4,"log_size":1949,"log_dups_size":0,"ondisk_log_size":1949,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:04:34.586412+0000","scrub_duration":111,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16749926,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1942,"num_write_kb":17243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"23'394","reported_seq":428,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:51.302147+0000","last_change":"2024-04-01T02:12:51.302147+0000","last_active":"2024-04-01T02:12:51.302147+0000","last_peered":"2024-04-01T02:12:51.302147+0000","last_clean":"2024-04-01T02:12:51.302147+0000","last_became_active":"2024-04-01T01:55:48.216141+0000","last_became_peered":"2024-04-01T01:55:48.216141+0000","last_unstale":"2024-04-01T02:12:51.302147+0000","last_undegraded":"2024-04-01T02:12:51.302147+0000","last_fullsized":"2024-04-01T02:12:51.302147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'394","last_scrub_stamp":"2024-04-01T02:12:51.301900+0000","last_deep_scrub":"23'394","last_deep_scrub_stamp":"2024-04-01T02:12:51.301900+0000","last_clean_scrub_stamp":"2024-04-01T02:12:51.301900+0000","objects_scrubbed":1,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:19:19.029853+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":392,"num_write_kb":4245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"23'564","reported_seq":596,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:57.844702+0000","last_change":"2024-04-01T02:12:57.844781+0000","last_active":"2024-04-01T02:12:57.844702+0000","last_peered":"2024-04-01T02:12:57.844702+0000","last_clean":"2024-04-01T02:12:57.844702+0000","last_became_active":"2024-04-01T01:55:49.243823+0000","last_became_peered":"2024-04-01T01:55:49.243823+0000","last_unstale":"2024-04-01T02:12:57.844702+0000","last_undegraded":"2024-04-01T02:12:57.844702+0000","last_fullsized":"2024-04-01T02:12:57.844702+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'564","last_scrub_stamp":"2024-04-01T02:12:57.844573+0000","last_deep_scrub":"23'564","last_deep_scrub_stamp":"2024-04-01T02:12:57.844573+0000","last_clean_scrub_stamp":"2024-04-01T02:12:57.844573+0000","objects_scrubbed":14,"log_size":564,"log_dups_size":0,"ondisk_log_size":564,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:20:11.627917+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3965184,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":412,"num_write_kb":14098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"23'1755","reported_seq":1789,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:13:00.757453+0000","last_change":"2024-04-01T02:13:00.757527+0000","last_active":"2024-04-01T02:13:00.757453+0000","last_peered":"2024-04-01T02:13:00.757453+0000","last_clean":"2024-04-01T02:13:00.757453+0000","last_became_active":"2024-04-01T01:55:48.222535+0000","last_became_peered":"2024-04-01T01:55:48.222535+0000","last_unstale":"2024-04-01T02:13:00.757453+0000","last_undegraded":"2024-04-01T02:13:00.757453+0000","last_fullsized":"2024-04-01T02:13:00.757453+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1755","last_scrub_stamp":"2024-04-01T02:13:00.757279+0000","last_deep_scrub":"23'1755","last_deep_scrub_stamp":"2024-04-01T02:13:00.757279+0000","last_clean_scrub_stamp":"2024-04-01T02:13:00.757279+0000","objects_scrubbed":3,"log_size":1755,"log_dups_size":0,"ondisk_log_size":1755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:24:58.684456+0000","scrub_duration":83,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1749,"num_write_kb":12993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"23'546","reported_seq":578,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:55.402113+0000","last_change":"2024-04-01T02:12:55.402199+0000","last_active":"2024-04-01T02:12:55.402113+0000","last_peered":"2024-04-01T02:12:55.402113+0000","last_clean":"2024-04-01T02:12:55.402113+0000","last_became_active":"2024-04-01T01:55:49.230659+0000","last_became_peered":"2024-04-01T01:55:49.230659+0000","last_unstale":"2024-04-01T02:12:55.402113+0000","last_undegraded":"2024-04-01T02:12:55.402113+0000","last_fullsized":"2024-04-01T02:12:55.402113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'546","last_scrub_stamp":"2024-04-01T02:12:55.401927+0000","last_deep_scrub":"23'546","last_deep_scrub_stamp":"2024-04-01T02:12:55.401927+0000","last_clean_scrub_stamp":"2024-04-01T02:12:55.401927+0000","objects_scrubbed":15,"log_size":546,"log_dups_size":0,"ondisk_log_size":546,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T13:01:18.439313+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3477908,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":407,"num_write_kb":10690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"23'1","reported_seq":35,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:49.919410+0000","last_change":"2024-04-01T02:12:49.919432+0000","last_active":"2024-04-01T02:12:49.919410+0000","last_peered":"2024-04-01T02:12:49.919410+0000","last_clean":"2024-04-01T02:12:49.919410+0000","last_became_active":"2024-04-01T01:55:48.216318+0000","last_became_peered":"2024-04-01T01:55:48.216318+0000","last_unstale":"2024-04-01T02:12:49.919410+0000","last_undegraded":"2024-04-01T02:12:49.919410+0000","last_fullsized":"2024-04-01T02:12:49.919410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1","last_scrub_stamp":"2024-04-01T02:12:49.919321+0000","last_deep_scrub":"23'1","last_deep_scrub_stamp":"2024-04-01T02:12:49.919321+0000","last_clean_scrub_stamp":"2024-04-01T02:12:49.919321+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:31:46.335059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"23'559","reported_seq":591,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:55.343722+0000","last_change":"2024-04-01T02:12:55.343811+0000","last_active":"2024-04-01T02:12:55.343722+0000","last_peered":"2024-04-01T02:12:55.343722+0000","last_clean":"2024-04-01T02:12:55.343722+0000","last_became_active":"2024-04-01T01:55:49.279866+0000","last_became_peered":"2024-04-01T01:55:49.279866+0000","last_unstale":"2024-04-01T02:12:55.343722+0000","last_undegraded":"2024-04-01T02:12:55.343722+0000","last_fullsized":"2024-04-01T02:12:55.343722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'559","last_scrub_stamp":"2024-04-01T02:12:55.343514+0000","last_deep_scrub":"23'559","last_deep_scrub_stamp":"2024-04-01T02:12:55.343514+0000","last_clean_scrub_stamp":"2024-04-01T02:12:55.343514+0000","objects_scrubbed":9,"log_size":559,"log_dups_size":0,"ondisk_log_size":559,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:53:23.721280+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2636189,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":401,"num_write_kb":10506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"23'495","reported_seq":529,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:51.196591+0000","last_change":"2024-04-01T02:12:51.196661+0000","last_active":"2024-04-01T02:12:51.196591+0000","last_peered":"2024-04-01T02:12:51.196591+0000","last_clean":"2024-04-01T02:12:51.196591+0000","last_became_active":"2024-04-01T01:55:48.213610+0000","last_became_peered":"2024-04-01T01:55:48.213610+0000","last_unstale":"2024-04-01T02:12:51.196591+0000","last_undegraded":"2024-04-01T02:12:51.196591+0000","last_fullsized":"2024-04-01T02:12:51.196591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'495","last_scrub_stamp":"2024-04-01T02:12:51.196405+0000","last_deep_scrub":"23'495","last_deep_scrub_stamp":"2024-04-01T02:12:51.196405+0000","last_clean_scrub_stamp":"2024-04-01T02:12:51.196405+0000","objects_scrubbed":1,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:54:22.076959+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":490,"num_write_kb":4342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"23'516","reported_seq":548,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:13:04.855666+0000","last_change":"2024-04-01T02:13:04.855806+0000","last_active":"2024-04-01T02:13:04.855666+0000","last_peered":"2024-04-01T02:13:04.855666+0000","last_clean":"2024-04-01T02:13:04.855666+0000","last_became_active":"2024-04-01T01:55:49.261260+0000","last_became_peered":"2024-04-01T01:55:49.261260+0000","last_unstale":"2024-04-01T02:13:04.855666+0000","last_undegraded":"2024-04-01T02:13:04.855666+0000","last_fullsized":"2024-04-01T02:13:04.855666+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'516","last_scrub_stamp":"2024-04-01T02:13:04.855462+0000","last_deep_scrub":"23'516","last_deep_scrub_stamp":"2024-04-01T02:13:04.855462+0000","last_clean_scrub_stamp":"2024-04-01T02:13:04.855462+0000","objects_scrubbed":9,"log_size":516,"log_dups_size":0,"ondisk_log_size":516,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:10:20.047447+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2169152,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":377,"num_write_kb":10428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"23'1319","reported_seq":1353,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:53.479499+0000","last_change":"2024-04-01T02:12:53.479528+0000","last_active":"2024-04-01T02:12:53.479499+0000","last_peered":"2024-04-01T02:12:53.479499+0000","last_clean":"2024-04-01T02:12:53.479499+0000","last_became_active":"2024-04-01T01:55:48.226061+0000","last_became_peered":"2024-04-01T01:55:48.226061+0000","last_unstale":"2024-04-01T02:12:53.479499+0000","last_undegraded":"2024-04-01T02:12:53.479499+0000","last_fullsized":"2024-04-01T02:12:53.479499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1319","last_scrub_stamp":"2024-04-01T02:12:53.479431+0000","last_deep_scrub":"23'1319","last_deep_scrub_stamp":"2024-04-01T02:12:53.479431+0000","last_clean_scrub_stamp":"2024-04-01T02:12:53.479431+0000","objects_scrubbed":3,"log_size":1319,"log_dups_size":0,"ondisk_log_size":1319,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:57:47.002964+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1316,"num_write_kb":5169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"23'652","reported_seq":684,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:50.601666+0000","last_change":"2024-04-01T02:12:50.601722+0000","last_active":"2024-04-01T02:12:50.601666+0000","last_peered":"2024-04-01T02:12:50.601666+0000","last_clean":"2024-04-01T02:12:50.601666+0000","last_became_active":"2024-04-01T01:55:49.261286+0000","last_became_peered":"2024-04-01T01:55:49.261286+0000","last_unstale":"2024-04-01T02:12:50.601666+0000","last_undegraded":"2024-04-01T02:12:50.601666+0000","last_fullsized":"2024-04-01T02:12:50.601666+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'652","last_scrub_stamp":"2024-04-01T02:12:50.601555+0000","last_deep_scrub":"23'652","last_deep_scrub_stamp":"2024-04-01T02:12:50.601555+0000","last_clean_scrub_stamp":"2024-04-01T02:12:50.601555+0000","objects_scrubbed":10,"log_size":652,"log_dups_size":0,"ondisk_log_size":652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:09:44.845580+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3031627,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":532,"num_write_kb":22303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"23'1660","reported_seq":1694,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:49.438804+0000","last_change":"2024-04-01T02:12:49.438804+0000","last_active":"2024-04-01T02:12:49.438804+0000","last_peered":"2024-04-01T02:12:49.438804+0000","last_clean":"2024-04-01T02:12:49.438804+0000","last_became_active":"2024-04-01T01:55:48.219107+0000","last_became_peered":"2024-04-01T01:55:48.219107+0000","last_unstale":"2024-04-01T02:12:49.438804+0000","last_undegraded":"2024-04-01T02:12:49.438804+0000","last_fullsized":"2024-04-01T02:12:49.438804+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1659","last_scrub_stamp":"2024-04-01T02:12:49.438628+0000","last_deep_scrub":"23'1659","last_deep_scrub_stamp":"2024-04-01T02:12:49.438628+0000","last_clean_scrub_stamp":"2024-04-01T02:12:49.438628+0000","objects_scrubbed":6,"log_size":1660,"log_dups_size":0,"ondisk_log_size":1660,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:23:33.089557+0000","scrub_duration":79,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1652,"num_write_kb":13026,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"23'485","reported_seq":517,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:57.175832+0000","last_change":"2024-04-01T02:12:57.175902+0000","last_active":"2024-04-01T02:12:57.175832+0000","last_peered":"2024-04-01T02:12:57.175832+0000","last_clean":"2024-04-01T02:12:57.175832+0000","last_became_active":"2024-04-01T01:55:49.247910+0000","last_became_peered":"2024-04-01T01:55:49.247910+0000","last_unstale":"2024-04-01T02:12:57.175832+0000","last_undegraded":"2024-04-01T02:12:57.175832+0000","last_fullsized":"2024-04-01T02:12:57.175832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'485","last_scrub_stamp":"2024-04-01T02:12:57.175667+0000","last_deep_scrub":"23'485","last_deep_scrub_stamp":"2024-04-01T02:12:57.175667+0000","last_clean_scrub_stamp":"2024-04-01T02:12:57.175667+0000","objects_scrubbed":7,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:59:00.273204+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3214612,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":324,"num_write_kb":15075,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"23'1310","reported_seq":1344,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:51.459075+0000","last_change":"2024-04-01T02:12:51.459151+0000","last_active":"2024-04-01T02:12:51.459075+0000","last_peered":"2024-04-01T02:12:51.459075+0000","last_clean":"2024-04-01T02:12:51.459075+0000","last_became_active":"2024-04-01T01:55:48.214669+0000","last_became_peered":"2024-04-01T01:55:48.214669+0000","last_unstale":"2024-04-01T02:12:51.459075+0000","last_undegraded":"2024-04-01T02:12:51.459075+0000","last_fullsized":"2024-04-01T02:12:51.459075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1310","last_scrub_stamp":"2024-04-01T02:12:51.458907+0000","last_deep_scrub":"23'1310","last_deep_scrub_stamp":"2024-04-01T02:12:51.458907+0000","last_clean_scrub_stamp":"2024-04-01T02:12:51.458907+0000","objects_scrubbed":4,"log_size":1310,"log_dups_size":0,"ondisk_log_size":1310,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:13:21.121375+0000","scrub_duration":55,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1305,"num_write_kb":8736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"23'512","reported_seq":544,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:59.354764+0000","last_change":"2024-04-01T02:12:59.354857+0000","last_active":"2024-04-01T02:12:59.354764+0000","last_peered":"2024-04-01T02:12:59.354764+0000","last_clean":"2024-04-01T02:12:59.354764+0000","last_became_active":"2024-04-01T01:55:49.269840+0000","last_became_peered":"2024-04-01T01:55:49.269840+0000","last_unstale":"2024-04-01T02:12:59.354764+0000","last_undegraded":"2024-04-01T02:12:59.354764+0000","last_fullsized":"2024-04-01T02:12:59.354764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'512","last_scrub_stamp":"2024-04-01T02:12:59.354603+0000","last_deep_scrub":"23'512","last_deep_scrub_stamp":"2024-04-01T02:12:59.354603+0000","last_clean_scrub_stamp":"2024-04-01T02:12:59.354603+0000","objects_scrubbed":10,"log_size":512,"log_dups_size":0,"ondisk_log_size":512,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:09:53.598628+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2873887,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":372,"num_write_kb":10690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":34,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:56.673956+0000","last_change":"2024-04-01T02:12:56.674010+0000","last_active":"2024-04-01T02:12:56.673956+0000","last_peered":"2024-04-01T02:12:56.673956+0000","last_clean":"2024-04-01T02:12:56.673956+0000","last_became_active":"2024-04-01T01:55:48.213463+0000","last_became_peered":"2024-04-01T01:55:48.213463+0000","last_unstale":"2024-04-01T02:12:56.673956+0000","last_undegraded":"2024-04-01T02:12:56.673956+0000","last_fullsized":"2024-04-01T02:12:56.673956+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T02:12:56.673768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T02:12:56.673768+0000","last_clean_scrub_stamp":"2024-04-01T02:12:56.673768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:58:59.771305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"23'705","reported_seq":737,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:13:06.789872+0000","last_change":"2024-04-01T02:13:06.789954+0000","last_active":"2024-04-01T02:13:06.789872+0000","last_peered":"2024-04-01T02:13:06.789872+0000","last_clean":"2024-04-01T02:13:06.789872+0000","last_became_active":"2024-04-01T01:55:49.274430+0000","last_became_peered":"2024-04-01T01:55:49.274430+0000","last_unstale":"2024-04-01T02:13:06.789872+0000","last_undegraded":"2024-04-01T02:13:06.789872+0000","last_fullsized":"2024-04-01T02:13:06.789872+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'705","last_scrub_stamp":"2024-04-01T02:13:06.789692+0000","last_deep_scrub":"23'705","last_deep_scrub_stamp":"2024-04-01T02:13:06.789692+0000","last_clean_scrub_stamp":"2024-04-01T02:13:06.789692+0000","objects_scrubbed":11,"log_size":705,"log_dups_size":0,"ondisk_log_size":705,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:59:40.095890+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1869911,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":559,"num_write_kb":109429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":34,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:50.202973+0000","last_change":"2024-04-01T02:12:50.203026+0000","last_active":"2024-04-01T02:12:50.202973+0000","last_peered":"2024-04-01T02:12:50.202973+0000","last_clean":"2024-04-01T02:12:50.202973+0000","last_became_active":"2024-04-01T01:55:48.210616+0000","last_became_peered":"2024-04-01T01:55:48.210616+0000","last_unstale":"2024-04-01T02:12:50.202973+0000","last_undegraded":"2024-04-01T02:12:50.202973+0000","last_fullsized":"2024-04-01T02:12:50.202973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T02:12:50.202776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T02:12:50.202776+0000","last_clean_scrub_stamp":"2024-04-01T02:12:50.202776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:12:40.918668+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"23'519","reported_seq":551,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:50.933021+0000","last_change":"2024-04-01T02:12:50.933055+0000","last_active":"2024-04-01T02:12:50.933021+0000","last_peered":"2024-04-01T02:12:50.933021+0000","last_clean":"2024-04-01T02:12:50.933021+0000","last_became_active":"2024-04-01T01:55:49.238805+0000","last_became_peered":"2024-04-01T01:55:49.238805+0000","last_unstale":"2024-04-01T02:12:50.933021+0000","last_undegraded":"2024-04-01T02:12:50.933021+0000","last_fullsized":"2024-04-01T02:12:50.933021+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'519","last_scrub_stamp":"2024-04-01T02:12:50.932942+0000","last_deep_scrub":"23'519","last_deep_scrub_stamp":"2024-04-01T02:12:50.932942+0000","last_clean_scrub_stamp":"2024-04-01T02:12:50.932942+0000","objects_scrubbed":8,"log_size":519,"log_dups_size":0,"ondisk_log_size":519,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:57:44.456475+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1821215,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":368,"num_write_kb":8386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"23'822","reported_seq":856,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:52.506276+0000","last_change":"2024-04-01T02:12:52.506342+0000","last_active":"2024-04-01T02:12:52.506276+0000","last_peered":"2024-04-01T02:12:52.506276+0000","last_clean":"2024-04-01T02:12:52.506276+0000","last_became_active":"2024-04-01T01:55:48.210893+0000","last_became_peered":"2024-04-01T01:55:48.210893+0000","last_unstale":"2024-04-01T02:12:52.506276+0000","last_undegraded":"2024-04-01T02:12:52.506276+0000","last_fullsized":"2024-04-01T02:12:52.506276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'822","last_scrub_stamp":"2024-04-01T02:12:52.506140+0000","last_deep_scrub":"23'822","last_deep_scrub_stamp":"2024-04-01T02:12:52.506140+0000","last_clean_scrub_stamp":"2024-04-01T02:12:52.506140+0000","objects_scrubbed":6,"log_size":822,"log_dups_size":0,"ondisk_log_size":822,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:48:46.795985+0000","scrub_duration":59,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":818,"num_write_kb":8585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"23'615","reported_seq":647,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:52.646996+0000","last_change":"2024-04-01T02:12:52.647079+0000","last_active":"2024-04-01T02:12:52.646996+0000","last_peered":"2024-04-01T02:12:52.646996+0000","last_clean":"2024-04-01T02:12:52.646996+0000","last_became_active":"2024-04-01T01:55:49.261517+0000","last_became_peered":"2024-04-01T01:55:49.261517+0000","last_unstale":"2024-04-01T02:12:52.646996+0000","last_undegraded":"2024-04-01T02:12:52.646996+0000","last_fullsized":"2024-04-01T02:12:52.646996+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'615","last_scrub_stamp":"2024-04-01T02:12:52.646822+0000","last_deep_scrub":"23'615","last_deep_scrub_stamp":"2024-04-01T02:12:52.646822+0000","last_clean_scrub_stamp":"2024-04-01T02:12:52.646822+0000","objects_scrubbed":11,"log_size":615,"log_dups_size":0,"ondisk_log_size":615,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:42:59.363957+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5805184,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":464,"num_write_kb":32813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"23'424","reported_seq":458,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:48.292847+0000","last_change":"2024-04-01T02:12:48.292898+0000","last_active":"2024-04-01T02:12:48.292847+0000","last_peered":"2024-04-01T02:12:48.292847+0000","last_clean":"2024-04-01T02:12:48.292847+0000","last_became_active":"2024-04-01T01:55:48.198319+0000","last_became_peered":"2024-04-01T01:55:48.198319+0000","last_unstale":"2024-04-01T02:12:48.292847+0000","last_undegraded":"2024-04-01T02:12:48.292847+0000","last_fullsized":"2024-04-01T02:12:48.292847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'424","last_scrub_stamp":"2024-04-01T02:12:48.292738+0000","last_deep_scrub":"23'424","last_deep_scrub_stamp":"2024-04-01T02:12:48.292738+0000","last_clean_scrub_stamp":"2024-04-01T02:12:48.292738+0000","objects_scrubbed":2,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:02:35.747733+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":421,"num_write_kb":4293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"23'527","reported_seq":559,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:52.362312+0000","last_change":"2024-04-01T02:12:52.362466+0000","last_active":"2024-04-01T02:12:52.362312+0000","last_peered":"2024-04-01T02:12:52.362312+0000","last_clean":"2024-04-01T02:12:52.362312+0000","last_became_active":"2024-04-01T01:55:49.265670+0000","last_became_peered":"2024-04-01T01:55:49.265670+0000","last_unstale":"2024-04-01T02:12:52.362312+0000","last_undegraded":"2024-04-01T02:12:52.362312+0000","last_fullsized":"2024-04-01T02:12:52.362312+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'527","last_scrub_stamp":"2024-04-01T02:12:52.362098+0000","last_deep_scrub":"23'527","last_deep_scrub_stamp":"2024-04-01T02:12:52.362098+0000","last_clean_scrub_stamp":"2024-04-01T02:12:52.362098+0000","objects_scrubbed":13,"log_size":527,"log_dups_size":0,"ondisk_log_size":527,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:04:43.893980+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4958208,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":395,"num_write_kb":11184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"23'502","reported_seq":536,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:53.460616+0000","last_change":"2024-04-01T02:12:53.460647+0000","last_active":"2024-04-01T02:12:53.460616+0000","last_peered":"2024-04-01T02:12:53.460616+0000","last_clean":"2024-04-01T02:12:53.460616+0000","last_became_active":"2024-04-01T01:55:48.218562+0000","last_became_peered":"2024-04-01T01:55:48.218562+0000","last_unstale":"2024-04-01T02:12:53.460616+0000","last_undegraded":"2024-04-01T02:12:53.460616+0000","last_fullsized":"2024-04-01T02:12:53.460616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'502","last_scrub_stamp":"2024-04-01T02:12:53.460542+0000","last_deep_scrub":"23'502","last_deep_scrub_stamp":"2024-04-01T02:12:53.460542+0000","last_clean_scrub_stamp":"2024-04-01T02:12:53.460542+0000","objects_scrubbed":2,"log_size":502,"log_dups_size":0,"ondisk_log_size":502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:02:40.915537+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":500,"num_write_kb":4281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"23'496","reported_seq":528,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:13:01.210631+0000","last_change":"2024-04-01T02:13:01.210709+0000","last_active":"2024-04-01T02:13:01.210631+0000","last_peered":"2024-04-01T02:13:01.210631+0000","last_clean":"2024-04-01T02:13:01.210631+0000","last_became_active":"2024-04-01T01:55:49.267502+0000","last_became_peered":"2024-04-01T01:55:49.267502+0000","last_unstale":"2024-04-01T02:13:01.210631+0000","last_undegraded":"2024-04-01T02:13:01.210631+0000","last_fullsized":"2024-04-01T02:13:01.210631+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'496","last_scrub_stamp":"2024-04-01T02:13:01.210465+0000","last_deep_scrub":"23'496","last_deep_scrub_stamp":"2024-04-01T02:13:01.210465+0000","last_clean_scrub_stamp":"2024-04-01T02:13:01.210465+0000","objects_scrubbed":7,"log_size":496,"log_dups_size":0,"ondisk_log_size":496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:24:59.137641+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2609152,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":355,"num_write_kb":9167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"23'654","reported_seq":688,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:51.957278+0000","last_change":"2024-04-01T02:12:51.957405+0000","last_active":"2024-04-01T02:12:51.957278+0000","last_peered":"2024-04-01T02:12:51.957278+0000","last_clean":"2024-04-01T02:12:51.957278+0000","last_became_active":"2024-04-01T01:55:48.215852+0000","last_became_peered":"2024-04-01T01:55:48.215852+0000","last_unstale":"2024-04-01T02:12:51.957278+0000","last_undegraded":"2024-04-01T02:12:51.957278+0000","last_fullsized":"2024-04-01T02:12:51.957278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'654","last_scrub_stamp":"2024-04-01T02:12:51.957066+0000","last_deep_scrub":"23'654","last_deep_scrub_stamp":"2024-04-01T02:12:51.957066+0000","last_clean_scrub_stamp":"2024-04-01T02:12:51.957066+0000","objects_scrubbed":2,"log_size":654,"log_dups_size":0,"ondisk_log_size":654,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:07:45.968003+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":651,"num_write_kb":4358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"23'543","reported_seq":575,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:58.223071+0000","last_change":"2024-04-01T02:12:58.223217+0000","last_active":"2024-04-01T02:12:58.223071+0000","last_peered":"2024-04-01T02:12:58.223071+0000","last_clean":"2024-04-01T02:12:58.223071+0000","last_became_active":"2024-04-01T01:55:49.255781+0000","last_became_peered":"2024-04-01T01:55:49.255781+0000","last_unstale":"2024-04-01T02:12:58.223071+0000","last_undegraded":"2024-04-01T02:12:58.223071+0000","last_fullsized":"2024-04-01T02:12:58.223071+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'543","last_scrub_stamp":"2024-04-01T02:12:58.222869+0000","last_deep_scrub":"23'543","last_deep_scrub_stamp":"2024-04-01T02:12:58.222869+0000","last_clean_scrub_stamp":"2024-04-01T02:12:58.222869+0000","objects_scrubbed":12,"log_size":543,"log_dups_size":0,"ondisk_log_size":543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:36:47.435317+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3486100,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384,"num_write_kb":10452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"23'483","reported_seq":517,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:52.290471+0000","last_change":"2024-04-01T02:12:52.290542+0000","last_active":"2024-04-01T02:12:52.290471+0000","last_peered":"2024-04-01T02:12:52.290471+0000","last_clean":"2024-04-01T02:12:52.290471+0000","last_became_active":"2024-04-01T01:55:48.215898+0000","last_became_peered":"2024-04-01T01:55:48.215898+0000","last_unstale":"2024-04-01T02:12:52.290471+0000","last_undegraded":"2024-04-01T02:12:52.290471+0000","last_fullsized":"2024-04-01T02:12:52.290471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'483","last_scrub_stamp":"2024-04-01T02:12:52.290324+0000","last_deep_scrub":"23'483","last_deep_scrub_stamp":"2024-04-01T02:12:52.290324+0000","last_clean_scrub_stamp":"2024-04-01T02:12:52.290324+0000","objects_scrubbed":1,"log_size":483,"log_dups_size":0,"ondisk_log_size":483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:04:43.822206+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":481,"num_write_kb":4326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"23'556","reported_seq":588,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:13:07.763836+0000","last_change":"2024-04-01T02:13:07.763935+0000","last_active":"2024-04-01T02:13:07.763836+0000","last_peered":"2024-04-01T02:13:07.763836+0000","last_clean":"2024-04-01T02:13:07.763836+0000","last_became_active":"2024-04-01T01:55:49.274600+0000","last_became_peered":"2024-04-01T01:55:49.274600+0000","last_unstale":"2024-04-01T02:13:07.763836+0000","last_undegraded":"2024-04-01T02:13:07.763836+0000","last_fullsized":"2024-04-01T02:13:07.763836+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'556","last_scrub_stamp":"2024-04-01T02:13:07.763649+0000","last_deep_scrub":"23'556","last_deep_scrub_stamp":"2024-04-01T02:13:07.763649+0000","last_clean_scrub_stamp":"2024-04-01T02:13:07.763649+0000","objects_scrubbed":13,"log_size":556,"log_dups_size":0,"ondisk_log_size":556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:02:29.383992+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3740270,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":421,"num_write_kb":13583,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"23'119","reported_seq":193,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:48.921533+0000","last_change":"2024-04-01T02:12:48.921568+0000","last_active":"2024-04-01T02:12:48.921533+0000","last_peered":"2024-04-01T02:12:48.921533+0000","last_clean":"2024-04-01T02:12:48.921533+0000","last_became_active":"2024-04-01T01:55:43.144882+0000","last_became_peered":"2024-04-01T01:55:43.144882+0000","last_unstale":"2024-04-01T02:12:48.921533+0000","last_undegraded":"2024-04-01T02:12:48.921533+0000","last_fullsized":"2024-04-01T02:12:48.921533+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'119","last_scrub_stamp":"2024-04-01T02:12:48.921455+0000","last_deep_scrub":"23'119","last_deep_scrub_stamp":"2024-04-01T02:12:48.921455+0000","last_clean_scrub_stamp":"2024-04-01T02:12:48.921455+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T05:13:18.583922+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"23'540","reported_seq":575,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:54.701297+0000","last_change":"2024-04-01T02:12:54.701365+0000","last_active":"2024-04-01T02:12:54.701297+0000","last_peered":"2024-04-01T02:12:54.701297+0000","last_clean":"2024-04-01T02:12:54.701297+0000","last_became_active":"2024-04-01T01:55:48.206293+0000","last_became_peered":"2024-04-01T01:55:48.206293+0000","last_unstale":"2024-04-01T02:12:54.701297+0000","last_undegraded":"2024-04-01T02:12:54.701297+0000","last_fullsized":"2024-04-01T02:12:54.701297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'540","last_scrub_stamp":"2024-04-01T02:12:54.701088+0000","last_deep_scrub":"23'540","last_deep_scrub_stamp":"2024-04-01T02:12:54.701088+0000","last_clean_scrub_stamp":"2024-04-01T02:12:54.701088+0000","objects_scrubbed":1,"log_size":540,"log_dups_size":0,"ondisk_log_size":540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T13:39:58.971329+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":538,"num_write_kb":4366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"23'483","reported_seq":516,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:13:01.338499+0000","last_change":"2024-04-01T02:13:01.338607+0000","last_active":"2024-04-01T02:13:01.338499+0000","last_peered":"2024-04-01T02:13:01.338499+0000","last_clean":"2024-04-01T02:13:01.338499+0000","last_became_active":"2024-04-01T01:55:49.273197+0000","last_became_peered":"2024-04-01T01:55:49.273197+0000","last_unstale":"2024-04-01T02:13:01.338499+0000","last_undegraded":"2024-04-01T02:13:01.338499+0000","last_fullsized":"2024-04-01T02:13:01.338499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'483","last_scrub_stamp":"2024-04-01T02:13:01.338312+0000","last_deep_scrub":"23'483","last_deep_scrub_stamp":"2024-04-01T02:13:01.338312+0000","last_clean_scrub_stamp":"2024-04-01T02:13:01.338312+0000","objects_scrubbed":9,"log_size":483,"log_dups_size":0,"ondisk_log_size":483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T13:40:05.608553+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2100352,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":362,"num_write_kb":7512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"23'1727","reported_seq":1762,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:57.758281+0000","last_change":"2024-04-01T02:12:57.758352+0000","last_active":"2024-04-01T02:12:57.758281+0000","last_peered":"2024-04-01T02:12:57.758281+0000","last_clean":"2024-04-01T02:12:57.758281+0000","last_became_active":"2024-04-01T01:55:48.213914+0000","last_became_peered":"2024-04-01T01:55:48.213914+0000","last_unstale":"2024-04-01T02:12:57.758281+0000","last_undegraded":"2024-04-01T02:12:57.758281+0000","last_fullsized":"2024-04-01T02:12:57.758281+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1727","last_scrub_stamp":"2024-04-01T02:12:57.758101+0000","last_deep_scrub":"23'1727","last_deep_scrub_stamp":"2024-04-01T02:12:57.758101+0000","last_clean_scrub_stamp":"2024-04-01T02:12:57.758101+0000","objects_scrubbed":3,"log_size":1727,"log_dups_size":0,"ondisk_log_size":1727,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:36:46.970549+0000","scrub_duration":79,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1721,"num_write_kb":12994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"23'532","reported_seq":565,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:13:00.349200+0000","last_change":"2024-04-01T02:13:00.349287+0000","last_active":"2024-04-01T02:13:00.349200+0000","last_peered":"2024-04-01T02:13:00.349200+0000","last_clean":"2024-04-01T02:13:00.349200+0000","last_became_active":"2024-04-01T01:55:49.271821+0000","last_became_peered":"2024-04-01T01:55:49.271821+0000","last_unstale":"2024-04-01T02:13:00.349200+0000","last_undegraded":"2024-04-01T02:13:00.349200+0000","last_fullsized":"2024-04-01T02:13:00.349200+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'532","last_scrub_stamp":"2024-04-01T02:13:00.349025+0000","last_deep_scrub":"23'532","last_deep_scrub_stamp":"2024-04-01T02:13:00.349025+0000","last_clean_scrub_stamp":"2024-04-01T02:13:00.349025+0000","objects_scrubbed":12,"log_size":532,"log_dups_size":0,"ondisk_log_size":532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:30:19.146214+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2398580,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":392,"num_write_kb":9213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"23'1760","reported_seq":3554,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:52.420558+0000","last_change":"2024-04-01T02:12:52.420629+0000","last_active":"2024-04-01T02:12:52.420558+0000","last_peered":"2024-04-01T02:12:52.420558+0000","last_clean":"2024-04-01T02:12:52.420558+0000","last_became_active":"2024-04-01T01:55:48.217516+0000","last_became_peered":"2024-04-01T01:55:48.217516+0000","last_unstale":"2024-04-01T02:12:52.420558+0000","last_undegraded":"2024-04-01T02:12:52.420558+0000","last_fullsized":"2024-04-01T02:12:52.420558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1760","last_scrub_stamp":"2024-04-01T02:12:52.420382+0000","last_deep_scrub":"23'1760","last_deep_scrub_stamp":"2024-04-01T02:12:52.420382+0000","last_clean_scrub_stamp":"2024-04-01T02:12:52.420382+0000","objects_scrubbed":1,"log_size":1760,"log_dups_size":0,"ondisk_log_size":1760,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:31:48.836121+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1520757,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1759,"num_read_kb":2743,"num_write":1759,"num_write_kb":2743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"23'587","reported_seq":620,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:58.859714+0000","last_change":"2024-04-01T02:12:58.859795+0000","last_active":"2024-04-01T02:12:58.859714+0000","last_peered":"2024-04-01T02:12:58.859714+0000","last_clean":"2024-04-01T02:12:58.859714+0000","last_became_active":"2024-04-01T01:55:49.246152+0000","last_became_peered":"2024-04-01T01:55:49.246152+0000","last_unstale":"2024-04-01T02:12:58.859714+0000","last_undegraded":"2024-04-01T02:12:58.859714+0000","last_fullsized":"2024-04-01T02:12:58.859714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'587","last_scrub_stamp":"2024-04-01T02:12:58.859539+0000","last_deep_scrub":"23'587","last_deep_scrub_stamp":"2024-04-01T02:12:58.859539+0000","last_clean_scrub_stamp":"2024-04-01T02:12:58.859539+0000","objects_scrubbed":12,"log_size":587,"log_dups_size":0,"ondisk_log_size":587,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:27:36.969086+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4683946,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":447,"num_write_kb":12840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"23'1296","reported_seq":1331,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:13:01.702366+0000","last_change":"2024-04-01T02:13:01.702436+0000","last_active":"2024-04-01T02:13:01.702366+0000","last_peered":"2024-04-01T02:13:01.702366+0000","last_clean":"2024-04-01T02:13:01.702366+0000","last_became_active":"2024-04-01T01:55:48.222414+0000","last_became_peered":"2024-04-01T01:55:48.222414+0000","last_unstale":"2024-04-01T02:13:01.702366+0000","last_undegraded":"2024-04-01T02:13:01.702366+0000","last_fullsized":"2024-04-01T02:13:01.702366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1296","last_scrub_stamp":"2024-04-01T02:13:01.702176+0000","last_deep_scrub":"23'1296","last_deep_scrub_stamp":"2024-04-01T02:13:01.702176+0000","last_clean_scrub_stamp":"2024-04-01T02:13:01.702176+0000","objects_scrubbed":2,"log_size":1296,"log_dups_size":0,"ondisk_log_size":1296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:03:40.540519+0000","scrub_duration":59,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1292,"num_write_kb":8711,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"23'515","reported_seq":548,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:56.180611+0000","last_change":"2024-04-01T02:12:56.180748+0000","last_active":"2024-04-01T02:12:56.180611+0000","last_peered":"2024-04-01T02:12:56.180611+0000","last_clean":"2024-04-01T02:12:56.180611+0000","last_became_active":"2024-04-01T01:55:49.247285+0000","last_became_peered":"2024-04-01T01:55:49.247285+0000","last_unstale":"2024-04-01T02:12:56.180611+0000","last_undegraded":"2024-04-01T02:12:56.180611+0000","last_fullsized":"2024-04-01T02:12:56.180611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'515","last_scrub_stamp":"2024-04-01T02:12:56.180390+0000","last_deep_scrub":"23'515","last_deep_scrub_stamp":"2024-04-01T02:12:56.180390+0000","last_clean_scrub_stamp":"2024-04-01T02:12:56.180390+0000","objects_scrubbed":8,"log_size":515,"log_dups_size":0,"ondisk_log_size":515,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T13:01:35.714931+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1905973,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":374,"num_write_kb":9925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"23'412","reported_seq":447,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:53.911067+0000","last_change":"2024-04-01T02:12:53.911111+0000","last_active":"2024-04-01T02:12:53.911067+0000","last_peered":"2024-04-01T02:12:53.911067+0000","last_clean":"2024-04-01T02:12:53.911067+0000","last_became_active":"2024-04-01T01:55:48.225487+0000","last_became_peered":"2024-04-01T01:55:48.225487+0000","last_unstale":"2024-04-01T02:12:53.911067+0000","last_undegraded":"2024-04-01T02:12:53.911067+0000","last_fullsized":"2024-04-01T02:12:53.911067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'412","last_scrub_stamp":"2024-04-01T02:12:53.910989+0000","last_deep_scrub":"23'412","last_deep_scrub_stamp":"2024-04-01T02:12:53.910989+0000","last_clean_scrub_stamp":"2024-04-01T02:12:53.910989+0000","objects_scrubbed":1,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:28:25.775332+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":410,"num_write_kb":4283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"23'568","reported_seq":601,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:51.364949+0000","last_change":"2024-04-01T02:12:51.364997+0000","last_active":"2024-04-01T02:12:51.364949+0000","last_peered":"2024-04-01T02:12:51.364949+0000","last_clean":"2024-04-01T02:12:51.364949+0000","last_became_active":"2024-04-01T01:55:49.264914+0000","last_became_peered":"2024-04-01T01:55:49.264914+0000","last_unstale":"2024-04-01T02:12:51.364949+0000","last_undegraded":"2024-04-01T02:12:51.364949+0000","last_fullsized":"2024-04-01T02:12:51.364949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'568","last_scrub_stamp":"2024-04-01T02:12:51.364864+0000","last_deep_scrub":"23'568","last_deep_scrub_stamp":"2024-04-01T02:12:51.364864+0000","last_clean_scrub_stamp":"2024-04-01T02:12:51.364864+0000","objects_scrubbed":12,"log_size":568,"log_dups_size":0,"ondisk_log_size":568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:19:19.092817+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3471816,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":416,"num_write_kb":10624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"23'811","reported_seq":846,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:53.680626+0000","last_change":"2024-04-01T02:12:53.680705+0000","last_active":"2024-04-01T02:12:53.680626+0000","last_peered":"2024-04-01T02:12:53.680626+0000","last_clean":"2024-04-01T02:12:53.680626+0000","last_became_active":"2024-04-01T01:55:48.226948+0000","last_became_peered":"2024-04-01T01:55:48.226948+0000","last_unstale":"2024-04-01T02:12:53.680626+0000","last_undegraded":"2024-04-01T02:12:53.680626+0000","last_fullsized":"2024-04-01T02:12:53.680626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'811","last_scrub_stamp":"2024-04-01T02:12:53.680443+0000","last_deep_scrub":"23'811","last_deep_scrub_stamp":"2024-04-01T02:12:53.680443+0000","last_clean_scrub_stamp":"2024-04-01T02:12:53.680443+0000","objects_scrubbed":2,"log_size":811,"log_dups_size":0,"ondisk_log_size":811,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:07:35.526494+0000","scrub_duration":63,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":807,"num_write_kb":8573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"23'586","reported_seq":619,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:54.302864+0000","last_change":"2024-04-01T02:12:54.302926+0000","last_active":"2024-04-01T02:12:54.302864+0000","last_peered":"2024-04-01T02:12:54.302864+0000","last_clean":"2024-04-01T02:12:54.302864+0000","last_became_active":"2024-04-01T01:55:49.241632+0000","last_became_peered":"2024-04-01T01:55:49.241632+0000","last_unstale":"2024-04-01T02:12:54.302864+0000","last_undegraded":"2024-04-01T02:12:54.302864+0000","last_fullsized":"2024-04-01T02:12:54.302864+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'586","last_scrub_stamp":"2024-04-01T02:12:54.302738+0000","last_deep_scrub":"23'586","last_deep_scrub_stamp":"2024-04-01T02:12:54.302738+0000","last_clean_scrub_stamp":"2024-04-01T02:12:54.302738+0000","objects_scrubbed":8,"log_size":586,"log_dups_size":0,"ondisk_log_size":586,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:50:42.742758+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1649698,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":453,"num_write_kb":12096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"23'923","reported_seq":958,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:50.504306+0000","last_change":"2024-04-01T02:12:50.504306+0000","last_active":"2024-04-01T02:12:50.504306+0000","last_peered":"2024-04-01T02:12:50.504306+0000","last_clean":"2024-04-01T02:12:50.504306+0000","last_became_active":"2024-04-01T01:55:48.203576+0000","last_became_peered":"2024-04-01T01:55:48.203576+0000","last_unstale":"2024-04-01T02:12:50.504306+0000","last_undegraded":"2024-04-01T02:12:50.504306+0000","last_fullsized":"2024-04-01T02:12:50.504306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'923","last_scrub_stamp":"2024-04-01T02:12:50.503868+0000","last_deep_scrub":"23'923","last_deep_scrub_stamp":"2024-04-01T02:12:50.503868+0000","last_clean_scrub_stamp":"2024-04-01T02:12:50.503868+0000","objects_scrubbed":1,"log_size":923,"log_dups_size":0,"ondisk_log_size":923,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:04:42.035750+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2724,"num_write_kb":1428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"23'524","reported_seq":557,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:57.394753+0000","last_change":"2024-04-01T02:12:57.394753+0000","last_active":"2024-04-01T02:12:57.394753+0000","last_peered":"2024-04-01T02:12:57.394753+0000","last_clean":"2024-04-01T02:12:57.394753+0000","last_became_active":"2024-04-01T01:55:49.244632+0000","last_became_peered":"2024-04-01T01:55:49.244632+0000","last_unstale":"2024-04-01T02:12:57.394753+0000","last_undegraded":"2024-04-01T02:12:57.394753+0000","last_fullsized":"2024-04-01T02:12:57.394753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'524","last_scrub_stamp":"2024-04-01T02:12:57.394554+0000","last_deep_scrub":"23'524","last_deep_scrub_stamp":"2024-04-01T02:12:57.394554+0000","last_clean_scrub_stamp":"2024-04-01T02:12:57.394554+0000","objects_scrubbed":12,"log_size":524,"log_dups_size":0,"ondisk_log_size":524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:56:47.093266+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2231074,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":416,"num_write_kb":11781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"23'453","reported_seq":488,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:58.735951+0000","last_change":"2024-04-01T02:12:58.735951+0000","last_active":"2024-04-01T02:12:58.735951+0000","last_peered":"2024-04-01T02:12:58.735951+0000","last_clean":"2024-04-01T02:12:58.735951+0000","last_became_active":"2024-04-01T01:55:48.220889+0000","last_became_peered":"2024-04-01T01:55:48.220889+0000","last_unstale":"2024-04-01T02:12:58.735951+0000","last_undegraded":"2024-04-01T02:12:58.735951+0000","last_fullsized":"2024-04-01T02:12:58.735951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'453","last_scrub_stamp":"2024-04-01T02:12:58.735529+0000","last_deep_scrub":"23'453","last_deep_scrub_stamp":"2024-04-01T02:12:58.735529+0000","last_clean_scrub_stamp":"2024-04-01T02:12:58.735529+0000","objects_scrubbed":2,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:16:25.878981+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":451,"num_write_kb":4303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"23'580","reported_seq":613,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:13:00.297813+0000","last_change":"2024-04-01T02:13:00.297813+0000","last_active":"2024-04-01T02:13:00.297813+0000","last_peered":"2024-04-01T02:13:00.297813+0000","last_clean":"2024-04-01T02:13:00.297813+0000","last_became_active":"2024-04-01T01:55:49.251641+0000","last_became_peered":"2024-04-01T01:55:49.251641+0000","last_unstale":"2024-04-01T02:13:00.297813+0000","last_undegraded":"2024-04-01T02:13:00.297813+0000","last_fullsized":"2024-04-01T02:13:00.297813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'580","last_scrub_stamp":"2024-04-01T02:13:00.297565+0000","last_deep_scrub":"23'580","last_deep_scrub_stamp":"2024-04-01T02:13:00.297565+0000","last_clean_scrub_stamp":"2024-04-01T02:13:00.297565+0000","objects_scrubbed":6,"log_size":580,"log_dups_size":0,"ondisk_log_size":580,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:07:42.143616+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1372160,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":436,"num_write_kb":14438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"23'657","reported_seq":692,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:49.249951+0000","last_change":"2024-04-01T02:12:49.249951+0000","last_active":"2024-04-01T02:12:49.249951+0000","last_peered":"2024-04-01T02:12:49.249951+0000","last_clean":"2024-04-01T02:12:49.249951+0000","last_became_active":"2024-04-01T01:55:48.203828+0000","last_became_peered":"2024-04-01T01:55:48.203828+0000","last_unstale":"2024-04-01T02:12:49.249951+0000","last_undegraded":"2024-04-01T02:12:49.249951+0000","last_fullsized":"2024-04-01T02:12:49.249951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'657","last_scrub_stamp":"2024-04-01T02:12:49.249724+0000","last_deep_scrub":"23'657","last_deep_scrub_stamp":"2024-04-01T02:12:49.249724+0000","last_clean_scrub_stamp":"2024-04-01T02:12:49.249724+0000","objects_scrubbed":1,"log_size":657,"log_dups_size":0,"ondisk_log_size":657,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:19:32.566830+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":655,"num_write_kb":4360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"23'542","reported_seq":575,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:51.612177+0000","last_change":"2024-04-01T02:12:51.612177+0000","last_active":"2024-04-01T02:12:51.612177+0000","last_peered":"2024-04-01T02:12:51.612177+0000","last_clean":"2024-04-01T02:12:51.612177+0000","last_became_active":"2024-04-01T01:55:49.259332+0000","last_became_peered":"2024-04-01T01:55:49.259332+0000","last_unstale":"2024-04-01T02:12:51.612177+0000","last_undegraded":"2024-04-01T02:12:51.612177+0000","last_fullsized":"2024-04-01T02:12:51.612177+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'542","last_scrub_stamp":"2024-04-01T02:12:51.612090+0000","last_deep_scrub":"23'542","last_deep_scrub_stamp":"2024-04-01T02:12:51.612090+0000","last_clean_scrub_stamp":"2024-04-01T02:12:51.612090+0000","objects_scrubbed":8,"log_size":542,"log_dups_size":0,"ondisk_log_size":542,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:30:10.409279+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2628206,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":12728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"23'522","reported_seq":557,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:51.522928+0000","last_change":"2024-04-01T02:12:51.522928+0000","last_active":"2024-04-01T02:12:51.522928+0000","last_peered":"2024-04-01T02:12:51.522928+0000","last_clean":"2024-04-01T02:12:51.522928+0000","last_became_active":"2024-04-01T01:55:48.206027+0000","last_became_peered":"2024-04-01T01:55:48.206027+0000","last_unstale":"2024-04-01T02:12:51.522928+0000","last_undegraded":"2024-04-01T02:12:51.522928+0000","last_fullsized":"2024-04-01T02:12:51.522928+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'522","last_scrub_stamp":"2024-04-01T02:12:51.522525+0000","last_deep_scrub":"23'522","last_deep_scrub_stamp":"2024-04-01T02:12:51.522525+0000","last_clean_scrub_stamp":"2024-04-01T02:12:51.522525+0000","objects_scrubbed":1,"log_size":522,"log_dups_size":0,"ondisk_log_size":522,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:25:33.215345+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":520,"num_write_kb":4323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"23'500","reported_seq":533,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:58.363788+0000","last_change":"2024-04-01T02:12:58.363788+0000","last_active":"2024-04-01T02:12:58.363788+0000","last_peered":"2024-04-01T02:12:58.363788+0000","last_clean":"2024-04-01T02:12:58.363788+0000","last_became_active":"2024-04-01T01:55:49.245774+0000","last_became_peered":"2024-04-01T01:55:49.245774+0000","last_unstale":"2024-04-01T02:12:58.363788+0000","last_undegraded":"2024-04-01T02:12:58.363788+0000","last_fullsized":"2024-04-01T02:12:58.363788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'500","last_scrub_stamp":"2024-04-01T02:12:58.363552+0000","last_deep_scrub":"23'500","last_deep_scrub_stamp":"2024-04-01T02:12:58.363552+0000","last_clean_scrub_stamp":"2024-04-01T02:12:58.363552+0000","objects_scrubbed":10,"log_size":500,"log_dups_size":0,"ondisk_log_size":500,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:28:49.320418+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2457258,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":347,"num_write_kb":7703,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"23'733","reported_seq":768,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:53.354490+0000","last_change":"2024-04-01T02:12:53.354490+0000","last_active":"2024-04-01T02:12:53.354490+0000","last_peered":"2024-04-01T02:12:53.354490+0000","last_clean":"2024-04-01T02:12:53.354490+0000","last_became_active":"2024-04-01T01:55:48.221148+0000","last_became_peered":"2024-04-01T01:55:48.221148+0000","last_unstale":"2024-04-01T02:12:53.354490+0000","last_undegraded":"2024-04-01T02:12:53.354490+0000","last_fullsized":"2024-04-01T02:12:53.354490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'733","last_scrub_stamp":"2024-04-01T02:12:53.354291+0000","last_deep_scrub":"23'733","last_deep_scrub_stamp":"2024-04-01T02:12:53.354291+0000","last_clean_scrub_stamp":"2024-04-01T02:12:53.354291+0000","objects_scrubbed":2,"log_size":733,"log_dups_size":0,"ondisk_log_size":733,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:25:35.047111+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":729,"num_write_kb":8526,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"23'580","reported_seq":612,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:54.471168+0000","last_change":"2024-04-01T02:12:54.471204+0000","last_active":"2024-04-01T02:12:54.471168+0000","last_peered":"2024-04-01T02:12:54.471168+0000","last_clean":"2024-04-01T02:12:54.471168+0000","last_became_active":"2024-04-01T01:55:49.248925+0000","last_became_peered":"2024-04-01T01:55:49.248925+0000","last_unstale":"2024-04-01T02:12:54.471168+0000","last_undegraded":"2024-04-01T02:12:54.471168+0000","last_fullsized":"2024-04-01T02:12:54.471168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'580","last_scrub_stamp":"2024-04-01T02:12:54.471099+0000","last_deep_scrub":"23'580","last_deep_scrub_stamp":"2024-04-01T02:12:54.471099+0000","last_clean_scrub_stamp":"2024-04-01T02:12:54.471099+0000","objects_scrubbed":9,"log_size":580,"log_dups_size":0,"ondisk_log_size":580,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:39:03.226786+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4491912,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":426,"num_write_kb":28953,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"23'1473","reported_seq":1507,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:55.793973+0000","last_change":"2024-04-01T02:12:55.794098+0000","last_active":"2024-04-01T02:12:55.793973+0000","last_peered":"2024-04-01T02:12:55.793973+0000","last_clean":"2024-04-01T02:12:55.793973+0000","last_became_active":"2024-04-01T01:55:48.206856+0000","last_became_peered":"2024-04-01T01:55:48.206856+0000","last_unstale":"2024-04-01T02:12:55.793973+0000","last_undegraded":"2024-04-01T02:12:55.793973+0000","last_fullsized":"2024-04-01T02:12:55.793973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1473","last_scrub_stamp":"2024-04-01T02:12:55.793793+0000","last_deep_scrub":"23'1473","last_deep_scrub_stamp":"2024-04-01T02:12:55.793793+0000","last_clean_scrub_stamp":"2024-04-01T02:12:55.793793+0000","objects_scrubbed":4,"log_size":1473,"log_dups_size":0,"ondisk_log_size":1473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T13:01:35.328335+0000","scrub_duration":87,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1465,"num_write_kb":12919,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"23'568","reported_seq":601,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:13:05.762228+0000","last_change":"2024-04-01T02:13:05.762228+0000","last_active":"2024-04-01T02:13:05.762228+0000","last_peered":"2024-04-01T02:13:05.762228+0000","last_clean":"2024-04-01T02:13:05.762228+0000","last_became_active":"2024-04-01T01:55:49.270254+0000","last_became_peered":"2024-04-01T01:55:49.270254+0000","last_unstale":"2024-04-01T02:13:05.762228+0000","last_undegraded":"2024-04-01T02:13:05.762228+0000","last_fullsized":"2024-04-01T02:13:05.762228+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'568","last_scrub_stamp":"2024-04-01T02:13:05.761852+0000","last_deep_scrub":"23'568","last_deep_scrub_stamp":"2024-04-01T02:13:05.761852+0000","last_clean_scrub_stamp":"2024-04-01T02:13:05.761852+0000","objects_scrubbed":9,"log_size":568,"log_dups_size":0,"ondisk_log_size":568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:16:20.516938+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5269504,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":425,"num_write_kb":26844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"23'517","reported_seq":549,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:13:08.744334+0000","last_change":"2024-04-01T02:13:08.744334+0000","last_active":"2024-04-01T02:13:08.744334+0000","last_peered":"2024-04-01T02:13:08.744334+0000","last_clean":"2024-04-01T02:13:08.744334+0000","last_became_active":"2024-04-01T01:55:49.275050+0000","last_became_peered":"2024-04-01T01:55:49.275050+0000","last_unstale":"2024-04-01T02:13:08.744334+0000","last_undegraded":"2024-04-01T02:13:08.744334+0000","last_fullsized":"2024-04-01T02:13:08.744334+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'517","last_scrub_stamp":"2024-04-01T02:13:08.744050+0000","last_deep_scrub":"23'517","last_deep_scrub_stamp":"2024-04-01T02:13:08.744050+0000","last_clean_scrub_stamp":"2024-04-01T02:13:08.744050+0000","objects_scrubbed":10,"log_size":517,"log_dups_size":0,"ondisk_log_size":517,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T13:42:05.733977+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1932316,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":383,"num_write_kb":9512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"23'406","reported_seq":440,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:53.166388+0000","last_change":"2024-04-01T02:12:53.166388+0000","last_active":"2024-04-01T02:12:53.166388+0000","last_peered":"2024-04-01T02:12:53.166388+0000","last_clean":"2024-04-01T02:12:53.166388+0000","last_became_active":"2024-04-01T01:55:48.223220+0000","last_became_peered":"2024-04-01T01:55:48.223220+0000","last_unstale":"2024-04-01T02:12:53.166388+0000","last_undegraded":"2024-04-01T02:12:53.166388+0000","last_fullsized":"2024-04-01T02:12:53.166388+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'406","last_scrub_stamp":"2024-04-01T02:12:53.166028+0000","last_deep_scrub":"23'406","last_deep_scrub_stamp":"2024-04-01T02:12:53.166028+0000","last_clean_scrub_stamp":"2024-04-01T02:12:53.166028+0000","objects_scrubbed":2,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:28:44.122893+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":404,"num_write_kb":4216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"23'484","reported_seq":516,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:55.014221+0000","last_change":"2024-04-01T02:12:55.014221+0000","last_active":"2024-04-01T02:12:55.014221+0000","last_peered":"2024-04-01T02:12:55.014221+0000","last_clean":"2024-04-01T02:12:55.014221+0000","last_became_active":"2024-04-01T01:55:49.258478+0000","last_became_peered":"2024-04-01T01:55:49.258478+0000","last_unstale":"2024-04-01T02:12:55.014221+0000","last_undegraded":"2024-04-01T02:12:55.014221+0000","last_fullsized":"2024-04-01T02:12:55.014221+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'484","last_scrub_stamp":"2024-04-01T02:12:55.013953+0000","last_deep_scrub":"23'484","last_deep_scrub_stamp":"2024-04-01T02:12:55.013953+0000","last_clean_scrub_stamp":"2024-04-01T02:12:55.013953+0000","objects_scrubbed":10,"log_size":484,"log_dups_size":0,"ondisk_log_size":484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:52:32.944978+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2118876,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":354,"num_write_kb":10865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"23'1766","reported_seq":1800,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:52.214872+0000","last_change":"2024-04-01T02:12:52.214872+0000","last_active":"2024-04-01T02:12:52.214872+0000","last_peered":"2024-04-01T02:12:52.214872+0000","last_clean":"2024-04-01T02:12:52.214872+0000","last_became_active":"2024-04-01T01:55:48.217755+0000","last_became_peered":"2024-04-01T01:55:48.217755+0000","last_unstale":"2024-04-01T02:12:52.214872+0000","last_undegraded":"2024-04-01T02:12:52.214872+0000","last_fullsized":"2024-04-01T02:12:52.214872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1766","last_scrub_stamp":"2024-04-01T02:12:52.214626+0000","last_deep_scrub":"23'1766","last_deep_scrub_stamp":"2024-04-01T02:12:52.214626+0000","last_clean_scrub_stamp":"2024-04-01T02:12:52.214626+0000","objects_scrubbed":4,"log_size":1766,"log_dups_size":0,"ondisk_log_size":1766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:56:41.913339+0000","scrub_duration":87,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1758,"num_write_kb":13032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"23'616","reported_seq":649,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:55.879877+0000","last_change":"2024-04-01T02:12:55.879959+0000","last_active":"2024-04-01T02:12:55.879877+0000","last_peered":"2024-04-01T02:12:55.879877+0000","last_clean":"2024-04-01T02:12:55.879877+0000","last_became_active":"2024-04-01T01:55:49.242851+0000","last_became_peered":"2024-04-01T01:55:49.242851+0000","last_unstale":"2024-04-01T02:12:55.879877+0000","last_undegraded":"2024-04-01T02:12:55.879877+0000","last_fullsized":"2024-04-01T02:12:55.879877+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'616","last_scrub_stamp":"2024-04-01T02:12:55.879721+0000","last_deep_scrub":"23'616","last_deep_scrub_stamp":"2024-04-01T02:12:55.879721+0000","last_clean_scrub_stamp":"2024-04-01T02:12:55.879721+0000","objects_scrubbed":12,"log_size":616,"log_dups_size":0,"ondisk_log_size":616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:17:16.477687+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2501666,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":481,"num_write_kb":61542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"23'1143","reported_seq":1178,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:50.936804+0000","last_change":"2024-04-01T02:12:50.936836+0000","last_active":"2024-04-01T02:12:50.936804+0000","last_peered":"2024-04-01T02:12:50.936804+0000","last_clean":"2024-04-01T02:12:50.936804+0000","last_became_active":"2024-04-01T01:55:48.213122+0000","last_became_peered":"2024-04-01T01:55:48.213122+0000","last_unstale":"2024-04-01T02:12:50.936804+0000","last_undegraded":"2024-04-01T02:12:50.936804+0000","last_fullsized":"2024-04-01T02:12:50.936804+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1143","last_scrub_stamp":"2024-04-01T02:12:50.936731+0000","last_deep_scrub":"23'1143","last_deep_scrub_stamp":"2024-04-01T02:12:50.936731+0000","last_clean_scrub_stamp":"2024-04-01T02:12:50.936731+0000","objects_scrubbed":2,"log_size":1143,"log_dups_size":0,"ondisk_log_size":1143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:14:23.878647+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1140,"num_write_kb":8675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"23'572","reported_seq":605,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:13:03.844980+0000","last_change":"2024-04-01T02:13:03.845048+0000","last_active":"2024-04-01T02:13:03.844980+0000","last_peered":"2024-04-01T02:13:03.844980+0000","last_clean":"2024-04-01T02:13:03.844980+0000","last_became_active":"2024-04-01T01:55:49.251963+0000","last_became_peered":"2024-04-01T01:55:49.251963+0000","last_unstale":"2024-04-01T02:13:03.844980+0000","last_undegraded":"2024-04-01T02:13:03.844980+0000","last_fullsized":"2024-04-01T02:13:03.844980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'572","last_scrub_stamp":"2024-04-01T02:13:03.844810+0000","last_deep_scrub":"23'572","last_deep_scrub_stamp":"2024-04-01T02:13:03.844810+0000","last_clean_scrub_stamp":"2024-04-01T02:13:03.844810+0000","objects_scrubbed":5,"log_size":572,"log_dups_size":0,"ondisk_log_size":572,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:43:17.057627+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1665465,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":447,"num_write_kb":10082,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"23'998","reported_seq":1033,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-01T02:12:54.461524+0000","last_change":"2024-04-01T02:12:54.461653+0000","last_active":"2024-04-01T02:12:54.461524+0000","last_peered":"2024-04-01T02:12:54.461524+0000","last_clean":"2024-04-01T02:12:54.461524+0000","last_became_active":"2024-04-01T01:55:48.224494+0000","last_became_peered":"2024-04-01T01:55:48.224494+0000","last_unstale":"2024-04-01T02:12:54.461524+0000","last_undegraded":"2024-04-01T02:12:54.461524+0000","last_fullsized":"2024-04-01T02:12:54.461524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'998","last_scrub_stamp":"2024-04-01T02:12:54.461311+0000","last_deep_scrub":"23'998","last_deep_scrub_stamp":"2024-04-01T02:12:54.461311+0000","last_clean_scrub_stamp":"2024-04-01T02:12:54.461311+0000","objects_scrubbed":4,"log_size":998,"log_dups_size":0,"ondisk_log_size":998,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:19:37.778417+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389190,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":993,"num_write_kb":8588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":215832773,"num_objects":671,"num_object_clones":0,"num_object_copies":1342,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":671,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26120,"num_write_kb":1144114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":33914880,"data_stored":431659406,"data_compressed":20248526,"data_compressed_allocated":27738112,"data_compressed_original":427758424,"omap_allocated":0,"internal_metadata":0},"log_size":35178,"ondisk_log_size":35178,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":198627225,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":1759,"num_read_kb":2743,"num_write":29726,"num_write_kb":207983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":261431296,"data_stored":397254450,"data_compressed":36932112,"data_compressed_allocated":55713792,"data_compressed_original":191602688,"omap_allocated":0,"internal_metadata":0},"log_size":28033,"ondisk_log_size":28033,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66838,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509657,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":103636,"kb_used_data":23884,"kb_used_omap":1,"kb_used_meta":79742,"kb_avail":94268204,"statfs":{"total":96636764160,"available":96530640896,"internally_reserved":0,"allocated":24457216,"data_stored":69188313,"data_compressed":4487044,"data_compressed_allocated":6590464,"data_compressed_original":51672926,"omap_allocated":1590,"internal_metadata":81656266},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509658,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":119288,"kb_used_data":33968,"kb_used_omap":1,"kb_used_meta":85310,"kb_avail":94252552,"statfs":{"total":96636764160,"available":96514613248,"internally_reserved":0,"allocated":34783232,"data_stored":88936133,"data_compressed":7023647,"data_compressed_allocated":10317824,"data_compressed_original":64849434,"omap_allocated":1595,"internal_metadata":87357893},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509656,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":184340,"kb_used_data":62924,"kb_used_omap":1,"kb_used_meta":121406,"kb_avail":94187500,"statfs":{"total":96636764160,"available":96448000000,"internally_reserved":0,"allocated":64434176,"data_stored":165059531,"data_compressed":11682465,"data_compressed_allocated":17096704,"data_compressed_original":118219990,"omap_allocated":1592,"internal_metadata":124320200},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509657,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":93932,"kb_used_data":26660,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94277908,"statfs":{"total":96636764160,"available":96540577792,"internally_reserved":0,"allocated":27299840,"data_stored":94836675,"data_compressed":5914255,"data_compressed_allocated":8593408,"data_compressed_original":76574396,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509657,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":96400,"kb_used_data":29128,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94275440,"statfs":{"total":96636764160,"available":96538050560,"internally_reserved":0,"allocated":29827072,"data_stored":88082926,"data_compressed":5618475,"data_compressed_allocated":8155136,"data_compressed_original":66844186,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509656,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":166152,"kb_used_data":50304,"kb_used_omap":1,"kb_used_meta":115838,"kb_avail":94205688,"statfs":{"total":96636764160,"available":96466624512,"internally_reserved":0,"allocated":51511296,"data_stored":133601447,"data_compressed":9646909,"data_compressed_allocated":14168064,"data_compressed_original":96757598,"omap_allocated":1595,"internal_metadata":118618565},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542360,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":95764,"kb_used_data":24332,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94276076,"statfs":{"total":96636764160,"available":96538701824,"internally_reserved":0,"allocated":24915968,"data_stored":74736278,"data_compressed":5225453,"data_compressed_allocated":7524352,"data_compressed_original":57747294,"omap_allocated":1594,"internal_metadata":73136582},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575065,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":138384,"kb_used_data":39176,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":94233456,"statfs":{"total":96636764160,"available":96495058944,"internally_reserved":0,"allocated":40116224,"data_stored":116325977,"data_compressed":7649228,"data_compressed_allocated":11096064,"data_compressed_original":87842168,"omap_allocated":1595,"internal_metadata":101579205},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33419,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33419,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":46329856,"data_stored":71275934,"data_compressed":6727789,"data_compressed_allocated":10149888,"data_compressed_original":35106816,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":25587712,"data_stored":37748806,"data_compressed":3257537,"data_compressed_allocated":4939776,"data_compressed_original":17104896,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":22360064,"data_stored":33555104,"data_compressed":3040138,"data_compressed_allocated":4640768,"data_compressed_original":15843328,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":58339328,"data_stored":88053676,"data_compressed":8070060,"data_compressed_allocated":12161024,"data_compressed_original":41881600,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":31485952,"data_stored":50332992,"data_compressed":5217803,"data_compressed_allocated":7843840,"data_compressed_original":26705920,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":34701312,"data_stored":51852497,"data_compressed":4625369,"data_compressed_allocated":6967296,"data_compressed_original":24129536,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":21364736,"data_stored":33554432,"data_compressed":3299283,"data_compressed_allocated":4878336,"data_compressed_original":17068032,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":21262336,"data_stored":30881009,"data_compressed":2694133,"data_compressed_allocated":4132864,"data_compressed_original":13762560,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4947968,"data_stored":62241427,"data_compressed":2919120,"data_compressed_allocated":4018176,"data_compressed_original":61650782,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3940352,"data_stored":49659666,"data_compressed":2327519,"data_compressed_allocated":3170304,"data_compressed_original":49165850,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4706304,"data_stored":61197485,"data_compressed":2874117,"data_compressed_allocated":3952640,"data_compressed_original":60731068,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":5861376,"data_stored":76921769,"data_compressed":3612405,"data_compressed_allocated":4935680,"data_compressed_original":76338390,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":3063808,"data_stored":38519055,"data_compressed":1805844,"data_compressed_allocated":2473984,"data_compressed_original":38143514,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":5115904,"data_stored":63799026,"data_compressed":2990440,"data_compressed_allocated":4083712,"data_compressed_original":63139192,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":3317760,"data_stored":41097760,"data_compressed":1926170,"data_compressed_allocated":2646016,"data_compressed_original":40679262,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":2961408,"data_stored":38223218,"data_compressed":1792911,"data_compressed_allocated":2457600,"data_compressed_original":37910366,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-01T02:13:32.317 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-01T02:13:32.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.479+0000 7fb2953ed640 1 Processor -- start 2024-04-01T02:13:32.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.479+0000 7fb2953ed640 1 -- start start 2024-04-01T02:13:32.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.479+0000 7fb2953ed640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb29006fe70 0x7fb290070290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:13:32.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.479+0000 7fb2953ed640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2900707d0 con 0x7fb2900c2af0 2024-04-01T02:13:32.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.479+0000 7fb2953ed640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb29015add0 con 0x7fb2900c3fe0 2024-04-01T02:13:32.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.479+0000 7fb2953ed640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fb290070bd0 con 0x7fb29006fe70 2024-04-01T02:13:32.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.479+0000 7fb28f7fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fb2900c2af0 0x7fb2900c2f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:40304/0 (socket says 172.21.15.50:40304) 2024-04-01T02:13:32.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.479+0000 7fb28f7fe640 1 -- 172.21.15.50:0/1555642821 learned_addr learned my addr 172.21.15.50:0/1555642821 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-04-01T02:13:32.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.479+0000 7fb28e7fc640 1 --2- 172.21.15.50:0/1555642821 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb29006fe70 0x7fb290070290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:13:32.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.479+0000 7fb28dffb640 1 -- 172.21.15.50:0/1555642821 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3861837487 0 0) 0x7fb2880014a0 con 0x7fb2900c2af0 2024-04-01T02:13:32.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.479+0000 7fb28dffb640 1 -- 172.21.15.50:0/1555642821 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb278003530 con 0x7fb2900c2af0 2024-04-01T02:13:32.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.479+0000 7fb28dffb640 1 -- 172.21.15.50:0/1555642821 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3391975742 0 0) 0x7fb278003530 con 0x7fb2900c2af0 2024-04-01T02:13:32.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.479+0000 7fb28dffb640 1 -- 172.21.15.50:0/1555642821 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb29006fe70 msgr2=0x7fb290070290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T02:13:32.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.479+0000 7fb28dffb640 1 --2- 172.21.15.50:0/1555642821 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb29006fe70 0x7fb290070290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:13:32.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.479+0000 7fb28dffb640 1 -- 172.21.15.50:0/1555642821 >> v1:172.21.15.97:6789/0 conn(0x7fb2900c3fe0 legacy=0x7fb2900cd710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:13:32.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.479+0000 7fb28dffb640 1 -- 172.21.15.50:0/1555642821 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb290159f70 con 0x7fb2900c2af0 2024-04-01T02:13:32.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.479+0000 7fb28dffb640 1 -- 172.21.15.50:0/1555642821 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2779672543 0 0) 0x7fb288001bd0 con 0x7fb2900c2af0 2024-04-01T02:13:32.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.479+0000 7fb28dffb640 1 -- 172.21.15.50:0/1555642821 >> v1:172.21.15.50:6789/0 conn(0x7fb2900c2af0 legacy=0x7fb2900c2f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:13:32.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.479+0000 7fb28dffb640 1 --2- 172.21.15.50:0/1555642821 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb2780039f0 0x7fb278003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:13:32.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.479+0000 7fb28dffb640 1 --2- 172.21.15.50:0/1555642821 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb29006fe70 0x7fb278004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:13:32.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.479+0000 7fb28dffb640 1 --2- 172.21.15.50:0/1555642821 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb278004d50 0x7fb2780051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:13:32.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.479+0000 7fb28dffb640 1 -- 172.21.15.50:0/1555642821 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb290070bd0 con 0x7fb278004d50 2024-04-01T02:13:32.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.479+0000 7fb28dffb640 1 -- 172.21.15.50:0/1555642821 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fb27800ba80 con 0x7fb2780039f0 2024-04-01T02:13:32.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.479+0000 7fb28dffb640 1 -- 172.21.15.50:0/1555642821 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fb27800bc80 con 0x7fb29006fe70 2024-04-01T02:13:32.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.479+0000 7fb28f7fe640 1 --2- 172.21.15.50:0/1555642821 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb278004d50 0x7fb2780051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:13:32.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.479+0000 7fb28effd640 1 --2- 172.21.15.50:0/1555642821 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb2780039f0 0x7fb278003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:13:32.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.479+0000 7fb28e7fc640 1 --2- 172.21.15.50:0/1555642821 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb29006fe70 0x7fb278004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:13:32.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.479+0000 7fb28f7fe640 1 -- 172.21.15.50:0/1555642821 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb29006fe70 msgr2=0x7fb278004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T02:13:32.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.479+0000 7fb28f7fe640 1 --2- 172.21.15.50:0/1555642821 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb29006fe70 0x7fb278004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:13:32.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.479+0000 7fb28f7fe640 1 -- 172.21.15.50:0/1555642821 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb2780039f0 msgr2=0x7fb278003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T02:13:32.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.479+0000 7fb28f7fe640 1 --2- 172.21.15.50:0/1555642821 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb2780039f0 0x7fb278003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:13:32.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.479+0000 7fb28f7fe640 1 -- 172.21.15.50:0/1555642821 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb278003530 con 0x7fb278004d50 2024-04-01T02:13:32.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.483+0000 7fb28f7fe640 1 --2- 172.21.15.50:0/1555642821 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb278004d50 0x7fb2780051d0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fb28800aa50 tx=0x7fb28801d380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45e812fdf6cec5ba server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:13:32.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.483+0000 7fb28dffb640 1 -- 172.21.15.50:0/1555642821 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb28800a670 con 0x7fb278004d50 2024-04-01T02:13:32.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.483+0000 7fb28dffb640 1 -- 172.21.15.50:0/1555642821 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2880ad630 con 0x7fb278004d50 2024-04-01T02:13:32.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.483+0000 7fb28dffb640 1 -- 172.21.15.50:0/1555642821 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2880ada20 con 0x7fb278004d50 2024-04-01T02:13:32.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.483+0000 7fb2953ed640 1 -- 172.21.15.50:0/1555642821 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb278004d50 msgr2=0x7fb2780051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:13:32.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.483+0000 7fb2953ed640 1 --2- 172.21.15.50:0/1555642821 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb278004d50 0x7fb2780051d0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fb28800aa50 tx=0x7fb28801d380 comp rx=0 tx=0).stop 2024-04-01T02:13:32.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.483+0000 7fb28f7fe640 1 -- 172.21.15.50:0/1555642821 reap_dead start 2024-04-01T02:13:32.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.483+0000 7fb2953ed640 1 -- 172.21.15.50:0/1555642821 shutdown_connections 2024-04-01T02:13:32.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.483+0000 7fb2953ed640 1 -- 172.21.15.50:0/1555642821 >> 172.21.15.50:0/1555642821 conn(0x7fb290067560 msgr2=0x7fb29006b220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T02:13:32.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.483+0000 7fb2953ed640 1 -- 172.21.15.50:0/1555642821 shutdown_connections 2024-04-01T02:13:32.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.483+0000 7fb2953ed640 1 -- 172.21.15.50:0/1555642821 wait complete. 2024-04-01T02:13:32.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.483+0000 7fb2953ed640 1 Processor -- start 2024-04-01T02:13:32.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.487+0000 7fb2953ed640 1 -- start start 2024-04-01T02:13:32.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.487+0000 7fb2953ed640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb2901f6580 0x7fb290157030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:13:32.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.487+0000 7fb2953ed640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb290153f50 0x7fb2901f6960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:13:32.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.487+0000 7fb2953ed640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb2901f6ea0 0x7fb290157a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:13:32.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.487+0000 7fb2953ed640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb2900c43c0 con 0x7fb290153f50 2024-04-01T02:13:32.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.487+0000 7fb2953ed640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fb29015aaf0 con 0x7fb2901f6ea0 2024-04-01T02:13:32.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.487+0000 7fb2953ed640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fb29006da80 con 0x7fb2901f6580 2024-04-01T02:13:32.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.487+0000 7fb28e7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb290153f50 0x7fb2901f6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:13:32.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.487+0000 7fb28e7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb290153f50 0x7fb2901f6960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56228/0 (socket says 172.21.15.50:56228) 2024-04-01T02:13:32.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.487+0000 7fb28e7fc640 1 -- 172.21.15.50:0/3683534540 learned_addr learned my addr 172.21.15.50:0/3683534540 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T02:13:32.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.487+0000 7fb28effd640 1 --2- 172.21.15.50:0/3683534540 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb2901f6580 0x7fb290157030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:13:32.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.487+0000 7fb28f7fe640 1 --2- 172.21.15.50:0/3683534540 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb2901f6ea0 0x7fb290157a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:13:32.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.487+0000 7fb28e7fc640 1 -- 172.21.15.50:0/3683534540 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb2901f6580 msgr2=0x7fb290157030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:13:32.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.487+0000 7fb28e7fc640 1 --2- 172.21.15.50:0/3683534540 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb2901f6580 0x7fb290157030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:13:32.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.487+0000 7fb28e7fc640 1 -- 172.21.15.50:0/3683534540 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb2901f6ea0 msgr2=0x7fb290157a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:13:32.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.487+0000 7fb28e7fc640 1 --2- 172.21.15.50:0/3683534540 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb2901f6ea0 0x7fb290157a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:13:32.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.487+0000 7fb28e7fc640 1 -- 172.21.15.50:0/3683534540 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2900c9d80 con 0x7fb290153f50 2024-04-01T02:13:32.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.487+0000 7fb28effd640 1 --2- 172.21.15.50:0/3683534540 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb2901f6580 0x7fb290157030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T02:13:32.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.487+0000 7fb28e7fc640 1 --2- 172.21.15.50:0/3683534540 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb290153f50 0x7fb2901f6960 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fb284011a30 tx=0x7fb284011ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:13:32.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.487+0000 7fb2777fe640 1 -- 172.21.15.50:0/3683534540 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb28400fbb0 con 0x7fb290153f50 2024-04-01T02:13:32.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.487+0000 7fb2777fe640 1 -- 172.21.15.50:0/3683534540 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb28400fd50 con 0x7fb290153f50 2024-04-01T02:13:32.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.487+0000 7fb2777fe640 1 -- 172.21.15.50:0/3683534540 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb284014680 con 0x7fb290153f50 2024-04-01T02:13:32.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.487+0000 7fb2953ed640 1 -- 172.21.15.50:0/3683534540 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2900ca060 con 0x7fb290153f50 2024-04-01T02:13:32.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.487+0000 7fb2953ed640 1 -- 172.21.15.50:0/3683534540 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2900cd2d0 con 0x7fb290153f50 2024-04-01T02:13:32.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.487+0000 7fb2953ed640 1 -- 172.21.15.50:0/3683534540 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2900ccde0 con 0x7fb290153f50 2024-04-01T02:13:32.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.487+0000 7fb2777fe640 1 -- 172.21.15.50:0/3683534540 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 87103+0+0 (secure 0 0 0) 0x7fb284012040 con 0x7fb290153f50 2024-04-01T02:13:32.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.487+0000 7fb2777fe640 1 --2- 172.21.15.50:0/3683534540 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fb27c067420 0x7fb27c0698e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:13:32.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.491+0000 7fb2777fe640 1 -- 172.21.15.50:0/3683534540 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5738+0+0 (secure 0 0 0) 0x7fb284085d20 con 0x7fb290153f50 2024-04-01T02:13:32.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.491+0000 7fb28effd640 1 --2- 172.21.15.50:0/3683534540 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fb27c067420 0x7fb27c0698e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:13:32.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.491+0000 7fb28effd640 1 --2- 172.21.15.50:0/3683534540 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fb27c067420 0x7fb27c0698e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb280000c10 tx=0x7fb280009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:13:32.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.495+0000 7fb2777fe640 1 -- 172.21.15.50:0/3683534540 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+176632 (secure 0 0 0) 0x7fb284019030 con 0x7fb290153f50 2024-04-01T02:13:32.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.651+0000 7fb2953ed640 1 -- 172.21.15.50:0/3683534540 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7fb290068940 con 0x7fb290153f50 2024-04-01T02:13:32.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.655+0000 7fb2777fe640 1 -- 172.21.15.50:0/3683534540 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) ==== 123+0+0 (secure 0 0 0) 0x7fb284056bf0 con 0x7fb290153f50 2024-04-01T02:13:32.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.655+0000 7fb2777fe640 1 -- 172.21.15.50:0/3683534540 <== mon.0 v2:172.21.15.50:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fb284089030 con 0x7fb290153f50 2024-04-01T02:13:32.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.655+0000 7fb2953ed640 1 -- 172.21.15.50:0/3683534540 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fb27c067420 msgr2=0x7fb27c0698e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:13:32.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.655+0000 7fb2953ed640 1 --2- 172.21.15.50:0/3683534540 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fb27c067420 0x7fb27c0698e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb280000c10 tx=0x7fb280009040 comp rx=0 tx=0).stop 2024-04-01T02:13:32.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.655+0000 7fb2953ed640 1 -- 172.21.15.50:0/3683534540 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb290153f50 msgr2=0x7fb2901f6960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:13:32.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.655+0000 7fb2953ed640 1 --2- 172.21.15.50:0/3683534540 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb290153f50 0x7fb2901f6960 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fb284011a30 tx=0x7fb284011ef0 comp rx=0 tx=0).stop 2024-04-01T02:13:32.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.655+0000 7fb2953ed640 1 -- 172.21.15.50:0/3683534540 shutdown_connections 2024-04-01T02:13:32.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.655+0000 7fb2953ed640 1 --2- 172.21.15.50:0/3683534540 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7fb27c067420 0x7fb27c0698e0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:13:32.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.655+0000 7fb2953ed640 1 --2- 172.21.15.50:0/3683534540 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb2901f6ea0 0x7fb290157a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:13:32.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.655+0000 7fb2953ed640 1 --2- 172.21.15.50:0/3683534540 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb290153f50 0x7fb2901f6960 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:13:32.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.655+0000 7fb2953ed640 1 --2- 172.21.15.50:0/3683534540 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb2901f6580 0x7fb290157030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:13:32.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.655+0000 7fb2953ed640 1 -- 172.21.15.50:0/3683534540 >> 172.21.15.50:0/3683534540 conn(0x7fb290067560 msgr2=0x7fb2900af120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T02:13:32.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.655+0000 7fb2953ed640 1 -- 172.21.15.50:0/3683534540 shutdown_connections 2024-04-01T02:13:32.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.655+0000 7fb2953ed640 1 -- 172.21.15.50:0/3683534540 wait complete. 2024-04-01T02:13:32.669 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-01T02:13:32.669 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-01T02:13:32.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.795+0000 7f1870e5b640 1 Processor -- start 2024-04-01T02:13:32.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.795+0000 7f1870e5b640 1 -- start start 2024-04-01T02:13:32.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.799+0000 7f1870e5b640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f186c0c77c0 0x7f186c15a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:13:32.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.799+0000 7f1870e5b640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f186c156a20 con 0x7f186c0c73a0 2024-04-01T02:13:32.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.799+0000 7f1870e5b640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f186c156ce0 con 0x7f186c150e60 2024-04-01T02:13:32.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.799+0000 7f1870e5b640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f186c1578f0 con 0x7f186c0c77c0 2024-04-01T02:13:32.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.799+0000 7f1869d9b640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f186c0c73a0 0x7f186c0c2900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:40306/0 (socket says 172.21.15.50:40306) 2024-04-01T02:13:32.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.799+0000 7f1869d9b640 1 -- 172.21.15.50:0/2894787867 learned_addr learned my addr 172.21.15.50:0/2894787867 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-04-01T02:13:32.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.799+0000 7f186ad9d640 1 --2- 172.21.15.50:0/2894787867 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f186c0c77c0 0x7f186c15a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:13:32.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.799+0000 7f186959a640 1 -- 172.21.15.50:0/2894787867 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1420838590 0 0) 0x7f186c156a20 con 0x7f186c0c73a0 2024-04-01T02:13:32.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.799+0000 7f186959a640 1 -- 172.21.15.50:0/2894787867 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1854005740 con 0x7f186c0c73a0 2024-04-01T02:13:32.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.799+0000 7f186959a640 1 -- 172.21.15.50:0/2894787867 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3604496681 0 0) 0x7f1854005740 con 0x7f186c0c73a0 2024-04-01T02:13:32.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.799+0000 7f186959a640 1 -- 172.21.15.50:0/2894787867 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f186c0c77c0 msgr2=0x7f186c15a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T02:13:32.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.799+0000 7f186959a640 1 --2- 172.21.15.50:0/2894787867 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f186c0c77c0 0x7f186c15a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:13:32.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.799+0000 7f186959a640 1 -- 172.21.15.50:0/2894787867 >> v1:172.21.15.97:6789/0 conn(0x7f186c150e60 legacy=0x7f186c072f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:13:32.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.799+0000 7f186959a640 1 -- 172.21.15.50:0/2894787867 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f186c156fc0 con 0x7f186c0c73a0 2024-04-01T02:13:32.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.799+0000 7f186959a640 1 -- 172.21.15.50:0/2894787867 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2779672543 0 0) 0x7f1860001680 con 0x7f186c0c73a0 2024-04-01T02:13:32.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.799+0000 7f186959a640 1 -- 172.21.15.50:0/2894787867 >> v1:172.21.15.50:6789/0 conn(0x7f186c0c73a0 legacy=0x7f186c0c2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:13:32.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.799+0000 7f186959a640 1 --2- 172.21.15.50:0/2894787867 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1854005c00 0x7f1854005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:13:32.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.799+0000 7f186959a640 1 --2- 172.21.15.50:0/2894787867 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1854006560 0x7f1854006a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:13:32.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.799+0000 7f186959a640 1 --2- 172.21.15.50:0/2894787867 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1854007240 0x7f185400dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:13:32.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.799+0000 7f186959a640 1 -- 172.21.15.50:0/2894787867 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f186c1578f0 con 0x7f1854006560 2024-04-01T02:13:32.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.799+0000 7f186959a640 1 -- 172.21.15.50:0/2894787867 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f185400e150 con 0x7f1854007240 2024-04-01T02:13:32.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.799+0000 7f186959a640 1 -- 172.21.15.50:0/2894787867 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f185400e350 con 0x7f1854005c00 2024-04-01T02:13:32.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.799+0000 7f1869d9b640 1 --2- 172.21.15.50:0/2894787867 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1854006560 0x7f1854006a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:13:32.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.799+0000 7f186a59c640 1 --2- 172.21.15.50:0/2894787867 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1854005c00 0x7f1854005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:13:32.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.799+0000 7f186ad9d640 1 --2- 172.21.15.50:0/2894787867 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1854007240 0x7f185400dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:13:32.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.799+0000 7f1869d9b640 1 -- 172.21.15.50:0/2894787867 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1854005c00 msgr2=0x7f1854005fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T02:13:32.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.799+0000 7f1869d9b640 1 --2- 172.21.15.50:0/2894787867 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1854005c00 0x7f1854005fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:13:32.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.799+0000 7f1869d9b640 1 -- 172.21.15.50:0/2894787867 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1854007240 msgr2=0x7f185400dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T02:13:32.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.799+0000 7f1869d9b640 1 --2- 172.21.15.50:0/2894787867 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1854007240 0x7f185400dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:13:32.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.799+0000 7f1869d9b640 1 -- 172.21.15.50:0/2894787867 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1854005740 con 0x7f1854006560 2024-04-01T02:13:32.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.799+0000 7f1869d9b640 1 --2- 172.21.15.50:0/2894787867 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1854006560 0x7f1854006a40 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f186000c210 tx=0x7f186001cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4752a3c967b4c481 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:13:32.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.799+0000 7f186959a640 1 -- 172.21.15.50:0/2894787867 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1860007d40 con 0x7f1854006560 2024-04-01T02:13:32.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.799+0000 7f186959a640 1 -- 172.21.15.50:0/2894787867 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f18600a9070 con 0x7f1854006560 2024-04-01T02:13:32.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.799+0000 7f186959a640 1 -- 172.21.15.50:0/2894787867 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18600a5e60 con 0x7f1854006560 2024-04-01T02:13:32.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.803+0000 7f1870e5b640 1 -- 172.21.15.50:0/2894787867 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1854006560 msgr2=0x7f1854006a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:13:32.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.803+0000 7f1870e5b640 1 --2- 172.21.15.50:0/2894787867 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1854006560 0x7f1854006a40 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f186000c210 tx=0x7f186001cca0 comp rx=0 tx=0).stop 2024-04-01T02:13:32.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.803+0000 7f186ad9d640 1 -- 172.21.15.50:0/2894787867 reap_dead start 2024-04-01T02:13:32.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.803+0000 7f1870e5b640 1 -- 172.21.15.50:0/2894787867 shutdown_connections 2024-04-01T02:13:32.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.803+0000 7f1870e5b640 1 -- 172.21.15.50:0/2894787867 >> 172.21.15.50:0/2894787867 conn(0x7f186c067560 msgr2=0x7f186c06b220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T02:13:32.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.803+0000 7f1870e5b640 1 -- 172.21.15.50:0/2894787867 shutdown_connections 2024-04-01T02:13:32.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.803+0000 7f1870e5b640 1 -- 172.21.15.50:0/2894787867 wait complete. 2024-04-01T02:13:32.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.803+0000 7f1870e5b640 1 Processor -- start 2024-04-01T02:13:32.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.803+0000 7f1870e5b640 1 -- start start 2024-04-01T02:13:32.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.803+0000 7f1870e5b640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1854006560 0x7f186c144540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:13:32.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.803+0000 7f1870e5b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f186c159a30 0x7f186c1ebc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:13:32.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.803+0000 7f1870e5b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f186c142130 0x7f186c146310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:13:32.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.803+0000 7f1870e5b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f186c0c3010 con 0x7f186c142130 2024-04-01T02:13:32.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.803+0000 7f1870e5b640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f186c157580 con 0x7f186c159a30 2024-04-01T02:13:32.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.803+0000 7f1870e5b640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f186c0c3190 con 0x7f1854006560 2024-04-01T02:13:32.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.803+0000 7f186a59c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1854006560 0x7f186c144540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:13:32.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.803+0000 7f186ad9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f186c142130 0x7f186c146310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:13:32.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.803+0000 7f1869d9b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f186c159a30 0x7f186c1ebc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:13:32.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.803+0000 7f186ad9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f186c142130 0x7f186c146310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56256/0 (socket says 172.21.15.50:56256) 2024-04-01T02:13:32.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.803+0000 7f186a59c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1854006560 0x7f186c144540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.50:48788/0 (socket says 172.21.15.50:48788) 2024-04-01T02:13:32.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.803+0000 7f186ad9d640 1 -- 172.21.15.50:0/852929102 learned_addr learned my addr 172.21.15.50:0/852929102 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T02:13:32.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.803+0000 7f186ad9d640 1 -- 172.21.15.50:0/852929102 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1854006560 msgr2=0x7f186c144540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:13:32.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.803+0000 7f186ad9d640 1 --2- 172.21.15.50:0/852929102 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1854006560 0x7f186c144540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:13:32.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.803+0000 7f186ad9d640 1 -- 172.21.15.50:0/852929102 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f186c159a30 msgr2=0x7f186c1ebc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:13:32.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.803+0000 7f186ad9d640 1 --2- 172.21.15.50:0/852929102 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f186c159a30 0x7f186c1ebc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:13:32.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.803+0000 7f186ad9d640 1 -- 172.21.15.50:0/852929102 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f186c14ba20 con 0x7f186c142130 2024-04-01T02:13:32.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.803+0000 7f186ad9d640 1 --2- 172.21.15.50:0/852929102 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f186c142130 0x7f186c146310 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f186c06fe00 tx=0x7f18640115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:13:32.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.803+0000 7f185affd640 1 -- 172.21.15.50:0/852929102 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18640039a0 con 0x7f186c142130 2024-04-01T02:13:32.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.803+0000 7f185affd640 1 -- 172.21.15.50:0/852929102 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f186401b070 con 0x7f186c142130 2024-04-01T02:13:32.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.803+0000 7f185affd640 1 -- 172.21.15.50:0/852929102 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1864003ba0 con 0x7f186c142130 2024-04-01T02:13:32.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.803+0000 7f1870e5b640 1 -- 172.21.15.50:0/852929102 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f186c14bd00 con 0x7f186c142130 2024-04-01T02:13:32.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.803+0000 7f1870e5b640 1 -- 172.21.15.50:0/852929102 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f186c14c2c0 con 0x7f186c142130 2024-04-01T02:13:32.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.807+0000 7f1870e5b640 1 -- 172.21.15.50:0/852929102 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f186c068230 con 0x7f186c142130 2024-04-01T02:13:32.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.807+0000 7f185affd640 1 -- 172.21.15.50:0/852929102 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 87103+0+0 (secure 0 0 0) 0x7f1864004030 con 0x7f186c142130 2024-04-01T02:13:32.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.807+0000 7f185affd640 1 --2- 172.21.15.50:0/852929102 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f184c067450 0x7f184c069910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:13:32.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.807+0000 7f185affd640 1 -- 172.21.15.50:0/852929102 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5738+0+0 (secure 0 0 0) 0x7f1864085fc0 con 0x7f186c142130 2024-04-01T02:13:32.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.807+0000 7f186a59c640 1 --2- 172.21.15.50:0/852929102 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f184c067450 0x7f184c069910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:13:32.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.807+0000 7f186a59c640 1 --2- 172.21.15.50:0/852929102 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f184c067450 0x7f184c069910 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f185c001660 tx=0x7f185c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:13:32.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.811+0000 7f185affd640 1 -- 172.21.15.50:0/852929102 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+176632 (secure 0 0 0) 0x7f1864025020 con 0x7f186c142130 2024-04-01T02:13:32.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.995+0000 7f1870e5b640 1 -- 172.21.15.50:0/852929102 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f186c1569d0 con 0x7f186c142130 2024-04-01T02:13:32.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.999+0000 7f185affd640 1 -- 172.21.15.50:0/852929102 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+6815 (secure 0 0 0) 0x7f1864056660 con 0x7f186c142130 2024-04-01T02:13:32.994 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-01T02:13:32.997 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6839/3495253895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6837","nonce":3495253895},{"type":"v1","addr":"172.21.15.97:6839","nonce":3495253895}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6838/1055159165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":1055159165},{"type":"v1","addr":"172.21.15.97:6838","nonce":1055159165}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4251,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/716162893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":716162893},{"type":"v1","addr":"172.21.15.50:6833","nonce":716162893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6836/194873808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":194873808},{"type":"v1","addr":"172.21.15.50:6836","nonce":194873808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4264,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/2250920298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6835","nonce":2250920298},{"type":"v1","addr":"172.21.15.50:6837","nonce":2250920298}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-01T01:55:48.563827+0000","modified":"2024-04-01T01:55:51.631137+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.97:6835/974386562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":974386562},{"type":"v1","addr":"172.21.15.97:6835","nonce":974386562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4279]},"id":1}]} 2024-04-01T02:13:32.998 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 7 2024-04-01T02:13:32.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.999+0000 7f1870e5b640 1 -- 172.21.15.50:0/852929102 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f184c067450 msgr2=0x7f184c069910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:13:32.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.999+0000 7f1870e5b640 1 --2- 172.21.15.50:0/852929102 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f184c067450 0x7f184c069910 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f185c001660 tx=0x7f185c009040 comp rx=0 tx=0).stop 2024-04-01T02:13:32.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.999+0000 7f1870e5b640 1 -- 172.21.15.50:0/852929102 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f186c142130 msgr2=0x7f186c146310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:13:32.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.999+0000 7f1870e5b640 1 --2- 172.21.15.50:0/852929102 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f186c142130 0x7f186c146310 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f186c06fe00 tx=0x7f18640115a0 comp rx=0 tx=0).stop 2024-04-01T02:13:32.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.999+0000 7f1870e5b640 1 -- 172.21.15.50:0/852929102 shutdown_connections 2024-04-01T02:13:32.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.999+0000 7f1870e5b640 1 --2- 172.21.15.50:0/852929102 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f184c067450 0x7f184c069910 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:13:32.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.999+0000 7f1870e5b640 1 --2- 172.21.15.50:0/852929102 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f186c142130 0x7f186c146310 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:13:32.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.999+0000 7f1870e5b640 1 --2- 172.21.15.50:0/852929102 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f186c159a30 0x7f186c1ebc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:13:33.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.999+0000 7f1870e5b640 1 --2- 172.21.15.50:0/852929102 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1854006560 0x7f186c144540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:13:33.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.999+0000 7f1870e5b640 1 -- 172.21.15.50:0/852929102 >> 172.21.15.50:0/852929102 conn(0x7f186c067560 msgr2=0x7f186c0c50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T02:13:33.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.999+0000 7f1870e5b640 1 -- 172.21.15.50:0/852929102 shutdown_connections 2024-04-01T02:13:33.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:32.999+0000 7f1870e5b640 1 -- 172.21.15.50:0/852929102 wait complete. 2024-04-01T02:13:33.013 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-01T02:13:33.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.127+0000 7f6127203640 1 Processor -- start 2024-04-01T02:13:33.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.127+0000 7f6127203640 1 -- start start 2024-04-01T02:13:33.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.127+0000 7f6127203640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6120151de0 0x7f6120157be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:13:33.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.127+0000 7f6127203640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f6120158120 0x7f6120162560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:13:33.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.127+0000 7f6127203640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61200c30d0 con 0x7f61200c2900 2024-04-01T02:13:33.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.127+0000 7f6127203640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f612015b370 con 0x7f6120158120 2024-04-01T02:13:33.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.127+0000 7f6127203640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f612015c0f0 con 0x7f6120151de0 2024-04-01T02:13:33.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.127+0000 7f61257a0640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f6120158120 0x7f6120162560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:13:33.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.127+0000 7f61257a0640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f6120158120 0x7f6120162560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.50:45550/0 (socket says 172.21.15.50:45550) 2024-04-01T02:13:33.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.127+0000 7f61257a0640 1 -- 172.21.15.50:0/3715472426 learned_addr learned my addr 172.21.15.50:0/3715472426 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T02:13:33.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.127+0000 7f6124f9f640 1 --2- 172.21.15.50:0/3715472426 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6120151de0 0x7f6120157be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:13:33.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.127+0000 7f61257a0640 1 -- 172.21.15.50:0/3715472426 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6120151de0 msgr2=0x7f6120157be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T02:13:33.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.127+0000 7f61257a0640 1 --2- 172.21.15.50:0/3715472426 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6120151de0 0x7f6120157be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:13:33.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.127+0000 7f61257a0640 1 -- 172.21.15.50:0/3715472426 >> v1:172.21.15.97:6789/0 conn(0x7f61200c2900 legacy=0x7f61200c5f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:13:33.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.127+0000 7f61257a0640 1 -- 172.21.15.50:0/3715472426 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61200c2df0 con 0x7f6120158120 2024-04-01T02:13:33.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.131+0000 7f61257a0640 1 --2- 172.21.15.50:0/3715472426 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6120158120 0x7f6120162560 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6118009e50 tx=0x7f611801f210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d299805b6d3707d server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:13:33.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.131+0000 7f611f7fe640 1 -- 172.21.15.50:0/3715472426 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61180b4070 con 0x7f6120158120 2024-04-01T02:13:33.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.131+0000 7f611f7fe640 1 -- 172.21.15.50:0/3715472426 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f61180af400 con 0x7f6120158120 2024-04-01T02:13:33.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.131+0000 7f611f7fe640 1 -- 172.21.15.50:0/3715472426 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61180af7f0 con 0x7f6120158120 2024-04-01T02:13:33.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.131+0000 7f6127203640 1 -- 172.21.15.50:0/3715472426 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6120158120 msgr2=0x7f6120162560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:13:33.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.131+0000 7f6127203640 1 --2- 172.21.15.50:0/3715472426 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6120158120 0x7f6120162560 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6118009e50 tx=0x7f611801f210 comp rx=0 tx=0).stop 2024-04-01T02:13:33.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.131+0000 7f6127203640 1 -- 172.21.15.50:0/3715472426 shutdown_connections 2024-04-01T02:13:33.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.131+0000 7f6127203640 1 --2- 172.21.15.50:0/3715472426 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6120158120 0x7f6120162560 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:13:33.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.131+0000 7f6127203640 1 --2- 172.21.15.50:0/3715472426 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6120151de0 0x7f6120157be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:13:33.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.131+0000 7f6127203640 1 -- 172.21.15.50:0/3715472426 >> 172.21.15.50:0/3715472426 conn(0x7f6120067560 msgr2=0x7f612006b220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T02:13:33.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.131+0000 7f6127203640 1 -- 172.21.15.50:0/3715472426 shutdown_connections 2024-04-01T02:13:33.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.131+0000 7f6127203640 1 -- 172.21.15.50:0/3715472426 wait complete. 2024-04-01T02:13:33.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.131+0000 7f6127203640 1 Processor -- start 2024-04-01T02:13:33.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.131+0000 7f6127203640 1 -- start start 2024-04-01T02:13:33.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.135+0000 7f6127203640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f61200c2900 0x7f61201e32c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:13:33.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.135+0000 7f6127203640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6120151de0 0x7f6120159fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:13:33.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.135+0000 7f6127203640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6120158120 0x7f612015a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:13:33.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.135+0000 7f6127203640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f612015bbd0 con 0x7f6120158120 2024-04-01T02:13:33.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.135+0000 7f6127203640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f612015b8f0 con 0x7f6120151de0 2024-04-01T02:13:33.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.135+0000 7f6127203640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f61200c88a0 con 0x7f61200c2900 2024-04-01T02:13:33.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.135+0000 7f61257a0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6120158120 0x7f612015a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:13:33.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.135+0000 7f61257a0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6120158120 0x7f612015a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56270/0 (socket says 172.21.15.50:56270) 2024-04-01T02:13:33.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.135+0000 7f61257a0640 1 -- 172.21.15.50:0/2668964000 learned_addr learned my addr 172.21.15.50:0/2668964000 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T02:13:33.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.135+0000 7f611ffff640 1 --2- 172.21.15.50:0/2668964000 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6120151de0 0x7f6120159fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:13:33.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.135+0000 7f6124f9f640 1 --2- 172.21.15.50:0/2668964000 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f61200c2900 0x7f61201e32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:13:33.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.135+0000 7f61257a0640 1 -- 172.21.15.50:0/2668964000 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f61200c2900 msgr2=0x7f61201e32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:13:33.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.135+0000 7f61257a0640 1 --2- 172.21.15.50:0/2668964000 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f61200c2900 0x7f61201e32c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:13:33.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.135+0000 7f61257a0640 1 -- 172.21.15.50:0/2668964000 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6120151de0 msgr2=0x7f6120159fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:13:33.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.135+0000 7f61257a0640 1 --2- 172.21.15.50:0/2668964000 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6120151de0 0x7f6120159fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:13:33.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.135+0000 7f61257a0640 1 -- 172.21.15.50:0/2668964000 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61201e2330 con 0x7f6120158120 2024-04-01T02:13:33.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.135+0000 7f61257a0640 1 --2- 172.21.15.50:0/2668964000 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6120158120 0x7f612015a520 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f611801ce40 tx=0x7f611801bfb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:13:33.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.135+0000 7f611d7fa640 1 -- 172.21.15.50:0/2668964000 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61180c0070 con 0x7f6120158120 2024-04-01T02:13:33.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.135+0000 7f611d7fa640 1 -- 172.21.15.50:0/2668964000 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f61180090d0 con 0x7f6120158120 2024-04-01T02:13:33.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.135+0000 7f6127203640 1 -- 172.21.15.50:0/2668964000 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61201e25a0 con 0x7f6120158120 2024-04-01T02:13:33.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.135+0000 7f611d7fa640 1 -- 172.21.15.50:0/2668964000 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61180b4040 con 0x7f6120158120 2024-04-01T02:13:33.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.135+0000 7f6127203640 1 -- 172.21.15.50:0/2668964000 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61201e1390 con 0x7f6120158120 2024-04-01T02:13:33.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.135+0000 7f6127203640 1 -- 172.21.15.50:0/2668964000 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6120068230 con 0x7f6120158120 2024-04-01T02:13:33.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.135+0000 7f611d7fa640 1 -- 172.21.15.50:0/2668964000 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 87103+0+0 (secure 0 0 0) 0x7f61180a8d10 con 0x7f6120158120 2024-04-01T02:13:33.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.135+0000 7f611d7fa640 1 --2- 172.21.15.50:0/2668964000 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f610c067420 0x7f610c0698e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:13:33.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.139+0000 7f611d7fa640 1 -- 172.21.15.50:0/2668964000 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5738+0+0 (secure 0 0 0) 0x7f6118122cf0 con 0x7f6120158120 2024-04-01T02:13:33.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.139+0000 7f6124f9f640 1 --2- 172.21.15.50:0/2668964000 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f610c067420 0x7f610c0698e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:13:33.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.139+0000 7f6124f9f640 1 --2- 172.21.15.50:0/2668964000 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f610c067420 0x7f610c0698e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6110009af0 tx=0x7f6110008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:13:33.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.143+0000 7f611d7fa640 1 -- 172.21.15.50:0/2668964000 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+176632 (secure 0 0 0) 0x7f61180c9080 con 0x7f6120158120 2024-04-01T02:13:33.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.331+0000 7f6127203640 1 -- 172.21.15.50:0/2668964000 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f61201561b0 con 0x7f6120158120 2024-04-01T02:13:33.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.331+0000 7f611d7fa640 1 -- 172.21.15.50:0/2668964000 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+6815 (secure 0 0 0) 0x7f6118018d70 con 0x7f6120158120 2024-04-01T02:13:33.329 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-01T02:13:33.329 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6839/3495253895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6837","nonce":3495253895},{"type":"v1","addr":"172.21.15.97:6839","nonce":3495253895}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6838/1055159165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":1055159165},{"type":"v1","addr":"172.21.15.97:6838","nonce":1055159165}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4251,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/716162893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":716162893},{"type":"v1","addr":"172.21.15.50:6833","nonce":716162893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6836/194873808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":194873808},{"type":"v1","addr":"172.21.15.50:6836","nonce":194873808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4264,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/2250920298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6835","nonce":2250920298},{"type":"v1","addr":"172.21.15.50:6837","nonce":2250920298}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-01T01:55:48.563827+0000","modified":"2024-04-01T01:55:51.631137+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.97:6835/974386562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":974386562},{"type":"v1","addr":"172.21.15.97:6835","nonce":974386562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4279]},"id":1}]} 2024-04-01T02:13:33.330 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 7 2024-04-01T02:13:33.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.335+0000 7f6127203640 1 -- 172.21.15.50:0/2668964000 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f610c067420 msgr2=0x7f610c0698e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:13:33.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.335+0000 7f6127203640 1 --2- 172.21.15.50:0/2668964000 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f610c067420 0x7f610c0698e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6110009af0 tx=0x7f6110008040 comp rx=0 tx=0).stop 2024-04-01T02:13:33.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.335+0000 7f6127203640 1 -- 172.21.15.50:0/2668964000 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6120158120 msgr2=0x7f612015a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:13:33.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.335+0000 7f6127203640 1 --2- 172.21.15.50:0/2668964000 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6120158120 0x7f612015a520 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f611801ce40 tx=0x7f611801bfb0 comp rx=0 tx=0).stop 2024-04-01T02:13:33.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.335+0000 7f6127203640 1 -- 172.21.15.50:0/2668964000 shutdown_connections 2024-04-01T02:13:33.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.335+0000 7f6127203640 1 --2- 172.21.15.50:0/2668964000 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f610c067420 0x7f610c0698e0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:13:33.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.335+0000 7f6127203640 1 --2- 172.21.15.50:0/2668964000 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6120158120 0x7f612015a520 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:13:33.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.335+0000 7f6127203640 1 --2- 172.21.15.50:0/2668964000 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6120151de0 0x7f6120159fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:13:33.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.335+0000 7f6127203640 1 --2- 172.21.15.50:0/2668964000 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f61200c2900 0x7f61201e32c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:13:33.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.335+0000 7f6127203640 1 -- 172.21.15.50:0/2668964000 >> 172.21.15.50:0/2668964000 conn(0x7f6120067560 msgr2=0x7f6120150fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T02:13:33.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.335+0000 7f6127203640 1 -- 172.21.15.50:0/2668964000 shutdown_connections 2024-04-01T02:13:33.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.335+0000 7f6127203640 1 -- 172.21.15.50:0/2668964000 wait complete. 2024-04-01T02:13:33.348 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-01T02:13:33.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.467+0000 7f2df4f33640 1 Processor -- start 2024-04-01T02:13:33.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.467+0000 7f2df4f33640 1 -- start start 2024-04-01T02:13:33.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.467+0000 7f2df4f33640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f2df0154200 0x7f2df00cb780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:13:33.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.467+0000 7f2df4f33640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2df00c4ab0 0x7f2df00cc180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:13:33.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.467+0000 7f2df4f33640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2df00cc6c0 0x7f2df006c480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:13:33.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.467+0000 7f2df4f33640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f2df015dd70 con 0x7f2df00c4ab0 2024-04-01T02:13:33.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.467+0000 7f2df4f33640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f2df00caae0 con 0x7f2df0154200 2024-04-01T02:13:33.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.467+0000 7f2df4f33640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f2df01545e0 con 0x7f2df00cc6c0 2024-04-01T02:13:33.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.467+0000 7f2dedd9b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2df00c4ab0 0x7f2df00cc180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:13:33.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.467+0000 7f2dedd9b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2df00c4ab0 0x7f2df00cc180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56272/0 (socket says 172.21.15.50:56272) 2024-04-01T02:13:33.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.467+0000 7f2dedd9b640 1 -- 172.21.15.50:0/3741595977 learned_addr learned my addr 172.21.15.50:0/3741595977 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T02:13:33.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.467+0000 7f2dee59c640 1 --2- 172.21.15.50:0/3741595977 >> v2:172.21.15.97:3300/0 conn(0x7f2df0154200 0x7f2df00cb780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:13:33.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.467+0000 7f2deed9d640 1 --2- 172.21.15.50:0/3741595977 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2df00cc6c0 0x7f2df006c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:13:33.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.467+0000 7f2dedd9b640 1 -- 172.21.15.50:0/3741595977 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2df00cc6c0 msgr2=0x7f2df006c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T02:13:33.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.467+0000 7f2dedd9b640 1 --2- 172.21.15.50:0/3741595977 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2df00cc6c0 0x7f2df006c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:13:33.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.467+0000 7f2dedd9b640 1 -- 172.21.15.50:0/3741595977 >> v2:172.21.15.97:3300/0 conn(0x7f2df0154200 msgr2=0x7f2df00cb780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T02:13:33.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.467+0000 7f2dedd9b640 1 --2- 172.21.15.50:0/3741595977 >> v2:172.21.15.97:3300/0 conn(0x7f2df0154200 0x7f2df00cb780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:13:33.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.467+0000 7f2dedd9b640 1 -- 172.21.15.50:0/3741595977 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2df015e290 con 0x7f2df00c4ab0 2024-04-01T02:13:33.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.471+0000 7f2dedd9b640 1 --2- 172.21.15.50:0/3741595977 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2df00c4ab0 0x7f2df00cc180 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f2df00cce80 tx=0x7f2dd801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc390cf65a235523 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:13:33.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.471+0000 7f2ded59a640 1 -- 172.21.15.50:0/3741595977 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dd80b1070 con 0x7f2df00c4ab0 2024-04-01T02:13:33.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.471+0000 7f2ded59a640 1 -- 172.21.15.50:0/3741595977 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f2dd80ac620 con 0x7f2df00c4ab0 2024-04-01T02:13:33.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.471+0000 7f2ded59a640 1 -- 172.21.15.50:0/3741595977 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dd80aca10 con 0x7f2df00c4ab0 2024-04-01T02:13:33.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.471+0000 7f2df4f33640 1 -- 172.21.15.50:0/3741595977 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2df00c4ab0 msgr2=0x7f2df00cc180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:13:33.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.471+0000 7f2df4f33640 1 --2- 172.21.15.50:0/3741595977 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2df00c4ab0 0x7f2df00cc180 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f2df00cce80 tx=0x7f2dd801c4f0 comp rx=0 tx=0).stop 2024-04-01T02:13:33.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.471+0000 7f2df4f33640 1 -- 172.21.15.50:0/3741595977 shutdown_connections 2024-04-01T02:13:33.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.471+0000 7f2df4f33640 1 --2- 172.21.15.50:0/3741595977 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2df00cc6c0 0x7f2df006c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:13:33.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.471+0000 7f2df4f33640 1 --2- 172.21.15.50:0/3741595977 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2df00c4ab0 0x7f2df00cc180 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:13:33.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.471+0000 7f2df4f33640 1 --2- 172.21.15.50:0/3741595977 >> v2:172.21.15.97:3300/0 conn(0x7f2df0154200 0x7f2df00cb780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:13:33.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.471+0000 7f2df4f33640 1 -- 172.21.15.50:0/3741595977 >> 172.21.15.50:0/3741595977 conn(0x7f2df0066f60 msgr2=0x7f2df0067370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T02:13:33.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.471+0000 7f2df4f33640 1 -- 172.21.15.50:0/3741595977 shutdown_connections 2024-04-01T02:13:33.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.471+0000 7f2df4f33640 1 -- 172.21.15.50:0/3741595977 wait complete. 2024-04-01T02:13:33.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.471+0000 7f2df4f33640 1 Processor -- start 2024-04-01T02:13:33.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.471+0000 7f2df4f33640 1 -- start start 2024-04-01T02:13:33.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.471+0000 7f2df4f33640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2df00c4ab0 0x7f2df0144df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:13:33.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.471+0000 7f2df4f33640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2df00cc6c0 0x7f2df00b3d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:13:33.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.471+0000 7f2df4f33640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2df0154200 0x7f2df00b42b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:13:33.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.471+0000 7f2df4f33640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f2df00cbdd0 con 0x7f2df00c4ab0 2024-04-01T02:13:33.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.471+0000 7f2df4f33640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f2df006cdd0 con 0x7f2df00cc6c0 2024-04-01T02:13:33.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.471+0000 7f2df4f33640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f2df00cbf50 con 0x7f2df0154200 2024-04-01T02:13:33.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.471+0000 7f2dee59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2df00c4ab0 0x7f2df0144df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:13:33.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.471+0000 7f2dee59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2df00c4ab0 0x7f2df0144df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56278/0 (socket says 172.21.15.50:56278) 2024-04-01T02:13:33.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.471+0000 7f2dee59c640 1 -- 172.21.15.50:0/2390668503 learned_addr learned my addr 172.21.15.50:0/2390668503 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T02:13:33.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.471+0000 7f2dedd9b640 1 --2- 172.21.15.50:0/2390668503 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2df00cc6c0 0x7f2df00b3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:13:33.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.471+0000 7f2deed9d640 1 --2- 172.21.15.50:0/2390668503 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2df0154200 0x7f2df00b42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:13:33.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.471+0000 7f2dee59c640 1 -- 172.21.15.50:0/2390668503 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2df0154200 msgr2=0x7f2df00b42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:13:33.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.471+0000 7f2dee59c640 1 --2- 172.21.15.50:0/2390668503 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2df0154200 0x7f2df00b42b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:13:33.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.471+0000 7f2dee59c640 1 -- 172.21.15.50:0/2390668503 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2df00cc6c0 msgr2=0x7f2df00b3d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:13:33.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.471+0000 7f2dee59c640 1 --2- 172.21.15.50:0/2390668503 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2df00cc6c0 0x7f2df00b3d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:13:33.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.471+0000 7f2dee59c640 1 -- 172.21.15.50:0/2390668503 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2df0145330 con 0x7f2df00c4ab0 2024-04-01T02:13:33.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.471+0000 7f2dee59c640 1 --2- 172.21.15.50:0/2390668503 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2df00c4ab0 0x7f2df0144df0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f2de000e870 tx=0x7f2de000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:13:33.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.471+0000 7f2de6ffd640 1 -- 172.21.15.50:0/2390668503 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2de0017070 con 0x7f2df00c4ab0 2024-04-01T02:13:33.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.471+0000 7f2de6ffd640 1 -- 172.21.15.50:0/2390668503 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f2de000c940 con 0x7f2df00c4ab0 2024-04-01T02:13:33.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.471+0000 7f2df4f33640 1 -- 172.21.15.50:0/2390668503 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2df01f2f60 con 0x7f2df00c4ab0 2024-04-01T02:13:33.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.471+0000 7f2de6ffd640 1 -- 172.21.15.50:0/2390668503 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2de000cd10 con 0x7f2df00c4ab0 2024-04-01T02:13:33.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.471+0000 7f2df4f33640 1 -- 172.21.15.50:0/2390668503 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2df01f3220 con 0x7f2df00c4ab0 2024-04-01T02:13:33.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.475+0000 7f2df4f33640 1 -- 172.21.15.50:0/2390668503 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2df0068230 con 0x7f2df00c4ab0 2024-04-01T02:13:33.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.475+0000 7f2de6ffd640 1 -- 172.21.15.50:0/2390668503 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 87103+0+0 (secure 0 0 0) 0x7f2de001a070 con 0x7f2df00c4ab0 2024-04-01T02:13:33.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.475+0000 7f2de6ffd640 1 --2- 172.21.15.50:0/2390668503 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f2dd0067420 0x7f2dd00698e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:13:33.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.475+0000 7f2de6ffd640 1 -- 172.21.15.50:0/2390668503 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5738+0+0 (secure 0 0 0) 0x7f2de0085d90 con 0x7f2df00c4ab0 2024-04-01T02:13:33.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.475+0000 7f2dedd9b640 1 --2- 172.21.15.50:0/2390668503 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f2dd0067420 0x7f2dd00698e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:13:33.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.475+0000 7f2dedd9b640 1 --2- 172.21.15.50:0/2390668503 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f2dd0067420 0x7f2dd00698e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2dd80ae000 tx=0x7f2dd8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:13:33.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.479+0000 7f2de6ffd640 1 -- 172.21.15.50:0/2390668503 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+176632 (secure 0 0 0) 0x7f2df0145330 con 0x7f2df00c4ab0 2024-04-01T02:13:33.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.635+0000 7f2df4f33640 1 -- 172.21.15.50:0/2390668503 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2df00b1e90 con 0x7f2df00c4ab0 2024-04-01T02:13:33.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.639+0000 7f2de6ffd640 1 -- 172.21.15.50:0/2390668503 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16574 (secure 0 0 0) 0x7f2de0056410 con 0x7f2df00c4ab0 2024-04-01T02:13:33.635 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-01T02:13:33.635 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":23,"fsid":"f67878a9-bc75-426b-962d-fa7bc2517f7d","created":"2024-04-01T01:55:31.562371+0000","modified":"2024-04-01T01:56:37.409424+0000","last_up_change":"2024-04-01T01:55:42.134502+0000","last_in_change":"2024-04-01T01:55:33.849789+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-01T01:55:42.134418+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-01T01:55:47.009880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-01T01:55:47.551516+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"81e8ca4f-bde8-419a-875f-73a1f4a641ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":4170468134},{"type":"v1","addr":"172.21.15.50:6825","nonce":4170468134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":4170468134},{"type":"v1","addr":"172.21.15.50:6827","nonce":4170468134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":4170468134},{"type":"v1","addr":"172.21.15.50:6831","nonce":4170468134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":4170468134},{"type":"v1","addr":"172.21.15.50:6829","nonce":4170468134}]},"public_addr":"172.21.15.50:6825/4170468134","cluster_addr":"172.21.15.50:6827/4170468134","heartbeat_back_addr":"172.21.15.50:6831/4170468134","heartbeat_front_addr":"172.21.15.50:6829/4170468134","state":["exists","up"]},{"osd":1,"uuid":"bd060ca0-7559-4d30-987c-62e59818431d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1794491326},{"type":"v1","addr":"172.21.15.50:6809","nonce":1794491326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1794491326},{"type":"v1","addr":"172.21.15.50:6811","nonce":1794491326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1794491326},{"type":"v1","addr":"172.21.15.50:6815","nonce":1794491326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1794491326},{"type":"v1","addr":"172.21.15.50:6813","nonce":1794491326}]},"public_addr":"172.21.15.50:6809/1794491326","cluster_addr":"172.21.15.50:6811/1794491326","heartbeat_back_addr":"172.21.15.50:6815/1794491326","heartbeat_front_addr":"172.21.15.50:6813/1794491326","state":["exists","up"]},{"osd":2,"uuid":"eac5d816-a281-4acd-aa7d-b96a8e0aa962","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":710247177},{"type":"v1","addr":"172.21.15.50:6801","nonce":710247177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":710247177},{"type":"v1","addr":"172.21.15.50:6803","nonce":710247177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":710247177},{"type":"v1","addr":"172.21.15.50:6807","nonce":710247177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":710247177},{"type":"v1","addr":"172.21.15.50:6805","nonce":710247177}]},"public_addr":"172.21.15.50:6801/710247177","cluster_addr":"172.21.15.50:6803/710247177","heartbeat_back_addr":"172.21.15.50:6807/710247177","heartbeat_front_addr":"172.21.15.50:6805/710247177","state":["exists","up"]},{"osd":3,"uuid":"12b23968-04a7-40b8-98c4-02b16ae28265","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":871680805},{"type":"v1","addr":"172.21.15.50:6817","nonce":871680805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":871680805},{"type":"v1","addr":"172.21.15.50:6819","nonce":871680805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":871680805},{"type":"v1","addr":"172.21.15.50:6823","nonce":871680805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":871680805},{"type":"v1","addr":"172.21.15.50:6821","nonce":871680805}]},"public_addr":"172.21.15.50:6817/871680805","cluster_addr":"172.21.15.50:6819/871680805","heartbeat_back_addr":"172.21.15.50:6823/871680805","heartbeat_front_addr":"172.21.15.50:6821/871680805","state":["exists","up"]},{"osd":4,"uuid":"0e6b1639-23b0-47d9-8b08-40c8ab6df818","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":1095319381},{"type":"v1","addr":"172.21.15.97:6801","nonce":1095319381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":1095319381},{"type":"v1","addr":"172.21.15.97:6803","nonce":1095319381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":1095319381},{"type":"v1","addr":"172.21.15.97:6807","nonce":1095319381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":1095319381},{"type":"v1","addr":"172.21.15.97:6805","nonce":1095319381}]},"public_addr":"172.21.15.97:6801/1095319381","cluster_addr":"172.21.15.97:6803/1095319381","heartbeat_back_addr":"172.21.15.97:6807/1095319381","heartbeat_front_addr":"172.21.15.97:6805/1095319381","state":["exists","up"]},{"osd":5,"uuid":"f0f876ef-0823-46e9-8fe4-9b7a64a94cee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":899031308},{"type":"v1","addr":"172.21.15.97:6817","nonce":899031308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":899031308},{"type":"v1","addr":"172.21.15.97:6819","nonce":899031308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":899031308},{"type":"v1","addr":"172.21.15.97:6823","nonce":899031308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":899031308},{"type":"v1","addr":"172.21.15.97:6821","nonce":899031308}]},"public_addr":"172.21.15.97:6817/899031308","cluster_addr":"172.21.15.97:6819/899031308","heartbeat_back_addr":"172.21.15.97:6823/899031308","heartbeat_front_addr":"172.21.15.97:6821/899031308","state":["exists","up"]},{"osd":6,"uuid":"d29a625e-83bf-40ef-a57e-618220b96b9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2224814961},{"type":"v1","addr":"172.21.15.97:6825","nonce":2224814961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2224814961},{"type":"v1","addr":"172.21.15.97:6827","nonce":2224814961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2224814961},{"type":"v1","addr":"172.21.15.97:6831","nonce":2224814961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2224814961},{"type":"v1","addr":"172.21.15.97:6829","nonce":2224814961}]},"public_addr":"172.21.15.97:6825/2224814961","cluster_addr":"172.21.15.97:6827/2224814961","heartbeat_back_addr":"172.21.15.97:6831/2224814961","heartbeat_front_addr":"172.21.15.97:6829/2224814961","state":["exists","up"]},{"osd":7,"uuid":"7bcfd8f1-7dc0-4013-af17-16da5a8d931d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":284968823},{"type":"v1","addr":"172.21.15.97:6809","nonce":284968823}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":284968823},{"type":"v1","addr":"172.21.15.97:6811","nonce":284968823}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6814","nonce":284968823},{"type":"v1","addr":"172.21.15.97:6815","nonce":284968823}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":284968823},{"type":"v1","addr":"172.21.15.97:6813","nonce":284968823}]},"public_addr":"172.21.15.97:6809/284968823","cluster_addr":"172.21.15.97:6811/284968823","heartbeat_back_addr":"172.21.15.97:6815/284968823","heartbeat_front_addr":"172.21.15.97:6813/284968823","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T01:55:39.369550+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T01:55:39.367285+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T01:55:39.458393+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T01:55:39.456179+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T01:55:39.463649+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T01:55:38.728924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T01:55:39.522411+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T01:55:39.432081+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.36","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-01T02:13:33.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.639+0000 7f2df4f33640 1 -- 172.21.15.50:0/2390668503 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f2dd0067420 msgr2=0x7f2dd00698e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:13:33.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.639+0000 7f2df4f33640 1 --2- 172.21.15.50:0/2390668503 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f2dd0067420 0x7f2dd00698e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2dd80ae000 tx=0x7f2dd8008040 comp rx=0 tx=0).stop 2024-04-01T02:13:33.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.639+0000 7f2df4f33640 1 -- 172.21.15.50:0/2390668503 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2df00c4ab0 msgr2=0x7f2df0144df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:13:33.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.639+0000 7f2df4f33640 1 --2- 172.21.15.50:0/2390668503 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2df00c4ab0 0x7f2df0144df0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f2de000e870 tx=0x7f2de000ec70 comp rx=0 tx=0).stop 2024-04-01T02:13:33.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.639+0000 7f2df4f33640 1 -- 172.21.15.50:0/2390668503 shutdown_connections 2024-04-01T02:13:33.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.639+0000 7f2df4f33640 1 --2- 172.21.15.50:0/2390668503 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f2dd0067420 0x7f2dd00698e0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:13:33.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.639+0000 7f2df4f33640 1 --2- 172.21.15.50:0/2390668503 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2df0154200 0x7f2df00b42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:13:33.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.639+0000 7f2df4f33640 1 --2- 172.21.15.50:0/2390668503 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2df00cc6c0 0x7f2df00b3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:13:33.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.639+0000 7f2df4f33640 1 --2- 172.21.15.50:0/2390668503 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2df00c4ab0 0x7f2df0144df0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:13:33.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.639+0000 7f2df4f33640 1 -- 172.21.15.50:0/2390668503 >> 172.21.15.50:0/2390668503 conn(0x7f2df0066f60 msgr2=0x7f2df014a1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T02:13:33.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.639+0000 7f2df4f33640 1 -- 172.21.15.50:0/2390668503 shutdown_connections 2024-04-01T02:13:33.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.639+0000 7f2df4f33640 1 -- 172.21.15.50:0/2390668503 wait complete. 2024-04-01T02:13:33.653 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-01T02:13:33.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.767+0000 7f88ac094640 1 Processor -- start 2024-04-01T02:13:33.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.767+0000 7f88ac094640 1 -- start start 2024-04-01T02:13:33.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.767+0000 7f88ac094640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f88a4151f40 0x7f88a4158670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:13:33.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.767+0000 7f88ac094640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f88a4072380 0x7f88a415b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:13:33.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.767+0000 7f88ac094640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88a40c9d80 con 0x7f88a415bda0 2024-04-01T02:13:33.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.767+0000 7f88ac094640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f88a415b3d0 con 0x7f88a4072380 2024-04-01T02:13:33.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.767+0000 7f88ac094640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f88a40c5b50 con 0x7f88a4151f40 2024-04-01T02:13:33.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.767+0000 7f88a962f640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f88a4072380 0x7f88a415b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:13:33.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.767+0000 7f88a962f640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f88a4072380 0x7f88a415b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56290/0 (socket says 172.21.15.50:56290) 2024-04-01T02:13:33.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.767+0000 7f88a962f640 1 -- 172.21.15.50:0/2807707958 learned_addr learned my addr 172.21.15.50:0/2807707958 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T02:13:33.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.767+0000 7f88aa631640 1 --1- 172.21.15.50:0/2807707958 >> v1:172.21.15.50:6789/0 conn(0x7f88a415bda0 0x7f88a40c6ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:40316/0 (socket says 172.21.15.50:40316) 2024-04-01T02:13:33.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.767+0000 7f88a9e30640 1 --2- 172.21.15.50:0/2807707958 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f88a4151f40 0x7f88a4158670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:13:33.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.767+0000 7f88a962f640 1 -- 172.21.15.50:0/2807707958 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f88a4151f40 msgr2=0x7f88a4158670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T02:13:33.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.767+0000 7f88a962f640 1 --2- 172.21.15.50:0/2807707958 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f88a4151f40 0x7f88a4158670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:13:33.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.767+0000 7f88a962f640 1 -- 172.21.15.50:0/2807707958 >> v1:172.21.15.50:6789/0 conn(0x7f88a415bda0 legacy=0x7f88a40c6ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:13:33.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.767+0000 7f88a962f640 1 -- 172.21.15.50:0/2807707958 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88a40c5e30 con 0x7f88a4072380 2024-04-01T02:13:33.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.767+0000 7f88a9e30640 1 --2- 172.21.15.50:0/2807707958 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f88a4151f40 0x7f88a4158670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T02:13:33.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.771+0000 7f88a962f640 1 --2- 172.21.15.50:0/2807707958 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88a4072380 0x7f88a415b860 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f8894009870 tx=0x7f889401ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e04e1f34d0aa3fc server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:13:33.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.771+0000 7f88a8e2e640 1 -- 172.21.15.50:0/2807707958 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88940b5070 con 0x7f88a4072380 2024-04-01T02:13:33.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.771+0000 7f88a8e2e640 1 -- 172.21.15.50:0/2807707958 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f88940a8a50 con 0x7f88a4072380 2024-04-01T02:13:33.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.771+0000 7f88a8e2e640 1 -- 172.21.15.50:0/2807707958 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88940a8e40 con 0x7f88a4072380 2024-04-01T02:13:33.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.771+0000 7f88ac094640 1 -- 172.21.15.50:0/2807707958 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88a4072380 msgr2=0x7f88a415b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:13:33.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.771+0000 7f88ac094640 1 --2- 172.21.15.50:0/2807707958 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88a4072380 0x7f88a415b860 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f8894009870 tx=0x7f889401ed50 comp rx=0 tx=0).stop 2024-04-01T02:13:33.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.771+0000 7f88ac094640 1 -- 172.21.15.50:0/2807707958 shutdown_connections 2024-04-01T02:13:33.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.771+0000 7f88ac094640 1 --2- 172.21.15.50:0/2807707958 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88a4072380 0x7f88a415b860 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:13:33.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.771+0000 7f88ac094640 1 --2- 172.21.15.50:0/2807707958 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f88a4151f40 0x7f88a4158670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:13:33.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.771+0000 7f88ac094640 1 -- 172.21.15.50:0/2807707958 >> 172.21.15.50:0/2807707958 conn(0x7f88a40c8ea0 msgr2=0x7f88a40c92b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T02:13:33.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.771+0000 7f88ac094640 1 -- 172.21.15.50:0/2807707958 shutdown_connections 2024-04-01T02:13:33.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.771+0000 7f88ac094640 1 -- 172.21.15.50:0/2807707958 wait complete. 2024-04-01T02:13:33.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.771+0000 7f88ac094640 1 Processor -- start 2024-04-01T02:13:33.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.771+0000 7f88ac094640 1 -- start start 2024-04-01T02:13:33.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.771+0000 7f88ac094640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f88a4072380 0x7f88a41ee3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:13:33.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.771+0000 7f88ac094640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88a4151f40 0x7f88a41505f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:13:33.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.771+0000 7f88ac094640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f88a415bda0 0x7f88a40cacb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:13:33.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.771+0000 7f88ac094640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f88a4152320 con 0x7f88a4151f40 2024-04-01T02:13:33.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.771+0000 7f88ac094640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f88a40c63f0 con 0x7f88a415bda0 2024-04-01T02:13:33.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.771+0000 7f88ac094640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f88a40728a0 con 0x7f88a4072380 2024-04-01T02:13:33.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.771+0000 7f88a962f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88a4151f40 0x7f88a41505f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:13:33.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.771+0000 7f88a962f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88a4151f40 0x7f88a41505f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56296/0 (socket says 172.21.15.50:56296) 2024-04-01T02:13:33.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.771+0000 7f88a962f640 1 -- 172.21.15.50:0/3651832221 learned_addr learned my addr 172.21.15.50:0/3651832221 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T02:13:33.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.771+0000 7f88a9e30640 1 --2- 172.21.15.50:0/3651832221 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f88a4072380 0x7f88a41ee3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:13:33.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.771+0000 7f88a962f640 1 -- 172.21.15.50:0/3651832221 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f88a4072380 msgr2=0x7f88a41ee3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:13:33.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.771+0000 7f88a962f640 1 --2- 172.21.15.50:0/3651832221 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f88a4072380 0x7f88a41ee3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:13:33.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.771+0000 7f88a962f640 1 -- 172.21.15.50:0/3651832221 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f88a415bda0 msgr2=0x7f88a40cacb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:13:33.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.771+0000 7f88a962f640 1 --2- 172.21.15.50:0/3651832221 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f88a415bda0 0x7f88a40cacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:13:33.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.771+0000 7f88a962f640 1 -- 172.21.15.50:0/3651832221 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88a40ca240 con 0x7f88a4151f40 2024-04-01T02:13:33.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.771+0000 7f88a9e30640 1 --2- 172.21.15.50:0/3651832221 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f88a4072380 0x7f88a41ee3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T02:13:33.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.771+0000 7f88a962f640 1 --2- 172.21.15.50:0/3651832221 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88a4151f40 0x7f88a41505f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f889401d400 tx=0x7f889401baf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:13:33.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.771+0000 7f889a7fc640 1 -- 172.21.15.50:0/3651832221 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88940b5040 con 0x7f88a4151f40 2024-04-01T02:13:33.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.771+0000 7f889a7fc640 1 -- 172.21.15.50:0/3651832221 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f88940be070 con 0x7f88a4151f40 2024-04-01T02:13:33.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.771+0000 7f88ac094640 1 -- 172.21.15.50:0/3651832221 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88a4154f80 con 0x7f88a4151f40 2024-04-01T02:13:33.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.771+0000 7f889a7fc640 1 -- 172.21.15.50:0/3651832221 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88940b9690 con 0x7f88a4151f40 2024-04-01T02:13:33.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.771+0000 7f88ac094640 1 -- 172.21.15.50:0/3651832221 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88a40ca4b0 con 0x7f88a4151f40 2024-04-01T02:13:33.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.775+0000 7f88ac094640 1 -- 172.21.15.50:0/3651832221 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88a4068940 con 0x7f88a4151f40 2024-04-01T02:13:33.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.775+0000 7f889a7fc640 1 -- 172.21.15.50:0/3651832221 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 87103+0+0 (secure 0 0 0) 0x7f88940b9830 con 0x7f88a4151f40 2024-04-01T02:13:33.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.775+0000 7f889a7fc640 1 --2- 172.21.15.50:0/3651832221 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f8888067420 0x7f88880698e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:13:33.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.775+0000 7f889a7fc640 1 -- 172.21.15.50:0/3651832221 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5738+0+0 (secure 0 0 0) 0x7f88941235e0 con 0x7f88a4151f40 2024-04-01T02:13:33.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.775+0000 7f88a9e30640 1 --2- 172.21.15.50:0/3651832221 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f8888067420 0x7f88880698e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:13:33.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.775+0000 7f88a9e30640 1 --2- 172.21.15.50:0/3651832221 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f8888067420 0x7f88880698e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f889c008930 tx=0x7f889c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:13:33.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.779+0000 7f889a7fc640 1 -- 172.21.15.50:0/3651832221 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+176632 (secure 0 0 0) 0x7f88940188b0 con 0x7f88a4151f40 2024-04-01T02:13:33.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.971+0000 7f88ac094640 1 -- 172.21.15.50:0/3651832221 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f88a4072c60 con 0x7f88a4151f40 2024-04-01T02:13:33.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.975+0000 7f889a7fc640 1 -- 172.21.15.50:0/3651832221 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v8) ==== 161+0+0 (secure 0 0 0) 0x7f88940f42d0 con 0x7f88a4151f40 2024-04-01T02:13:33.971 INFO:teuthology.orchestra.run.smithi050.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-01T02:13:33.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.979+0000 7f88ac094640 1 -- 172.21.15.50:0/3651832221 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f8888067420 msgr2=0x7f88880698e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:13:33.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.979+0000 7f88ac094640 1 --2- 172.21.15.50:0/3651832221 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f8888067420 0x7f88880698e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f889c008930 tx=0x7f889c008040 comp rx=0 tx=0).stop 2024-04-01T02:13:33.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.979+0000 7f88ac094640 1 -- 172.21.15.50:0/3651832221 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88a4151f40 msgr2=0x7f88a41505f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:13:33.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.979+0000 7f88ac094640 1 --2- 172.21.15.50:0/3651832221 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88a4151f40 0x7f88a41505f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f889401d400 tx=0x7f889401baf0 comp rx=0 tx=0).stop 2024-04-01T02:13:33.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.979+0000 7f88ac094640 1 -- 172.21.15.50:0/3651832221 shutdown_connections 2024-04-01T02:13:33.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.979+0000 7f88ac094640 1 --2- 172.21.15.50:0/3651832221 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f8888067420 0x7f88880698e0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:13:33.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.979+0000 7f88ac094640 1 --2- 172.21.15.50:0/3651832221 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f88a415bda0 0x7f88a40cacb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:13:33.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.979+0000 7f88ac094640 1 --2- 172.21.15.50:0/3651832221 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88a4151f40 0x7f88a41505f0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:13:33.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.979+0000 7f88ac094640 1 --2- 172.21.15.50:0/3651832221 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f88a4072380 0x7f88a41ee3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:13:33.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.979+0000 7f88ac094640 1 -- 172.21.15.50:0/3651832221 >> 172.21.15.50:0/3651832221 conn(0x7f88a40c8ea0 msgr2=0x7f88a414e920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T02:13:33.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.979+0000 7f88ac094640 1 -- 172.21.15.50:0/3651832221 shutdown_connections 2024-04-01T02:13:33.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:33.979+0000 7f88ac094640 1 -- 172.21.15.50:0/3651832221 wait complete. 2024-04-01T02:13:33.992 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-01T02:13:34.052 INFO:tasks.ceph.mds.f.smithi097.stdout:starting mds.f at 2024-04-01T02:13:34.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:34.107+0000 7eff3d387640 1 Processor -- start 2024-04-01T02:13:34.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:34.107+0000 7eff3d387640 1 -- start start 2024-04-01T02:13:34.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:34.107+0000 7eff3d387640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7eff380c9250 0x7eff380c3b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:13:34.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:34.107+0000 7eff3d387640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff380c8700 con 0x7eff380c81a0 2024-04-01T02:13:34.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:34.107+0000 7eff3d387640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff38157d50 con 0x7eff38152060 2024-04-01T02:13:34.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:34.107+0000 7eff3d387640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7eff380c29e0 con 0x7eff380c9250 2024-04-01T02:13:34.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:34.107+0000 7eff367fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7eff380c9250 0x7eff380c3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:13:34.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:34.107+0000 7eff377fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7eff380c81a0 0x7eff380c9710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:40320/0 (socket says 172.21.15.50:40320) 2024-04-01T02:13:34.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:34.107+0000 7eff377fe640 1 -- 172.21.15.50:0/111521955 learned_addr learned my addr 172.21.15.50:0/111521955 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-04-01T02:13:34.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:34.107+0000 7eff367fc640 1 -- 172.21.15.50:0/111521955 >> v1:172.21.15.97:6789/0 conn(0x7eff38152060 legacy=0x7eff380cd730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:13:34.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:34.107+0000 7eff367fc640 1 -- 172.21.15.50:0/111521955 >> v1:172.21.15.50:6789/0 conn(0x7eff380c81a0 legacy=0x7eff380c9710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:13:34.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:34.107+0000 7eff367fc640 1 -- 172.21.15.50:0/111521955 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff38158030 con 0x7eff380c9250 2024-04-01T02:13:34.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:34.111+0000 7eff367fc640 1 --2- 172.21.15.50:0/111521955 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff380c9250 0x7eff380c3b90 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7eff200097c0 tx=0x7eff2001ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29d72435afb8862e server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:13:34.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:34.111+0000 7eff35ffb640 1 -- 172.21.15.50:0/111521955 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff200b5070 con 0x7eff380c9250 2024-04-01T02:13:34.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:34.111+0000 7eff35ffb640 1 -- 172.21.15.50:0/111521955 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7eff200a8990 con 0x7eff380c9250 2024-04-01T02:13:34.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:34.111+0000 7eff35ffb640 1 -- 172.21.15.50:0/111521955 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff200a8d80 con 0x7eff380c9250 2024-04-01T02:13:34.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:34.111+0000 7eff3d387640 1 -- 172.21.15.50:0/111521955 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff380c9250 msgr2=0x7eff380c3b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:13:34.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:34.111+0000 7eff3d387640 1 --2- 172.21.15.50:0/111521955 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff380c9250 0x7eff380c3b90 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7eff200097c0 tx=0x7eff2001ec90 comp rx=0 tx=0).stop 2024-04-01T02:13:34.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:34.111+0000 7eff3d387640 1 -- 172.21.15.50:0/111521955 shutdown_connections 2024-04-01T02:13:34.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:34.111+0000 7eff3d387640 1 --2- 172.21.15.50:0/111521955 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff380c9250 0x7eff380c3b90 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:13:34.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:34.111+0000 7eff3d387640 1 -- 172.21.15.50:0/111521955 >> 172.21.15.50:0/111521955 conn(0x7eff3806f650 msgr2=0x7eff3806b220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T02:13:34.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:34.111+0000 7eff3d387640 1 -- 172.21.15.50:0/111521955 shutdown_connections 2024-04-01T02:13:34.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:34.111+0000 7eff3d387640 1 -- 172.21.15.50:0/111521955 wait complete. 2024-04-01T02:13:34.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:34.111+0000 7eff3d387640 1 Processor -- start 2024-04-01T02:13:34.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:34.111+0000 7eff3d387640 1 -- start start 2024-04-01T02:13:34.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:34.115+0000 7eff3d387640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7eff380c81a0 0x7eff38158e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:13:34.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:34.115+0000 7eff3d387640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7eff380c9250 0x7eff3815a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:13:34.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:34.115+0000 7eff3d387640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff38152060 0x7eff3815ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:13:34.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:34.115+0000 7eff3d387640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7eff381585f0 con 0x7eff38152060 2024-04-01T02:13:34.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:34.115+0000 7eff3d387640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7eff38158960 con 0x7eff380c81a0 2024-04-01T02:13:34.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:34.115+0000 7eff3d387640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7eff380cde40 con 0x7eff380c9250 2024-04-01T02:13:34.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:34.115+0000 7eff377fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff38152060 0x7eff3815ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:13:34.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:34.115+0000 7eff377fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff38152060 0x7eff3815ad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56312/0 (socket says 172.21.15.50:56312) 2024-04-01T02:13:34.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:34.115+0000 7eff377fe640 1 -- 172.21.15.50:0/4212436035 learned_addr learned my addr 172.21.15.50:0/4212436035 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T02:13:34.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:34.115+0000 7eff36ffd640 1 --2- 172.21.15.50:0/4212436035 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7eff380c81a0 0x7eff38158e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:13:34.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:34.115+0000 7eff367fc640 1 --2- 172.21.15.50:0/4212436035 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7eff380c9250 0x7eff3815a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:13:34.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:34.115+0000 7eff377fe640 1 -- 172.21.15.50:0/4212436035 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7eff380c9250 msgr2=0x7eff3815a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:13:34.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:34.115+0000 7eff377fe640 1 --2- 172.21.15.50:0/4212436035 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7eff380c9250 0x7eff3815a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:13:34.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:34.115+0000 7eff377fe640 1 -- 172.21.15.50:0/4212436035 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7eff380c81a0 msgr2=0x7eff38158e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:13:34.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:34.115+0000 7eff377fe640 1 --2- 172.21.15.50:0/4212436035 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7eff380c81a0 0x7eff38158e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:13:34.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:34.115+0000 7eff377fe640 1 -- 172.21.15.50:0/4212436035 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff380cd440 con 0x7eff38152060 2024-04-01T02:13:34.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:34.115+0000 7eff36ffd640 1 --2- 172.21.15.50:0/4212436035 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7eff380c81a0 0x7eff38158e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T02:13:34.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:34.115+0000 7eff377fe640 1 --2- 172.21.15.50:0/4212436035 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff38152060 0x7eff3815ad10 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7eff2800cbc0 tx=0x7eff2800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:13:34.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:34.115+0000 7eff2f7fe640 1 -- 172.21.15.50:0/4212436035 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff28017070 con 0x7eff38152060 2024-04-01T02:13:34.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:34.115+0000 7eff2f7fe640 1 -- 172.21.15.50:0/4212436035 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7eff2800ad40 con 0x7eff38152060 2024-04-01T02:13:34.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:34.115+0000 7eff3d387640 1 -- 172.21.15.50:0/4212436035 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff380b0ae0 con 0x7eff38152060 2024-04-01T02:13:34.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:34.115+0000 7eff2f7fe640 1 -- 172.21.15.50:0/4212436035 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff28012620 con 0x7eff38152060 2024-04-01T02:13:34.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:34.115+0000 7eff3d387640 1 -- 172.21.15.50:0/4212436035 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff381e31d0 con 0x7eff38152060 2024-04-01T02:13:34.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:34.115+0000 7eff3d387640 1 -- 172.21.15.50:0/4212436035 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff38068940 con 0x7eff38152060 2024-04-01T02:13:34.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:34.115+0000 7eff2f7fe640 1 -- 172.21.15.50:0/4212436035 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 87103+0+0 (secure 0 0 0) 0x7eff2801a070 con 0x7eff38152060 2024-04-01T02:13:34.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:34.115+0000 7eff2f7fe640 1 --2- 172.21.15.50:0/4212436035 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7eff18067450 0x7eff18069910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:13:34.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:34.115+0000 7eff2f7fe640 1 -- 172.21.15.50:0/4212436035 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5824+0+0 (secure 0 0 0) 0x7eff280855a0 con 0x7eff38152060 2024-04-01T02:13:34.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:34.115+0000 7eff36ffd640 1 --2- 172.21.15.50:0/4212436035 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7eff18067450 0x7eff18069910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:13:34.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:34.115+0000 7eff36ffd640 1 --2- 172.21.15.50:0/4212436035 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7eff18067450 0x7eff18069910 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7eff30000f70 tx=0x7eff30009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:13:34.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:34.119+0000 7eff2f7fe640 1 -- 172.21.15.50:0/4212436035 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+176632 (secure 0 0 0) 0x7eff28056240 con 0x7eff38152060 2024-04-01T02:13:34.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:34.315+0000 7eff3d387640 1 -- 172.21.15.50:0/4212436035 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7eff380c8be0 con 0x7eff38152060 2024-04-01T02:13:34.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:34.983+0000 7eff2f7fe640 1 -- 172.21.15.50:0/4212436035 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v9) ==== 104+0+0 (secure 0 0 0) 0x7eff28055b40 con 0x7eff38152060 2024-04-01T02:13:34.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:34.983+0000 7eff3d387640 1 -- 172.21.15.50:0/4212436035 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7eff18067450 msgr2=0x7eff18069910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:13:34.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:34.983+0000 7eff3d387640 1 --2- 172.21.15.50:0/4212436035 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7eff18067450 0x7eff18069910 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7eff30000f70 tx=0x7eff30009040 comp rx=0 tx=0).stop 2024-04-01T02:13:34.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:34.983+0000 7eff3d387640 1 -- 172.21.15.50:0/4212436035 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff38152060 msgr2=0x7eff3815ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:13:34.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:34.983+0000 7eff3d387640 1 --2- 172.21.15.50:0/4212436035 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff38152060 0x7eff3815ad10 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7eff2800cbc0 tx=0x7eff2800a430 comp rx=0 tx=0).stop 2024-04-01T02:13:34.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:34.983+0000 7eff3d387640 1 -- 172.21.15.50:0/4212436035 shutdown_connections 2024-04-01T02:13:34.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:34.983+0000 7eff3d387640 1 --2- 172.21.15.50:0/4212436035 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7eff18067450 0x7eff18069910 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:13:34.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:34.983+0000 7eff3d387640 1 --2- 172.21.15.50:0/4212436035 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff38152060 0x7eff3815ad10 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:13:34.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:34.983+0000 7eff3d387640 1 --2- 172.21.15.50:0/4212436035 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7eff380c9250 0x7eff3815a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:13:34.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:34.983+0000 7eff3d387640 1 --2- 172.21.15.50:0/4212436035 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7eff380c81a0 0x7eff38158e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:13:34.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:34.983+0000 7eff3d387640 1 -- 172.21.15.50:0/4212436035 >> 172.21.15.50:0/4212436035 conn(0x7eff3806f650 msgr2=0x7eff3806b220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T02:13:34.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:34.983+0000 7eff3d387640 1 -- 172.21.15.50:0/4212436035 shutdown_connections 2024-04-01T02:13:34.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:34.983+0000 7eff3d387640 1 -- 172.21.15.50:0/4212436035 wait complete. 2024-04-01T02:13:35.004 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-01T02:13:35.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:35.139+0000 7f1f41e08640 1 Processor -- start 2024-04-01T02:13:35.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:35.139+0000 7f1f41e08640 1 -- start start 2024-04-01T02:13:35.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:35.139+0000 7f1f41e08640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1f3c0b4b90 0x7f1f3c0c58b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:13:35.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:35.139+0000 7f1f41e08640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1f3c0c5df0 0x7f1f3c0b3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:13:35.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:35.139+0000 7f1f41e08640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f3c0cb190 con 0x7f1f3c158420 2024-04-01T02:13:35.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:35.139+0000 7f1f41e08640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f1f3c0cb530 con 0x7f1f3c0c5df0 2024-04-01T02:13:35.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:35.139+0000 7f1f41e08640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f1f3c158800 con 0x7f1f3c0b4b90 2024-04-01T02:13:35.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:35.139+0000 7f1f3b7fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f1f3c158420 0x7f1f3c15ebc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:40326/0 (socket says 172.21.15.50:40326) 2024-04-01T02:13:35.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:35.139+0000 7f1f3b7fe640 1 -- 172.21.15.50:0/2703781064 learned_addr learned my addr 172.21.15.50:0/2703781064 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-04-01T02:13:35.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:35.139+0000 7f1f3bfff640 1 --2- 172.21.15.50:0/2703781064 >> v2:172.21.15.50:3300/0 conn(0x7f1f3c0c5df0 0x7f1f3c0b3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:13:35.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:35.139+0000 7f1f3affd640 1 --2- 172.21.15.50:0/2703781064 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1f3c0b4b90 0x7f1f3c0c58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:13:35.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:35.139+0000 7f1f3a7fc640 1 -- 172.21.15.50:0/2703781064 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2946183505 0 0) 0x7f1f3c0cb190 con 0x7f1f3c158420 2024-04-01T02:13:35.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:35.139+0000 7f1f3a7fc640 1 -- 172.21.15.50:0/2703781064 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f24003530 con 0x7f1f3c158420 2024-04-01T02:13:35.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:35.139+0000 7f1f3bfff640 1 -- 172.21.15.50:0/2703781064 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1f3c0b4b90 msgr2=0x7f1f3c0c58b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T02:13:35.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:35.139+0000 7f1f3bfff640 1 --2- 172.21.15.50:0/2703781064 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1f3c0b4b90 0x7f1f3c0c58b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:13:35.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:35.139+0000 7f1f3bfff640 1 -- 172.21.15.50:0/2703781064 >> v1:172.21.15.50:6789/0 conn(0x7f1f3c158420 legacy=0x7f1f3c15ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:13:35.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:35.139+0000 7f1f3bfff640 1 -- 172.21.15.50:0/2703781064 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f3c162600 con 0x7f1f3c0c5df0 2024-04-01T02:13:35.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:35.143+0000 7f1f3bfff640 1 --2- 172.21.15.50:0/2703781064 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f3c0c5df0 0x7f1f3c0b3dc0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f1f34009d90 tx=0x7f1f3401f150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5570699338865d60 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:13:35.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:35.143+0000 7f1f3a7fc640 1 -- 172.21.15.50:0/2703781064 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f340b4070 con 0x7f1f3c0c5df0 2024-04-01T02:13:35.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:35.143+0000 7f1f3a7fc640 1 -- 172.21.15.50:0/2703781064 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f1f340af600 con 0x7f1f3c0c5df0 2024-04-01T02:13:35.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:35.143+0000 7f1f3a7fc640 1 -- 172.21.15.50:0/2703781064 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f340af9b0 con 0x7f1f3c0c5df0 2024-04-01T02:13:35.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:35.143+0000 7f1f41e08640 1 -- 172.21.15.50:0/2703781064 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f3c0c5df0 msgr2=0x7f1f3c0b3dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:13:35.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:35.143+0000 7f1f41e08640 1 --2- 172.21.15.50:0/2703781064 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f3c0c5df0 0x7f1f3c0b3dc0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f1f34009d90 tx=0x7f1f3401f150 comp rx=0 tx=0).stop 2024-04-01T02:13:35.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:35.143+0000 7f1f41e08640 1 -- 172.21.15.50:0/2703781064 shutdown_connections 2024-04-01T02:13:35.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:35.143+0000 7f1f41e08640 1 --2- 172.21.15.50:0/2703781064 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f3c0c5df0 0x7f1f3c0b3dc0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:13:35.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:35.143+0000 7f1f41e08640 1 --2- 172.21.15.50:0/2703781064 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1f3c0b4b90 0x7f1f3c0c58b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:13:35.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:35.143+0000 7f1f41e08640 1 -- 172.21.15.50:0/2703781064 >> 172.21.15.50:0/2703781064 conn(0x7f1f3c06c910 msgr2=0x7f1f3c06ce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T02:13:35.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:35.143+0000 7f1f41e08640 1 -- 172.21.15.50:0/2703781064 shutdown_connections 2024-04-01T02:13:35.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:35.143+0000 7f1f41e08640 1 -- 172.21.15.50:0/2703781064 wait complete. 2024-04-01T02:13:35.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:35.143+0000 7f1f41e08640 1 Processor -- start 2024-04-01T02:13:35.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:35.143+0000 7f1f41e08640 1 -- start start 2024-04-01T02:13:35.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:35.147+0000 7f1f41e08640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f3c0b4b90 0x7f1f3c158a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:13:35.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:35.147+0000 7f1f41e08640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1f3c0c5df0 0x7f1f3c156630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:13:35.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:35.147+0000 7f1f41e08640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1f3c158420 0x7f1f3c1f7000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:13:35.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:35.147+0000 7f1f41e08640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f1f3c161b20 con 0x7f1f3c0b4b90 2024-04-01T02:13:35.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:35.147+0000 7f1f41e08640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f1f3c161840 con 0x7f1f3c0c5df0 2024-04-01T02:13:35.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:35.147+0000 7f1f41e08640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f1f3c161e00 con 0x7f1f3c158420 2024-04-01T02:13:35.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:35.147+0000 7f1f3b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f3c0b4b90 0x7f1f3c158a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:13:35.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:35.147+0000 7f1f3b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f3c0b4b90 0x7f1f3c158a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56320/0 (socket says 172.21.15.50:56320) 2024-04-01T02:13:35.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:35.147+0000 7f1f3b7fe640 1 -- 172.21.15.50:0/2553822436 learned_addr learned my addr 172.21.15.50:0/2553822436 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T02:13:35.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:35.147+0000 7f1f3bfff640 1 --2- 172.21.15.50:0/2553822436 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1f3c158420 0x7f1f3c1f7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:13:35.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:35.147+0000 7f1f3b7fe640 1 -- 172.21.15.50:0/2553822436 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1f3c158420 msgr2=0x7f1f3c1f7000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:13:35.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:35.147+0000 7f1f3affd640 1 --2- 172.21.15.50:0/2553822436 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1f3c0c5df0 0x7f1f3c156630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:13:35.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:35.147+0000 7f1f3b7fe640 1 --2- 172.21.15.50:0/2553822436 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1f3c158420 0x7f1f3c1f7000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:13:35.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:35.147+0000 7f1f3b7fe640 1 -- 172.21.15.50:0/2553822436 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1f3c0c5df0 msgr2=0x7f1f3c156630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:13:35.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:35.147+0000 7f1f3b7fe640 1 --2- 172.21.15.50:0/2553822436 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1f3c0c5df0 0x7f1f3c156630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:13:35.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:35.147+0000 7f1f3b7fe640 1 -- 172.21.15.50:0/2553822436 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f3c1592e0 con 0x7f1f3c0b4b90 2024-04-01T02:13:35.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:35.147+0000 7f1f3b7fe640 1 --2- 172.21.15.50:0/2553822436 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f3c0b4b90 0x7f1f3c158a30 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c00c450 tx=0x7f1f2c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:13:35.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:35.147+0000 7f1f23fff640 1 -- 172.21.15.50:0/2553822436 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f2c017070 con 0x7f1f3c0b4b90 2024-04-01T02:13:35.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:35.147+0000 7f1f23fff640 1 -- 172.21.15.50:0/2553822436 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f1f2c005cf0 con 0x7f1f3c0b4b90 2024-04-01T02:13:35.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:35.147+0000 7f1f41e08640 1 -- 172.21.15.50:0/2553822436 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f3c1595c0 con 0x7f1f3c0b4b90 2024-04-01T02:13:35.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:35.147+0000 7f1f23fff640 1 -- 172.21.15.50:0/2553822436 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f2c0072b0 con 0x7f1f3c0b4b90 2024-04-01T02:13:35.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:35.147+0000 7f1f41e08640 1 -- 172.21.15.50:0/2553822436 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f3c15b240 con 0x7f1f3c0b4b90 2024-04-01T02:13:35.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:35.147+0000 7f1f41e08640 1 -- 172.21.15.50:0/2553822436 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f3c068940 con 0x7f1f3c0b4b90 2024-04-01T02:13:35.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:35.147+0000 7f1f23fff640 1 -- 172.21.15.50:0/2553822436 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 87103+0+0 (secure 0 0 0) 0x7f1f2c01a070 con 0x7f1f3c0b4b90 2024-04-01T02:13:35.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:35.147+0000 7f1f23fff640 1 --2- 172.21.15.50:0/2553822436 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f1f28067450 0x7f1f28069910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:13:35.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:35.147+0000 7f1f23fff640 1 -- 172.21.15.50:0/2553822436 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5824+0+0 (secure 0 0 0) 0x7f1f2c084d30 con 0x7f1f3c0b4b90 2024-04-01T02:13:35.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:35.147+0000 7f1f3affd640 1 --2- 172.21.15.50:0/2553822436 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f1f28067450 0x7f1f28069910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:13:35.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:35.151+0000 7f1f3affd640 1 --2- 172.21.15.50:0/2553822436 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f1f28067450 0x7f1f28069910 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c15e720 tx=0x7f1f30008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:13:35.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:35.155+0000 7f1f23fff640 1 -- 172.21.15.50:0/2553822436 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+176632 (secure 0 0 0) 0x7f1f2c021080 con 0x7f1f3c0b4b90 2024-04-01T02:13:35.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:35.315+0000 7f1f41e08640 1 -- 172.21.15.50:0/2553822436 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f1f3c0cb6f0 con 0x7f1f3c0b4b90 2024-04-01T02:13:35.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:35.983+0000 7f1f23fff640 1 -- 172.21.15.50:0/2553822436 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v25) ==== 181+0+0 (secure 0 0 0) 0x7f1f2c055ad0 con 0x7f1f3c0b4b90 2024-04-01T02:13:35.982 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' removed 2024-04-01T02:13:35.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:35.987+0000 7f1f41e08640 1 -- 172.21.15.50:0/2553822436 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f1f28067450 msgr2=0x7f1f28069910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:13:35.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:35.987+0000 7f1f41e08640 1 --2- 172.21.15.50:0/2553822436 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f1f28067450 0x7f1f28069910 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c15e720 tx=0x7f1f30008040 comp rx=0 tx=0).stop 2024-04-01T02:13:35.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:35.987+0000 7f1f41e08640 1 -- 172.21.15.50:0/2553822436 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f3c0b4b90 msgr2=0x7f1f3c158a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:13:35.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:35.987+0000 7f1f41e08640 1 --2- 172.21.15.50:0/2553822436 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f3c0b4b90 0x7f1f3c158a30 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c00c450 tx=0x7f1f2c00c910 comp rx=0 tx=0).stop 2024-04-01T02:13:35.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:35.991+0000 7f1f41e08640 1 -- 172.21.15.50:0/2553822436 shutdown_connections 2024-04-01T02:13:35.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:35.991+0000 7f1f41e08640 1 --2- 172.21.15.50:0/2553822436 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f1f28067450 0x7f1f28069910 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:13:35.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:35.991+0000 7f1f41e08640 1 --2- 172.21.15.50:0/2553822436 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1f3c158420 0x7f1f3c1f7000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:13:35.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:35.991+0000 7f1f41e08640 1 --2- 172.21.15.50:0/2553822436 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1f3c0c5df0 0x7f1f3c156630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:13:35.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:35.991+0000 7f1f41e08640 1 --2- 172.21.15.50:0/2553822436 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f3c0b4b90 0x7f1f3c158a30 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:13:35.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:35.991+0000 7f1f41e08640 1 -- 172.21.15.50:0/2553822436 >> 172.21.15.50:0/2553822436 conn(0x7f1f3c06c910 msgr2=0x7f1f3c0cc4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T02:13:35.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:35.991+0000 7f1f41e08640 1 -- 172.21.15.50:0/2553822436 shutdown_connections 2024-04-01T02:13:35.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:35.995+0000 7f1f41e08640 1 -- 172.21.15.50:0/2553822436 wait complete. 2024-04-01T02:13:36.030 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-01T02:13:36.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:36.191+0000 7f22df776640 1 Processor -- start 2024-04-01T02:13:36.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:36.191+0000 7f22df776640 1 -- start start 2024-04-01T02:13:36.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:36.195+0000 7f22df776640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f22d8154370 0x7f22d8070390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:13:36.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:36.195+0000 7f22df776640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f22d80708d0 0x7f22d80c8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:13:36.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:36.195+0000 7f22df776640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f22d80c93e0 0x7f22d8072c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:13:36.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:36.195+0000 7f22df776640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f22d815e450 con 0x7f22d80708d0 2024-04-01T02:13:36.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:36.195+0000 7f22df776640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f22d815d8f0 con 0x7f22d8154370 2024-04-01T02:13:36.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:36.195+0000 7f22df776640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f22d815dbb0 con 0x7f22d80c93e0 2024-04-01T02:13:36.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:36.195+0000 7f22dcd11640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f22d80708d0 0x7f22d80c8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:13:36.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:36.195+0000 7f22dcd11640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f22d80708d0 0x7f22d80c8ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56334/0 (socket says 172.21.15.50:56334) 2024-04-01T02:13:36.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:36.195+0000 7f22dcd11640 1 -- 172.21.15.50:0/923793843 learned_addr learned my addr 172.21.15.50:0/923793843 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T02:13:36.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:36.195+0000 7f22dd512640 1 --2- 172.21.15.50:0/923793843 >> v2:172.21.15.97:3300/0 conn(0x7f22d8154370 0x7f22d8070390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:13:36.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:36.195+0000 7f22ddd13640 1 --2- 172.21.15.50:0/923793843 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f22d80c93e0 0x7f22d8072c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:13:36.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:36.195+0000 7f22dcd11640 1 -- 172.21.15.50:0/923793843 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f22d80c93e0 msgr2=0x7f22d8072c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T02:13:36.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:36.195+0000 7f22dcd11640 1 --2- 172.21.15.50:0/923793843 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f22d80c93e0 0x7f22d8072c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:13:36.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:36.195+0000 7f22dcd11640 1 -- 172.21.15.50:0/923793843 >> v2:172.21.15.97:3300/0 conn(0x7f22d8154370 msgr2=0x7f22d8070390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T02:13:36.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:36.195+0000 7f22dcd11640 1 --2- 172.21.15.50:0/923793843 >> v2:172.21.15.97:3300/0 conn(0x7f22d8154370 0x7f22d8070390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:13:36.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:36.195+0000 7f22dcd11640 1 -- 172.21.15.50:0/923793843 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22d815de90 con 0x7f22d80708d0 2024-04-01T02:13:36.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:36.195+0000 7f22dd512640 1 --2- 172.21.15.50:0/923793843 >> v2:172.21.15.97:3300/0 conn(0x7f22d8154370 0x7f22d8070390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T02:13:36.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:36.195+0000 7f22ddd13640 1 --2- 172.21.15.50:0/923793843 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f22d80c93e0 0x7f22d8072c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T02:13:36.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:36.195+0000 7f22dcd11640 1 --2- 172.21.15.50:0/923793843 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22d80708d0 0x7f22d80c8ea0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f22d80c8e70 tx=0x7f22c801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f439ff9246a52f0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:13:36.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:36.195+0000 7f22cffff640 1 -- 172.21.15.50:0/923793843 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22c80b0070 con 0x7f22d80708d0 2024-04-01T02:13:36.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:36.195+0000 7f22cffff640 1 -- 172.21.15.50:0/923793843 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f22c80ab600 con 0x7f22d80708d0 2024-04-01T02:13:36.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:36.195+0000 7f22cffff640 1 -- 172.21.15.50:0/923793843 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22c80ab9f0 con 0x7f22d80708d0 2024-04-01T02:13:36.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:36.199+0000 7f22df776640 1 -- 172.21.15.50:0/923793843 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22d80708d0 msgr2=0x7f22d80c8ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:13:36.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:36.199+0000 7f22df776640 1 --2- 172.21.15.50:0/923793843 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22d80708d0 0x7f22d80c8ea0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f22d80c8e70 tx=0x7f22c801c520 comp rx=0 tx=0).stop 2024-04-01T02:13:36.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:36.199+0000 7f22df776640 1 -- 172.21.15.50:0/923793843 shutdown_connections 2024-04-01T02:13:36.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:36.199+0000 7f22df776640 1 --2- 172.21.15.50:0/923793843 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f22d80c93e0 0x7f22d8072c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:13:36.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:36.199+0000 7f22df776640 1 --2- 172.21.15.50:0/923793843 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22d80708d0 0x7f22d80c8ea0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:13:36.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:36.199+0000 7f22df776640 1 --2- 172.21.15.50:0/923793843 >> v2:172.21.15.97:3300/0 conn(0x7f22d8154370 0x7f22d8070390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:13:36.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:36.199+0000 7f22df776640 1 -- 172.21.15.50:0/923793843 >> 172.21.15.50:0/923793843 conn(0x7f22d806c330 msgr2=0x7f22d806c740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T02:13:36.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:36.199+0000 7f22df776640 1 -- 172.21.15.50:0/923793843 shutdown_connections 2024-04-01T02:13:36.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:36.199+0000 7f22df776640 1 -- 172.21.15.50:0/923793843 wait complete. 2024-04-01T02:13:36.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:36.199+0000 7f22df776640 1 Processor -- start 2024-04-01T02:13:36.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:36.199+0000 7f22df776640 1 -- start start 2024-04-01T02:13:36.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:36.199+0000 7f22df776640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f22d80708d0 0x7f22d8155ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:13:36.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:36.199+0000 7f22df776640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22d80c93e0 0x7f22d8152420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:13:36.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:36.199+0000 7f22df776640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f22d8154370 0x7f22d8153510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:13:36.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:36.199+0000 7f22df776640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f22d815d540 con 0x7f22d80c93e0 2024-04-01T02:13:36.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:36.199+0000 7f22df776640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f22d8073550 con 0x7f22d8154370 2024-04-01T02:13:36.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:36.199+0000 7f22df776640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f22d81576c0 con 0x7f22d80708d0 2024-04-01T02:13:36.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:36.199+0000 7f22dcd11640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22d80c93e0 0x7f22d8152420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:13:36.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:36.199+0000 7f22dcd11640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22d80c93e0 0x7f22d8152420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56344/0 (socket says 172.21.15.50:56344) 2024-04-01T02:13:36.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:36.199+0000 7f22dcd11640 1 -- 172.21.15.50:0/102484594 learned_addr learned my addr 172.21.15.50:0/102484594 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-01T02:13:36.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:36.199+0000 7f22dd512640 1 --2- 172.21.15.50:0/102484594 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f22d80708d0 0x7f22d8155ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:13:36.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:36.199+0000 7f22ddd13640 1 --2- 172.21.15.50:0/102484594 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f22d8154370 0x7f22d8153510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:13:36.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:36.199+0000 7f22dcd11640 1 -- 172.21.15.50:0/102484594 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f22d80708d0 msgr2=0x7f22d8155ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:13:36.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:36.199+0000 7f22dcd11640 1 --2- 172.21.15.50:0/102484594 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f22d80708d0 0x7f22d8155ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:13:36.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:36.199+0000 7f22dcd11640 1 -- 172.21.15.50:0/102484594 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f22d8154370 msgr2=0x7f22d8153510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:13:36.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:36.199+0000 7f22dcd11640 1 --2- 172.21.15.50:0/102484594 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f22d8154370 0x7f22d8153510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:13:36.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:36.199+0000 7f22dcd11640 1 -- 172.21.15.50:0/102484594 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22d8154a40 con 0x7f22d80c93e0 2024-04-01T02:13:36.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:36.199+0000 7f22dcd11640 1 --2- 172.21.15.50:0/102484594 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22d80c93e0 0x7f22d8152420 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f22c80ae040 tx=0x7f22c80192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:13:36.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:36.199+0000 7f22cdffb640 1 -- 172.21.15.50:0/102484594 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22c80b0040 con 0x7f22d80c93e0 2024-04-01T02:13:36.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:36.199+0000 7f22cdffb640 1 -- 172.21.15.50:0/102484594 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f22c80b9070 con 0x7f22d80c93e0 2024-04-01T02:13:36.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:36.199+0000 7f22df776640 1 -- 172.21.15.50:0/102484594 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22d8154d20 con 0x7f22d80c93e0 2024-04-01T02:13:36.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:36.199+0000 7f22cdffb640 1 -- 172.21.15.50:0/102484594 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22c80b4850 con 0x7f22d80c93e0 2024-04-01T02:13:36.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:36.199+0000 7f22df776640 1 -- 172.21.15.50:0/102484594 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22d8151f00 con 0x7f22d80c93e0 2024-04-01T02:13:36.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:36.203+0000 7f22df776640 1 -- 172.21.15.50:0/102484594 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22d8068940 con 0x7f22d80c93e0 2024-04-01T02:13:36.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:36.203+0000 7f22cdffb640 1 -- 172.21.15.50:0/102484594 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 87103+0+0 (secure 0 0 0) 0x7f22c80b49f0 con 0x7f22d80c93e0 2024-04-01T02:13:36.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:36.203+0000 7f22cdffb640 1 --2- 172.21.15.50:0/102484594 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f22bc067420 0x7f22bc0698e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T02:13:36.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:36.203+0000 7f22cdffb640 1 -- 172.21.15.50:0/102484594 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5386+0+0 (secure 0 0 0) 0x7f22c811f4e0 con 0x7f22d80c93e0 2024-04-01T02:13:36.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:36.203+0000 7f22dd512640 1 --2- 172.21.15.50:0/102484594 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f22bc067420 0x7f22bc0698e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T02:13:36.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:36.203+0000 7f22dd512640 1 --2- 172.21.15.50:0/102484594 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f22bc067420 0x7f22bc0698e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f22d4007510 tx=0x7f22d40074a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T02:13:36.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:36.207+0000 7f22cdffb640 1 -- 172.21.15.50:0/102484594 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+176632 (secure 0 0 0) 0x7f22c8016110 con 0x7f22d80c93e0 2024-04-01T02:13:36.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:36.367+0000 7f22df776640 1 -- 172.21.15.50:0/102484594 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f22d81646b0 con 0x7f22d80c93e0 2024-04-01T02:13:36.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:36.991+0000 7f22cdffb640 1 -- 172.21.15.50:0/102484594 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v26) ==== 169+0+0 (secure 0 0 0) 0x7f22c80f0330 con 0x7f22d80c93e0 2024-04-01T02:13:36.989 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' removed 2024-04-01T02:13:36.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:36.995+0000 7f22df776640 1 -- 172.21.15.50:0/102484594 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f22bc067420 msgr2=0x7f22bc0698e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:13:36.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:36.995+0000 7f22df776640 1 --2- 172.21.15.50:0/102484594 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f22bc067420 0x7f22bc0698e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f22d4007510 tx=0x7f22d40074a0 comp rx=0 tx=0).stop 2024-04-01T02:13:36.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:36.995+0000 7f22df776640 1 -- 172.21.15.50:0/102484594 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22d80c93e0 msgr2=0x7f22d8152420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T02:13:36.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:36.995+0000 7f22df776640 1 --2- 172.21.15.50:0/102484594 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22d80c93e0 0x7f22d8152420 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f22c80ae040 tx=0x7f22c80192c0 comp rx=0 tx=0).stop 2024-04-01T02:13:36.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:36.999+0000 7f22df776640 1 -- 172.21.15.50:0/102484594 shutdown_connections 2024-04-01T02:13:36.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:36.999+0000 7f22df776640 1 --2- 172.21.15.50:0/102484594 >> [v2:172.21.15.97:6832/1677467570,v1:172.21.15.97:6833/1677467570] conn(0x7f22bc067420 0x7f22bc0698e0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:13:36.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:36.999+0000 7f22df776640 1 --2- 172.21.15.50:0/102484594 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f22d8154370 0x7f22d8153510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:13:36.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:36.999+0000 7f22df776640 1 --2- 172.21.15.50:0/102484594 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22d80c93e0 0x7f22d8152420 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:13:36.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:36.999+0000 7f22df776640 1 --2- 172.21.15.50:0/102484594 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f22d80708d0 0x7f22d8155ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T02:13:36.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:36.999+0000 7f22df776640 1 -- 172.21.15.50:0/102484594 >> 172.21.15.50:0/102484594 conn(0x7f22d806c330 msgr2=0x7f22d80c4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T02:13:36.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:37.003+0000 7f22df776640 1 -- 172.21.15.50:0/102484594 shutdown_connections 2024-04-01T02:13:36.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-01T02:13:37.003+0000 7f22df776640 1 -- 172.21.15.50:0/102484594 wait complete. 2024-04-01T02:13:37.031 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-01T02:13:37.031 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-01T02:13:37.031 INFO:teuthology.orchestra.run:waiting for 300 2024-04-01T02:13:37.032 INFO:tasks.ceph.mds.a.smithi050.stderr:2024-04-01T02:13:37.035+0000 7fd7d8eb1640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-mds -f --cluster ceph -i a (PID: 31086) UID: 0 2024-04-01T02:13:37.032 INFO:tasks.ceph.mds.a.smithi050.stderr:2024-04-01T02:13:37.035+0000 7fd7d8eb1640 -1 mds.a *** got signal Terminated *** 2024-04-01T02:13:38.401 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T02:13:38.404 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T02:13:43.133 INFO:tasks.ceph.mds.a:Stopped 2024-04-01T02:13:43.133 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-01T02:13:43.134 INFO:teuthology.orchestra.run:waiting for 300 2024-04-01T02:13:43.135 INFO:tasks.ceph.mds.c.smithi050.stderr:2024-04-01T02:13:43.139+0000 7f630e0a3640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-mds -f --cluster ceph -i c (PID: 31085) UID: 0 2024-04-01T02:13:43.135 INFO:tasks.ceph.mds.c.smithi050.stderr:2024-04-01T02:13:43.139+0000 7f630e0a3640 -1 mds.c *** got signal Terminated *** 2024-04-01T02:13:49.238 INFO:tasks.ceph.mds.c:Stopped 2024-04-01T02:13:49.239 DEBUG:tasks.ceph.mds.e:waiting for process to exit 2024-04-01T02:13:49.239 INFO:teuthology.orchestra.run:waiting for 300 2024-04-01T02:13:49.240 INFO:tasks.ceph.mds.e.smithi050.stderr:2024-04-01T02:13:49.243+0000 7f649a0a0640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-mds -f --cluster ceph -i e (PID: 31089) UID: 0 2024-04-01T02:13:49.240 INFO:tasks.ceph.mds.e.smithi050.stderr:2024-04-01T02:13:49.243+0000 7f649a0a0640 -1 mds.e *** got signal Terminated *** 2024-04-01T02:13:51.862 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e is failed for ~0s 2024-04-01T02:13:55.341 INFO:tasks.ceph.mds.e:Stopped 2024-04-01T02:13:55.341 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-01T02:13:55.341 INFO:teuthology.orchestra.run:waiting for 300 2024-04-01T02:13:55.342 INFO:tasks.ceph.mds.b.smithi097.stderr:2024-04-01T02:13:55.344+0000 7fcfc7277640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-mds -f --cluster ceph -i b (PID: 31409) UID: 0 2024-04-01T02:13:55.342 INFO:tasks.ceph.mds.b.smithi097.stderr:2024-04-01T02:13:55.344+0000 7fcfc7277640 -1 mds.b *** got signal Terminated *** 2024-04-01T02:13:58.476 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e has been restored 2024-04-01T02:14:01.443 INFO:tasks.ceph.mds.b:Stopped 2024-04-01T02:14:01.444 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-01T02:14:01.444 INFO:teuthology.orchestra.run:waiting for 300 2024-04-01T02:14:01.445 INFO:tasks.ceph.mds.d.smithi097.stderr:2024-04-01T02:14:01.444+0000 7f45d6d13640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-mds -f --cluster ceph -i d (PID: 31411) UID: 0 2024-04-01T02:14:01.445 INFO:tasks.ceph.mds.d.smithi097.stderr:2024-04-01T02:14:01.444+0000 7f45d6d13640 -1 mds.d *** got signal Terminated *** 2024-04-01T02:14:04.887 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2024-04-01T02:14:07.545 INFO:tasks.ceph.mds.d:Stopped 2024-04-01T02:14:07.546 DEBUG:tasks.ceph.mds.f:waiting for process to exit 2024-04-01T02:14:07.546 INFO:teuthology.orchestra.run:waiting for 300 2024-04-01T02:14:07.547 INFO:tasks.ceph.mds.f.smithi097.stderr:2024-04-01T02:14:07.548+0000 7f9368e4b640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-mds -f --cluster ceph -i f (PID: 31413) UID: 0 2024-04-01T02:14:07.547 INFO:tasks.ceph.mds.f.smithi097.stderr:2024-04-01T02:14:07.548+0000 7f9368e4b640 -1 mds.f *** got signal Terminated *** 2024-04-01T02:14:08.510 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T02:14:08.513 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T02:14:11.198 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f is failed for ~0s 2024-04-01T02:14:11.198 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2024-04-01T02:14:13.648 INFO:tasks.ceph.mds.f:Stopped 2024-04-01T02:14:13.648 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-01T02:14:13.649 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-01T02:14:13.649 INFO:teuthology.orchestra.run:waiting for 300 2024-04-01T02:14:13.650 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-04-01T02:14:13.650+0000 7f672135c640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 0 (PID: 27548) UID: 0 2024-04-01T02:14:13.650 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-04-01T02:14:13.650+0000 7f672135c640 -1 osd.0 32 *** Got signal Terminated *** 2024-04-01T02:14:13.650 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-04-01T02:14:13.650+0000 7f672135c640 -1 osd.0 32 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-01T02:14:17.410 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-04-01T02:14:17.410 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f has been restored 2024-04-01T02:14:19.750 INFO:tasks.ceph.osd.0:Stopped 2024-04-01T02:14:19.751 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-01T02:14:19.751 INFO:teuthology.orchestra.run:waiting for 300 2024-04-01T02:14:19.752 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-04-01T02:14:19.758+0000 7f4636ce3640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 1 (PID: 27550) UID: 0 2024-04-01T02:14:19.752 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-04-01T02:14:19.758+0000 7f4636ce3640 -1 osd.1 33 *** Got signal Terminated *** 2024-04-01T02:14:19.752 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-04-01T02:14:19.758+0000 7f4636ce3640 -1 osd.1 33 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-01T02:14:23.520 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-04-01T02:14:23.520 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-04-01T02:14:25.853 INFO:tasks.ceph.osd.1:Stopped 2024-04-01T02:14:25.854 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-01T02:14:25.854 INFO:teuthology.orchestra.run:waiting for 300 2024-04-01T02:14:25.855 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-04-01T02:14:25.858+0000 7f9991a8f640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 2 (PID: 27552) UID: 0 2024-04-01T02:14:25.855 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-04-01T02:14:25.858+0000 7f9991a8f640 -1 osd.2 35 *** Got signal Terminated *** 2024-04-01T02:14:25.855 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-04-01T02:14:25.858+0000 7f9991a8f640 -1 osd.2 35 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-01T02:14:29.528 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-04-01T02:14:29.529 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-04-01T02:14:31.956 INFO:tasks.ceph.osd.2:Stopped 2024-04-01T02:14:31.956 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-01T02:14:31.956 INFO:teuthology.orchestra.run:waiting for 300 2024-04-01T02:14:31.957 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-04-01T02:14:31.957+0000 7fc51752e640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 3 (PID: 27554) UID: 0 2024-04-01T02:14:31.957 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-04-01T02:14:31.957+0000 7fc51752e640 -1 osd.3 36 *** Got signal Terminated *** 2024-04-01T02:14:31.958 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-04-01T02:14:31.957+0000 7fc51752e640 -1 osd.3 36 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-01T02:14:35.436 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-04-01T02:14:35.437 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-04-01T02:14:38.058 INFO:tasks.ceph.osd.3:Stopped 2024-04-01T02:14:38.059 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-04-01T02:14:38.059 INFO:teuthology.orchestra.run:waiting for 300 2024-04-01T02:14:38.060 INFO:tasks.ceph.osd.4.smithi097.stderr:2024-04-01T02:14:38.059+0000 7f44ba637640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 4 (PID: 27804) UID: 0 2024-04-01T02:14:38.060 INFO:tasks.ceph.osd.4.smithi097.stderr:2024-04-01T02:14:38.059+0000 7f44ba637640 -1 osd.4 37 *** Got signal Terminated *** 2024-04-01T02:14:38.061 INFO:tasks.ceph.osd.4.smithi097.stderr:2024-04-01T02:14:38.059+0000 7f44ba637640 -1 osd.4 37 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-01T02:14:38.635 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T02:14:38.638 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T02:14:41.243 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2024-04-01T02:14:41.244 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-04-01T02:14:44.161 INFO:tasks.ceph.osd.4:Stopped 2024-04-01T02:14:44.162 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-04-01T02:14:44.162 INFO:teuthology.orchestra.run:waiting for 300 2024-04-01T02:14:44.172 INFO:tasks.ceph.osd.5.smithi097.stderr:2024-04-01T02:14:44.167+0000 7f6f18be4640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 5 (PID: 27808) UID: 0 2024-04-01T02:14:44.172 INFO:tasks.ceph.osd.5.smithi097.stderr:2024-04-01T02:14:44.167+0000 7f6f18be4640 -1 osd.5 38 *** Got signal Terminated *** 2024-04-01T02:14:44.173 INFO:tasks.ceph.osd.5.smithi097.stderr:2024-04-01T02:14:44.167+0000 7f6f18be4640 -1 osd.5 38 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-01T02:14:46.950 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-04-01T02:14:46.951 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2024-04-01T02:14:50.263 INFO:tasks.ceph.osd.5:Stopped 2024-04-01T02:14:50.264 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-04-01T02:14:50.264 INFO:teuthology.orchestra.run:waiting for 300 2024-04-01T02:14:50.266 INFO:tasks.ceph.osd.6.smithi097.stderr:2024-04-01T02:14:50.263+0000 7f595df9b640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 6 (PID: 27810) UID: 0 2024-04-01T02:14:50.266 INFO:tasks.ceph.osd.6.smithi097.stderr:2024-04-01T02:14:50.263+0000 7f595df9b640 -1 osd.6 39 *** Got signal Terminated *** 2024-04-01T02:14:50.266 INFO:tasks.ceph.osd.6.smithi097.stderr:2024-04-01T02:14:50.263+0000 7f595df9b640 -1 osd.6 39 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-01T02:14:52.556 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-04-01T02:14:52.557 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-04-01T02:14:56.366 INFO:tasks.ceph.osd.6:Stopped 2024-04-01T02:14:56.367 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-04-01T02:14:56.367 INFO:teuthology.orchestra.run:waiting for 300 2024-04-01T02:14:56.368 INFO:tasks.ceph.osd.7.smithi097.stderr:2024-04-01T02:14:56.367+0000 7f6ec3d8e640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 7 (PID: 27806) UID: 0 2024-04-01T02:14:56.368 INFO:tasks.ceph.osd.7.smithi097.stderr:2024-04-01T02:14:56.367+0000 7f6ec3d8e640 -1 osd.7 39 *** Got signal Terminated *** 2024-04-01T02:14:56.368 INFO:tasks.ceph.osd.7.smithi097.stderr:2024-04-01T02:14:56.367+0000 7f6ec3d8e640 -1 osd.7 39 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-01T02:14:58.062 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-04-01T02:14:58.062 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-04-01T02:15:02.469 INFO:tasks.ceph.osd.7:Stopped 2024-04-01T02:15:02.469 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-01T02:15:02.469 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-01T02:15:02.469 INFO:teuthology.orchestra.run:waiting for 300 2024-04-01T02:15:02.498 INFO:tasks.ceph.mgr.y:Stopped 2024-04-01T02:15:02.499 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-01T02:15:02.499 INFO:teuthology.orchestra.run:waiting for 300 2024-04-01T02:15:02.500 INFO:tasks.ceph.mgr.x.smithi097.stderr:2024-04-01T02:15:02.499+0000 7f9ddfd55640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-mgr -f --cluster ceph -i x (PID: 27488) UID: 0 2024-04-01T02:15:02.500 INFO:tasks.ceph.mgr.x.smithi097.stderr:2024-04-01T02:15:02.499+0000 7f9ddfd55640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-04-01T02:15:02.529 INFO:tasks.ceph.mgr.x:Stopped 2024-04-01T02:15:02.529 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-01T02:15:02.530 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-01T02:15:02.530 INFO:teuthology.orchestra.run:waiting for 300 2024-04-01T02:15:02.543 INFO:tasks.ceph.mon.a.smithi050.stderr:2024-04-01T02:15:02.548+0000 7f752b59b640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-mon -f --cluster ceph -i a (PID: 27443) UID: 0 2024-04-01T02:15:02.544 INFO:tasks.ceph.mon.a.smithi050.stderr:2024-04-01T02:15:02.548+0000 7f752b59b640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-04-01T02:15:03.265 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2024-04-01T02:15:03.265 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-04-01T02:15:08.467 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~5s 2024-04-01T02:15:08.631 INFO:tasks.ceph.mon.a:Stopped 2024-04-01T02:15:08.632 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-01T02:15:08.632 INFO:teuthology.orchestra.run:waiting for 300 2024-04-01T02:15:08.633 INFO:tasks.ceph.mon.b.smithi097.stderr:2024-04-01T02:15:08.634+0000 7f2247c63640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-mon -f --cluster ceph -i b (PID: 27484) UID: 0 2024-04-01T02:15:08.633 INFO:tasks.ceph.mon.b.smithi097.stderr:2024-04-01T02:15:08.634+0000 7f2247c63640 -1 mon.b@1(peon) e1 *** Got Signal Terminated *** 2024-04-01T02:15:08.755 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T02:15:08.758 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T02:15:13.569 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2024-04-01T02:15:13.570 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2024-04-01T02:15:14.734 INFO:tasks.ceph.mon.b:Stopped 2024-04-01T02:15:14.734 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-01T02:15:14.734 INFO:teuthology.orchestra.run:waiting for 300 2024-04-01T02:15:14.736 INFO:tasks.ceph.mon.c.smithi097.stderr:2024-04-01T02:15:14.734+0000 7f4b010d7640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-mon -f --cluster ceph -i c (PID: 27486) UID: 0 2024-04-01T02:15:14.736 INFO:tasks.ceph.mon.c.smithi097.stderr:2024-04-01T02:15:14.734+0000 7f4b010d7640 -1 mon.c@2(probing) e1 *** Got Signal Terminated *** 2024-04-01T02:15:18.570 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2024-04-01T02:15:18.571 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2024-04-01T02:15:20.837 INFO:tasks.ceph.mon.c:Stopped 2024-04-01T02:15:20.837 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-01T02:15:20.837 DEBUG:teuthology.orchestra.run.smithi050:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2024-04-01T02:15:20.856 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi050.front.sepia.ceph.com 2024-04-01T02:15:20.856 DEBUG:teuthology.orchestra.run.smithi050:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-01T02:15:21.110 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi050.front.sepia.ceph.com 2024-04-01T02:15:21.110 DEBUG:teuthology.orchestra.run.smithi050:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-01T02:15:21.321 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi050.front.sepia.ceph.com 2024-04-01T02:15:21.321 DEBUG:teuthology.orchestra.run.smithi050:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-01T02:15:21.597 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi050.front.sepia.ceph.com 2024-04-01T02:15:21.597 DEBUG:teuthology.orchestra.run.smithi050:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-01T02:15:21.753 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi097.front.sepia.ceph.com 2024-04-01T02:15:21.754 DEBUG:teuthology.orchestra.run.smithi097:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-04-01T02:15:21.898 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi097.front.sepia.ceph.com 2024-04-01T02:15:21.898 DEBUG:teuthology.orchestra.run.smithi097:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-04-01T02:15:22.046 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi097.front.sepia.ceph.com 2024-04-01T02:15:22.047 DEBUG:teuthology.orchestra.run.smithi097:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-04-01T02:15:22.199 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi097.front.sepia.ceph.com 2024-04-01T02:15:22.200 DEBUG:teuthology.orchestra.run.smithi097:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-04-01T02:15:22.329 INFO:tasks.ceph:Archiving mon data... 2024-04-01T02:15:22.331 DEBUG:teuthology.misc:Transferring archived files from smithi050:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-03-31_21:24:02-fs-squid-distro-default-smithi/7633248/data/mon.a.tgz 2024-04-01T02:15:22.331 DEBUG:teuthology.orchestra.run.smithi050:> mktemp 2024-04-01T02:15:22.337 INFO:teuthology.orchestra.run.smithi050.stdout:/tmp/tmp.BXPQL4otX8 2024-04-01T02:15:22.338 DEBUG:teuthology.orchestra.run.smithi050:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.BXPQL4otX8 2024-04-01T02:15:22.449 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 0666 /tmp/tmp.BXPQL4otX8 2024-04-01T02:15:22.512 DEBUG:teuthology.orchestra.remote:smithi050:/tmp/tmp.BXPQL4otX8 is 286KB 2024-04-01T02:15:22.573 DEBUG:teuthology.orchestra.run.smithi050:> rm -fr /tmp/tmp.BXPQL4otX8 2024-04-01T02:15:22.578 DEBUG:teuthology.misc:Transferring archived files from smithi097:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-03-31_21:24:02-fs-squid-distro-default-smithi/7633248/data/mon.b.tgz 2024-04-01T02:15:22.579 DEBUG:teuthology.orchestra.run.smithi097:> mktemp 2024-04-01T02:15:22.584 INFO:teuthology.orchestra.run.smithi097.stdout:/tmp/tmp.p5tYaAQh0N 2024-04-01T02:15:22.585 DEBUG:teuthology.orchestra.run.smithi097:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.p5tYaAQh0N 2024-04-01T02:15:22.696 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod 0666 /tmp/tmp.p5tYaAQh0N 2024-04-01T02:15:22.766 DEBUG:teuthology.orchestra.remote:smithi097:/tmp/tmp.p5tYaAQh0N is 288KB 2024-04-01T02:15:22.825 DEBUG:teuthology.orchestra.run.smithi097:> rm -fr /tmp/tmp.p5tYaAQh0N 2024-04-01T02:15:22.831 DEBUG:teuthology.misc:Transferring archived files from smithi097:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-03-31_21:24:02-fs-squid-distro-default-smithi/7633248/data/mon.c.tgz 2024-04-01T02:15:22.831 DEBUG:teuthology.orchestra.run.smithi097:> mktemp 2024-04-01T02:15:22.876 INFO:teuthology.orchestra.run.smithi097.stdout:/tmp/tmp.TcHMbVCdAm 2024-04-01T02:15:22.877 DEBUG:teuthology.orchestra.run.smithi097:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.TcHMbVCdAm 2024-04-01T02:15:22.992 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod 0666 /tmp/tmp.TcHMbVCdAm 2024-04-01T02:15:23.056 DEBUG:teuthology.orchestra.remote:smithi097:/tmp/tmp.TcHMbVCdAm is 288KB 2024-04-01T02:15:23.113 DEBUG:teuthology.orchestra.run.smithi097:> rm -fr /tmp/tmp.TcHMbVCdAm 2024-04-01T02:15:23.119 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-01T02:15:23.119 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-01T02:15:23.121 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-01T02:15:23.183 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-01T02:15:23.221 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-01T02:15:23.221 INFO:tasks.ceph:Archiving crash dumps... 2024-04-01T02:15:23.223 DEBUG:teuthology.misc:Transferring archived files from smithi050:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-03-31_21:24:02-fs-squid-distro-default-smithi/7633248/remote/smithi050/crash 2024-04-01T02:15:23.223 DEBUG:teuthology.orchestra.run.smithi050:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-01T02:15:23.243 DEBUG:teuthology.misc:Transferring archived files from smithi097:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-03-31_21:24:02-fs-squid-distro-default-smithi/7633248/remote/smithi097/crash 2024-04-01T02:15:23.244 DEBUG:teuthology.orchestra.run.smithi097:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-01T02:15:23.276 INFO:tasks.ceph:Shutting down logrotate 2024-04-01T02:15:23.276 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T02:15:23.288 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T02:15:23.455 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-01T02:15:23.468 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-01T02:15:23.482 INFO:tasks.ceph:Compressing logs... 2024-04-01T02:15:23.483 DEBUG:teuthology.orchestra.run.smithi050:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-01T02:15:23.512 DEBUG:teuthology.orchestra.run.smithi097:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-01T02:15:23.536 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34256.log 2024-04-01T02:15:23.537 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32293.log 2024-04-01T02:15:23.537 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.34256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32751.log 2024-04-01T02:15:23.537 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34256.log.gz 2024-04-01T02:15:23.538 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.32293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31056.log 2024-04-01T02:15:23.538 INFO:teuthology.orchestra.run.smithi050.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.32293.log.gz 2024-04-01T02:15:23.539 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-04-01T02:15:23.539 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.32751.log: /var/log/ceph/ceph-client.admin.31056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31887.log 2024-04-01T02:15:23.539 INFO:teuthology.orchestra.run.smithi050.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.31056.log.gz 2024-04-01T02:15:23.539 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34646.log 2024-04-01T02:15:23.539 INFO:teuthology.orchestra.run.smithi050.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.32751.log.gz 2024-04-01T02:15:23.542 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.31887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34334.log 2024-04-01T02:15:23.542 INFO:teuthology.orchestra.run.smithi050.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.31887.log.gz 2024-04-01T02:15:23.542 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.34646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.33064.log 2024-04-01T02:15:23.542 INFO:teuthology.orchestra.run.smithi050.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.34646.log.gz 2024-04-01T02:15:23.542 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.34334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33640.log 2024-04-01T02:15:23.542 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.33064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32305.log 2024-04-01T02:15:23.542 INFO:teuthology.orchestra.run.smithi050.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.34334.log.gz 2024-04-01T02:15:23.543 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.33640.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33640.log.gz 2024-04-01T02:15:23.543 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31094.log 2024-04-01T02:15:23.543 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-04-01T02:15:23.546 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.32305.log: /var/log/ceph/ceph-client.admin.31094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31895.log 2024-04-01T02:15:23.546 INFO:teuthology.orchestra.run.smithi050.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.31094.log.gz 2024-04-01T02:15:23.546 INFO:teuthology.orchestra.run.smithi050.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.32305.log.gz 2024-04-01T02:15:23.546 INFO:teuthology.orchestra.run.smithi050.stderr:gzip/var/log/ceph/ceph-osd.0.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.33771.log 2024-04-01T02:15:23.547 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.31895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32100.log 2024-04-01T02:15:23.547 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.31895.log.gz 2024-04-01T02:15:23.547 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.33771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34438.log 2024-04-01T02:15:23.547 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.32100.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33771.log.gz 2024-04-01T02:15:23.547 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34516.log 2024-04-01T02:15:23.547 INFO:teuthology.orchestra.run.smithi050.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.32100.log.gz 2024-04-01T02:15:23.547 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.34438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33917.log 2024-04-01T02:15:23.547 INFO:teuthology.orchestra.run.smithi050.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34438.log.gz 2024-04-01T02:15:23.548 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.34516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34074.log 2024-04-01T02:15:23.548 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.33917.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.34516.log.gz 2024-04-01T02:15:23.548 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33875.log 2024-04-01T02:15:23.548 INFO:teuthology.orchestra.run.smithi050.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.33917.log.gz 2024-04-01T02:15:23.548 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.34074.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31395.log 2024-04-01T02:15:23.548 INFO:teuthology.orchestra.run.smithi050.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.34074.log.gz 2024-04-01T02:15:23.548 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.33875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31581.log 2024-04-01T02:15:23.554 INFO:teuthology.orchestra.run.smithi050.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33875.log.gz 2024-04-01T02:15:23.554 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32082.log 2024-04-01T02:15:23.554 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.31395.log: /var/log/ceph/ceph-client.admin.31581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31737.log 2024-04-01T02:15:23.554 INFO:teuthology.orchestra.run.smithi050.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.31395.log.gz 2024-04-01T02:15:23.554 INFO:teuthology.orchestra.run.smithi050.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.31581.log.gz 2024-04-01T02:15:23.554 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.32082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31893.log 2024-04-01T02:15:23.555 INFO:teuthology.orchestra.run.smithi050.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.32082.log.gz 2024-04-01T02:15:23.555 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.31737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34178.log 2024-04-01T02:15:23.555 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.31893.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.31737.log.gz 2024-04-01T02:15:23.555 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-01T02:15:23.555 INFO:teuthology.orchestra.run.smithi050.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.31893.log.gz 2024-04-01T02:15:23.555 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32803.log 2024-04-01T02:15:23.555 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.34178.log: /var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33823.log 2024-04-01T02:15:23.555 INFO:teuthology.orchestra.run.smithi050.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34178.log.gz 2024-04-01T02:15:23.555 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.32803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31889.log 2024-04-01T02:15:23.556 INFO:teuthology.orchestra.run.smithi050.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.32803.log.gz 2024-04-01T02:15:23.556 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.33823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32491.log 2024-04-01T02:15:23.556 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.31889.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33823.log.gz 2024-04-01T02:15:23.556 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34230.log 2024-04-01T02:15:23.556 INFO:teuthology.orchestra.run.smithi050.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.31889.log.gz 2024-04-01T02:15:23.556 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.32491.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-01T02:15:23.556 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34672.log 2024-04-01T02:15:23.556 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.34230.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.32491.log.gz 2024-04-01T02:15:23.557 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-mon.a.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34230.log.gz 2024-04-01T02:15:23.557 INFO:teuthology.orchestra.run.smithi050.stderr: 94.8% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-04-01T02:15:23.557 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34204.log 2024-04-01T02:15:23.557 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32094.log 2024-04-01T02:15:23.557 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.34672.log: /var/log/ceph/ceph-client.admin.34204.log: 87.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34152.log 2024-04-01T02:15:23.557 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.34672.log.gz 2024-04-01T02:15:23.557 INFO:teuthology.orchestra.run.smithi050.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.34204.log.gz 2024-04-01T02:15:23.557 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.32094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32673.log 2024-04-01T02:15:23.557 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.32094.log.gz 2024-04-01T02:15:23.558 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.34152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32283.log 2024-04-01T02:15:23.568 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27746.log 2024-04-01T02:15:23.568 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27602.log 2024-04-01T02:15:23.568 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.27746.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-04-01T02:15:23.568 INFO:teuthology.orchestra.run.smithi097.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.27746.log.gz 2024-04-01T02:15:23.568 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.27602.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-04-01T02:15:23.568 INFO:teuthology.orchestra.run.smithi097.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.27602.log.gz 2024-04-01T02:15:23.569 INFO:teuthology.orchestra.run.smithi097.stderr:gzip/var/log/ceph/ceph-osd.7.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.27674.log 2024-04-01T02:15:23.569 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-04-01T02:15:23.569 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.27674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27770.log 2024-04-01T02:15:23.569 INFO:teuthology.orchestra.run.smithi097.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.27674.log.gz 2024-04-01T02:15:23.569 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-01T02:15:23.569 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.f.log 2024-04-01T02:15:23.569 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.27770.log: /var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-01T02:15:23.569 INFO:teuthology.orchestra.run.smithi097.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.27770.log.gz 2024-04-01T02:15:23.570 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27722.log 2024-04-01T02:15:23.570 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-mds.f.log: /var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27650.log 2024-04-01T02:15:23.570 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.27722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27626.log 2024-04-01T02:15:23.570 INFO:teuthology.orchestra.run.smithi097.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.27722.log.gz/var/log/ceph/ceph-client.admin.27650.log: 2024-04-01T02:15:23.570 INFO:teuthology.orchestra.run.smithi097.stderr: 89.2%gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-04-01T02:15:23.570 INFO:teuthology.orchestra.run.smithi097.stderr: -- replaced with /var/log/ceph/ceph-client.admin.27650.log.gz 2024-04-01T02:15:23.570 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.27626.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-01T02:15:23.570 INFO:teuthology.orchestra.run.smithi097.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.27626.log.gz 2024-04-01T02:15:23.570 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-04-01T02:15:23.571 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph.audit.log: 92.6% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-01T02:15:23.571 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-04-01T02:15:23.571 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-mds.d.log: 93.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-01T02:15:23.571 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-04-01T02:15:23.571 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2024-04-01T02:15:23.574 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-mds.b.log: 94.1% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-04-01T02:15:23.574 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-04-01T02:15:23.574 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-mon.b.log: 94.1% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-04-01T02:15:23.574 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27698.log 2024-04-01T02:15:23.580 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.32673.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34152.log.gz 2024-04-01T02:15:23.580 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34698.log 2024-04-01T02:15:23.580 INFO:teuthology.orchestra.run.smithi050.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.32673.log.gz 2024-04-01T02:15:23.580 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.32283.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31890.log 2024-04-01T02:15:23.581 INFO:teuthology.orchestra.run.smithi050.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.32283.log.gz 2024-04-01T02:15:23.581 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.34698.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33692.log 2024-04-01T02:15:23.581 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.31890.log: 89.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32543.log 2024-04-01T02:15:23.581 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.34698.log.gz 2024-04-01T02:15:23.581 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.33692.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.31890.log.gz 2024-04-01T02:15:23.581 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32102.log 2024-04-01T02:15:23.581 INFO:teuthology.orchestra.run.smithi050.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33692.log.gz 2024-04-01T02:15:23.581 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31763.log 2024-04-01T02:15:23.582 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.32543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33797.log 2024-04-01T02:15:23.582 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.32102.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.32543.log.gz 2024-04-01T02:15:23.582 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.31763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32647.log 2024-04-01T02:15:23.582 INFO:teuthology.orchestra.run.smithi050.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.32102.log.gz 2024-04-01T02:15:23.582 INFO:teuthology.orchestra.run.smithi050.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.31763.log.gz 2024-04-01T02:15:23.582 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.33797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34568.log 2024-04-01T02:15:23.582 INFO:teuthology.orchestra.run.smithi050.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.33797.log.gz 2024-04-01T02:15:23.582 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.32647.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-04-01T02:15:23.583 INFO:teuthology.orchestra.run.smithi050.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.32647.log.gz 2024-04-01T02:15:23.583 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32098.log 2024-04-01T02:15:23.583 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.34568.log: /var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31685.log 2024-04-01T02:15:23.583 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34568.log.gz 2024-04-01T02:15:23.583 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.32098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31341.log 2024-04-01T02:15:23.583 INFO:teuthology.orchestra.run.smithi050.stderr: 88.4%/var/log/ceph/ceph-client.admin.31685.log: -- replaced with /var/log/ceph/ceph-client.admin.32098.log.gz 2024-04-01T02:15:23.583 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32936.log 2024-04-01T02:15:23.583 INFO:teuthology.orchestra.run.smithi050.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.31685.log.gz 2024-04-01T02:15:23.583 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.31341.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.31341.log.gz 2024-04-01T02:15:23.584 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31367.log 2024-04-01T02:15:23.584 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.32936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32096.log 2024-04-01T02:15:23.584 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.31367.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.32936.log.gz 2024-04-01T02:15:23.584 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34100.log 2024-04-01T02:15:23.584 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32621.log 2024-04-01T02:15:23.584 INFO:teuthology.orchestra.run.smithi050.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.31367.log.gz 2024-04-01T02:15:23.584 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.32096.log: /var/log/ceph/ceph-client.admin.34100.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.32096.log.gz 2024-04-01T02:15:23.585 INFO:teuthology.orchestra.run.smithi050.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34100.log.gz 2024-04-01T02:15:23.585 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32569.log 2024-04-01T02:15:23.585 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.32621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34542.log 2024-04-01T02:15:23.585 INFO:teuthology.orchestra.run.smithi050.stderr: 88.8%/var/log/ceph/ceph-client.admin.32569.log: -- replaced with /var/log/ceph/ceph-client.admin.32621.log.gz 2024-04-01T02:15:23.585 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-01T02:15:23.585 INFO:teuthology.orchestra.run.smithi050.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.32569.log.gz 2024-04-01T02:15:23.585 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.34542.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.34542.log.gz 2024-04-01T02:15:23.585 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33849.log 2024-04-01T02:15:23.586 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31789.log 2024-04-01T02:15:23.586 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.33849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32777.log 2024-04-01T02:15:23.586 INFO:teuthology.orchestra.run.smithi050.stderr: 89.0%/var/log/ceph/ceph-client.admin.31789.log: -- replaced with /var/log/ceph/ceph-client.admin.33849.log.gz 2024-04-01T02:15:23.586 INFO:teuthology.orchestra.run.smithi050.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.31789.log.gz 2024-04-01T02:15:23.586 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31204.log 2024-04-01T02:15:23.586 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.32777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31527.log 2024-04-01T02:15:23.586 INFO:teuthology.orchestra.run.smithi050.stderr: 87.7%/var/log/ceph/ceph-client.admin.31204.log: -- replaced with /var/log/ceph/ceph-client.admin.32777.log.gz 2024-04-01T02:15:23.586 INFO:teuthology.orchestra.run.smithi050.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.31204.log.gz 2024-04-01T02:15:23.587 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31607.log 2024-04-01T02:15:23.587 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34466.log 2024-04-01T02:15:23.587 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.31527.log: /var/log/ceph/ceph-client.admin.31607.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.31527.log.gz 2024-04-01T02:15:23.587 INFO:teuthology.orchestra.run.smithi050.stderr: 89.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34620.log 2024-04-01T02:15:23.587 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.31607.log.gz 2024-04-01T02:15:23.587 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.34466.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34466.log.gz 2024-04-01T02:15:23.587 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33666.log 2024-04-01T02:15:23.587 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-01T02:15:23.587 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.34620.log: /var/log/ceph/ceph-client.admin.33666.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34620.log.gz 2024-04-01T02:15:23.588 INFO:teuthology.orchestra.run.smithi050.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.33666.log.gz 2024-04-01T02:15:23.588 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31263.log 2024-04-01T02:15:23.588 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31315.log 2024-04-01T02:15:23.588 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.31263.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.31263.log.gz 2024-04-01T02:15:23.588 INFO:teuthology.orchestra.run.smithi050.stderr: 86.4% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-01T02:15:23.590 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34282.log 2024-04-01T02:15:23.590 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27669.log 2024-04-01T02:15:23.590 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.31315.log: /var/log/ceph/ceph-client.admin.34282.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.31315.log.gz 2024-04-01T02:15:23.590 INFO:teuthology.orchestra.run.smithi050.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.34282.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32517.log 2024-04-01T02:15:23.590 INFO:teuthology.orchestra.run.smithi050.stderr: 2024-04-01T02:15:23.591 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-osd.4.log: /var/log/ceph/ceph-client.admin.27698.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.27698.log.gz 2024-04-01T02:15:23.597 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.27669.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.27669.log.gz 2024-04-01T02:15:23.597 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33718.log 2024-04-01T02:15:23.597 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31892.log 2024-04-01T02:15:23.597 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.32517.log: /var/log/ceph/ceph-client.admin.33718.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.32517.log.gz 2024-04-01T02:15:23.598 INFO:teuthology.orchestra.run.smithi050.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33718.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31449.log 2024-04-01T02:15:23.598 INFO:teuthology.orchestra.run.smithi050.stderr: 2024-04-01T02:15:23.598 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.31892.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.31892.log.gz 2024-04-01T02:15:23.598 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32725.log 2024-04-01T02:15:23.598 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31659.log 2024-04-01T02:15:23.598 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.31449.log: /var/log/ceph/ceph-client.admin.32725.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.31449.log.gz 2024-04-01T02:15:23.598 INFO:teuthology.orchestra.run.smithi050.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.32725.log.gz 2024-04-01T02:15:23.598 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34360.log 2024-04-01T02:15:23.599 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33744.log 2024-04-01T02:15:23.599 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.31659.log: /var/log/ceph/ceph-client.admin.34360.log: 88.5% 88.7% -- replaced with /var/log/ceph/ceph-client.admin.31659.log.gz 2024-04-01T02:15:23.599 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.34360.log.gz 2024-04-01T02:15:23.599 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31423.log 2024-04-01T02:15:23.599 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31633.log 2024-04-01T02:15:23.599 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.33744.log: /var/log/ceph/ceph-client.admin.31423.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33744.log.gz 2024-04-01T02:15:23.599 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7%gzip -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.31423.log.gz -- 2024-04-01T02:15:23.599 INFO:teuthology.orchestra.run.smithi050.stderr: /var/log/ceph/ceph-client.admin.32699.log 2024-04-01T02:15:23.599 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.31633.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.31633.log.gz 2024-04-01T02:15:23.600 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34386.log 2024-04-01T02:15:23.600 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31894.log 2024-04-01T02:15:23.600 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.32699.log: /var/log/ceph/ceph-client.admin.34386.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.32699.log.gz 2024-04-01T02:15:23.600 INFO:teuthology.orchestra.run.smithi050.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34386.log.gz 2024-04-01T02:15:23.600 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34022.log 2024-04-01T02:15:23.600 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33944.log 2024-04-01T02:15:23.600 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.31894.log: /var/log/ceph/ceph-client.admin.34022.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.31894.log.gz 2024-04-01T02:15:23.600 INFO:teuthology.orchestra.run.smithi050.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34022.log.gz 2024-04-01T02:15:23.601 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31289.log 2024-04-01T02:15:23.601 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-01T02:15:23.601 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.33944.log: /var/log/ceph/ceph-client.admin.31289.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.33944.log.gz 2024-04-01T02:15:23.601 INFO:teuthology.orchestra.run.smithi050.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.31289.log.gz 2024-04-01T02:15:23.601 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-04-01T02:15:23.601 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-04-01T02:15:23.601 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-mds.c.log: 89.0% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-01T02:15:23.601 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32881.log 2024-04-01T02:15:23.603 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-mds.a.log: 94.2% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-04-01T02:15:23.603 INFO:teuthology.orchestra.run.smithi050.stderr: 94.0% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-04-01T02:15:23.603 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32306.log 2024-04-01T02:15:23.604 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31178.log 2024-04-01T02:15:23.604 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.32881.log: /var/log/ceph/ceph-client.admin.32306.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.32306.log.gz 2024-04-01T02:15:23.604 INFO:teuthology.orchestra.run.smithi050.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.32881.log.gz 2024-04-01T02:15:23.604 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32294.log 2024-04-01T02:15:23.605 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.31178.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.31178.log.gz 2024-04-01T02:15:23.605 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32101.log 2024-04-01T02:15:23.605 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.32294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33996.log 2024-04-01T02:15:23.606 INFO:teuthology.orchestra.run.smithi050.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.32294.log.gz/var/log/ceph/ceph-client.admin.32101.log: 2024-04-01T02:15:23.606 INFO:teuthology.orchestra.run.smithi050.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.32101.log.gz 2024-04-01T02:15:23.607 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32295.log 2024-04-01T02:15:23.607 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33970.log 2024-04-01T02:15:23.607 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.33996.log: /var/log/ceph/ceph-client.admin.32295.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.33996.log.gz 2024-04-01T02:15:23.607 INFO:teuthology.orchestra.run.smithi050.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.32295.log.gz 2024-04-01T02:15:23.607 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34126.log 2024-04-01T02:15:23.608 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27450.log 2024-04-01T02:15:23.609 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.33970.log: /var/log/ceph/ceph-client.admin.34126.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33970.log.gz 2024-04-01T02:15:23.609 INFO:teuthology.orchestra.run.smithi050.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.34126.log.gz 2024-04-01T02:15:23.609 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32307.log 2024-04-01T02:15:23.609 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.27450.log: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.27450.log.gz 2024-04-01T02:15:23.610 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34412.log 2024-04-01T02:15:23.610 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31815.log 2024-04-01T02:15:23.611 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.32307.log: /var/log/ceph/ceph-client.admin.34412.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.32307.log.gz 2024-04-01T02:15:23.611 INFO:teuthology.orchestra.run.smithi050.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.34412.log.gz 2024-04-01T02:15:23.612 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27559.log 2024-04-01T02:15:23.612 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.31815.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.31815.log.gz 2024-04-01T02:15:23.612 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31841.log 2024-04-01T02:15:23.613 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34594.log 2024-04-01T02:15:23.613 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.27559.log: /var/log/ceph/ceph-client.admin.31841.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.27559.log.gz 2024-04-01T02:15:23.614 INFO:teuthology.orchestra.run.smithi050.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.31841.log.gz 2024-04-01T02:15:23.615 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34308.log 2024-04-01T02:15:23.615 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.34594.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.34594.log.gz 2024-04-01T02:15:23.615 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31711.log 2024-04-01T02:15:23.616 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34048.log 2024-04-01T02:15:23.616 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.34308.log: /var/log/ceph/ceph-client.admin.31711.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34308.log.gz 2024-04-01T02:15:23.617 INFO:teuthology.orchestra.run.smithi050.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.31711.log.gz 2024-04-01T02:15:23.617 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.22639.log 2024-04-01T02:15:23.617 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31876.log 2024-04-01T02:15:23.618 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.34048.log: /var/log/ceph/ceph.tmp-client.admin.22639.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.22639.log.gz 2024-04-01T02:15:23.618 INFO:teuthology.orchestra.run.smithi050.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.34048.log.gz 2024-04-01T02:15:23.618 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32855.log 2024-04-01T02:15:23.619 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32103.log 2024-04-01T02:15:23.620 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.31876.log: /var/log/ceph/ceph-client.admin.32855.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.31876.log.gz 2024-04-01T02:15:23.620 INFO:teuthology.orchestra.run.smithi050.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.32855.log.gz 2024-04-01T02:15:23.620 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31501.log 2024-04-01T02:15:23.621 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.e.log 2024-04-01T02:15:23.621 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.32103.log: /var/log/ceph/ceph-client.admin.31501.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.32103.log.gz 2024-04-01T02:15:23.621 INFO:teuthology.orchestra.run.smithi050.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.31501.log.gz 2024-04-01T02:15:23.621 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32829.log 2024-04-01T02:15:23.622 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32312.log 2024-04-01T02:15:23.622 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-mds.e.log: /var/log/ceph/ceph-client.admin.32829.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.32829.log.gz 2024-04-01T02:15:23.625 INFO:teuthology.orchestra.run.smithi050.stderr: 94.2% -- replaced with /var/log/ceph/ceph-mds.e.log.gz 2024-04-01T02:15:23.626 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34492.log 2024-04-01T02:15:23.627 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32595.log 2024-04-01T02:15:23.627 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.32312.log: /var/log/ceph/ceph-client.admin.34492.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.32312.log.gz 2024-04-01T02:15:23.628 INFO:teuthology.orchestra.run.smithi050.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.34492.log.gz 2024-04-01T02:15:23.628 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31553.log 2024-04-01T02:15:23.628 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31475.log 2024-04-01T02:15:23.629 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.32595.log: /var/log/ceph/ceph-client.admin.31553.log: 89.2% 89.1% -- replaced with /var/log/ceph/ceph-client.admin.32595.log.gz 2024-04-01T02:15:23.629 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.31553.log.gz 2024-04-01T02:15:23.629 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.31475.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.31475.log.gz 2024-04-01T02:15:23.749 INFO:teuthology.orchestra.run.smithi097.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-01T02:15:23.828 INFO:teuthology.orchestra.run.smithi097.stderr: 92.8% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-04-01T02:15:23.885 INFO:teuthology.orchestra.run.smithi097.stderr: 92.6% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-04-01T02:15:24.315 INFO:teuthology.orchestra.run.smithi050.stderr: 90.9% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-01T02:15:27.975 INFO:teuthology.orchestra.run.smithi050.stderr: 91.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-01T02:15:28.540 INFO:teuthology.orchestra.run.smithi050.stderr: 91.3% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-01T02:15:28.763 INFO:teuthology.orchestra.run.smithi097.stderr: 91.0% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-04-01T02:15:29.634 INFO:teuthology.orchestra.run.smithi097.stderr: 91.1% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-04-01T02:15:30.259 INFO:teuthology.orchestra.run.smithi097.stderr: 91.0% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-04-01T02:15:30.720 INFO:teuthology.orchestra.run.smithi097.stderr: 91.0% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-04-01T02:15:32.430 INFO:teuthology.orchestra.run.smithi050.stderr: 91.1% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-01T02:15:33.632 INFO:teuthology.orchestra.run.smithi050.stderr: 90.3% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-04-01T02:16:25.460 INFO:teuthology.orchestra.run.smithi097.stderr: 94.3% -- replaced with /var/log/ceph/ceph-mds.f.log.gz 2024-04-01T02:16:25.462 INFO:teuthology.orchestra.run.smithi097.stderr: 2024-04-01T02:16:25.462 INFO:teuthology.orchestra.run.smithi097.stderr:real 1m1.935s 2024-04-01T02:16:25.462 INFO:teuthology.orchestra.run.smithi097.stderr:user 1m24.886s 2024-04-01T02:16:25.463 INFO:teuthology.orchestra.run.smithi097.stderr:sys 0m2.917s 2024-04-01T02:17:12.199 INFO:teuthology.orchestra.run.smithi050.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.0.33064.log.gz 2024-04-01T02:17:12.199 INFO:teuthology.orchestra.run.smithi050.stderr: 2024-04-01T02:17:12.200 INFO:teuthology.orchestra.run.smithi050.stderr:real 1m48.683s 2024-04-01T02:17:12.200 INFO:teuthology.orchestra.run.smithi050.stderr:user 2m13.984s 2024-04-01T02:17:12.200 INFO:teuthology.orchestra.run.smithi050.stderr:sys 0m3.945s 2024-04-01T02:17:12.200 INFO:tasks.ceph:Archiving logs... 2024-04-01T02:17:12.201 DEBUG:teuthology.misc:Transferring archived files from smithi050:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-03-31_21:24:02-fs-squid-distro-default-smithi/7633248/remote/smithi050/log 2024-04-01T02:17:12.202 DEBUG:teuthology.orchestra.run.smithi050:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-01T02:17:29.341 DEBUG:teuthology.misc:Transferring archived files from smithi097:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-03-31_21:24:02-fs-squid-distro-default-smithi/7633248/remote/smithi097/log 2024-04-01T02:17:29.343 DEBUG:teuthology.orchestra.run.smithi097:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-01T02:17:48.868 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-01T02:17:48.878 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-01T02:17:48.878 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-01T02:17:48.881 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-01T02:17:48.961 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-01T02:17:48.970 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-01T02:17:48.970 DEBUG:teuthology.orchestra.run.smithi050:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-01T02:17:48.973 DEBUG:teuthology.orchestra.run.smithi097:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-01T02:17:48.987 INFO:teuthology.orchestra.run.smithi097.stdout: remote refid st t when poll reach delay offset jitter 2024-04-01T02:17:48.987 INFO:teuthology.orchestra.run.smithi097.stdout:============================================================================== 2024-04-01T02:17:48.988 INFO:teuthology.orchestra.run.smithi097.stdout:*hv01.front.sepi 44.4.53.2 2 u 33 64 377 0.074 -2.836 0.844 2024-04-01T02:17:48.988 INFO:teuthology.orchestra.run.smithi097.stdout:+hv02.front.sepi 63.231.80.2 3 u 31 64 377 0.079 -3.565 1.588 2024-04-01T02:17:48.988 INFO:teuthology.orchestra.run.smithi097.stdout:+hv03.front.sepi 74.6.168.72 3 u 25 64 377 0.073 -5.008 1.418 2024-04-01T02:17:48.988 INFO:teuthology.orchestra.run.smithi097.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2024-04-01T02:17:48.988 INFO:teuthology.orchestra.run.smithi050.stdout: remote refid st t when poll reach delay offset jitter 2024-04-01T02:17:48.988 INFO:teuthology.orchestra.run.smithi050.stdout:============================================================================== 2024-04-01T02:17:48.988 INFO:teuthology.orchestra.run.smithi050.stdout:*hv01.front.sepi 44.4.53.2 2 u 20 64 377 0.062 -7.445 1.852 2024-04-01T02:17:48.988 INFO:teuthology.orchestra.run.smithi050.stdout:+hv02.front.sepi 63.231.80.2 3 u 30 64 377 0.055 -8.389 2.754 2024-04-01T02:17:48.989 INFO:teuthology.orchestra.run.smithi050.stdout:+hv03.front.sepi 74.6.168.72 3 u 24 64 377 0.073 -8.864 1.811 2024-04-01T02:17:48.989 INFO:teuthology.orchestra.run.smithi050.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2024-04-01T02:17:48.989 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-01T02:17:48.998 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-01T02:17:48.998 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-01T02:17:49.007 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-01T02:17:49.016 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-01T02:17:49.043 INFO:teuthology.task.internal:Duration was 1971.240553 seconds 2024-04-01T02:17:49.044 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-01T02:17:49.053 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-01T02:17:49.054 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-01T02:17:49.056 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-01T02:17:49.093 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-01T02:17:49.094 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi050.front.sepia.ceph.com 2024-04-01T02:17:49.094 DEBUG:teuthology.orchestra.run.smithi050:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-01T02:17:49.148 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi097.front.sepia.ceph.com 2024-04-01T02:17:49.149 DEBUG:teuthology.orchestra.run.smithi097:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-01T02:17:49.158 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-01T02:17:49.159 DEBUG:teuthology.orchestra.run.smithi050:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-01T02:17:49.192 DEBUG:teuthology.orchestra.run.smithi097:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-01T02:17:49.224 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-01T02:17:49.224 DEBUG:teuthology.orchestra.run.smithi050:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-01T02:17:49.260 DEBUG:teuthology.orchestra.run.smithi097:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-01T02:17:49.324 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-01T02:17:49.334 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-01T02:17:49.334 DEBUG:teuthology.orchestra.run.smithi050:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-01T02:17:49.348 DEBUG:teuthology.orchestra.run.smithi097:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-01T02:17:49.360 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-01T02:17:49.370 DEBUG:teuthology.orchestra.run.smithi050:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-01T02:17:49.392 DEBUG:teuthology.orchestra.run.smithi097:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-01T02:17:49.401 INFO:teuthology.orchestra.run.smithi050.stdout:kernel.core_pattern = core 2024-04-01T02:17:49.411 INFO:teuthology.orchestra.run.smithi097.stdout:kernel.core_pattern = core 2024-04-01T02:17:49.434 DEBUG:teuthology.orchestra.run.smithi050:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-01T02:17:49.458 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-01T02:17:49.459 DEBUG:teuthology.orchestra.run.smithi097:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-01T02:17:49.478 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-01T02:17:49.479 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-01T02:17:49.489 INFO:teuthology.task.internal:Transferring archived files... 2024-04-01T02:17:49.490 DEBUG:teuthology.misc:Transferring archived files from smithi050:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-03-31_21:24:02-fs-squid-distro-default-smithi/7633248/remote/smithi050 2024-04-01T02:17:49.490 DEBUG:teuthology.orchestra.run.smithi050:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-01T02:17:49.523 DEBUG:teuthology.misc:Transferring archived files from smithi097:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-03-31_21:24:02-fs-squid-distro-default-smithi/7633248/remote/smithi097 2024-04-01T02:17:49.524 DEBUG:teuthology.orchestra.run.smithi097:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-01T02:17:49.543 INFO:teuthology.task.internal:Removing archive directory... 2024-04-01T02:17:49.543 DEBUG:teuthology.orchestra.run.smithi050:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-01T02:17:49.568 DEBUG:teuthology.orchestra.run.smithi097:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-01T02:17:49.587 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-01T02:17:49.599 INFO:teuthology.task.internal:Not uploading archives. 2024-04-01T02:17:49.599 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-01T02:17:49.609 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-01T02:17:49.609 DEBUG:teuthology.orchestra.run.smithi050:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-01T02:17:49.616 DEBUG:teuthology.orchestra.run.smithi097:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-01T02:17:49.621 INFO:teuthology.orchestra.run.smithi050.stdout: 658465 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 1 02:17 /home/ubuntu/cephtest 2024-04-01T02:17:49.635 INFO:teuthology.orchestra.run.smithi097.stdout: 658462 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 1 02:17 /home/ubuntu/cephtest 2024-04-01T02:17:49.637 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-01T02:17:49.648 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-01T02:17:49.669 INFO:teuthology.nuke:Checking targets against current locks 2024-04-01T02:17:49.694 DEBUG:teuthology.nuke:shortname: smithi050 2024-04-01T02:17:49.695 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-01T02:17:49.717 DEBUG:teuthology.nuke:shortname: smithi097 2024-04-01T02:17:49.717 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-01T02:17:49.721 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi050.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-03-31_21:24:02-fs-squid-distro-default-smithi/7633248', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-01 01:36:10.378691', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIaIIMFIyz/Ym4ph/Q4OtlkmlRL7pbJF7YwUBjImiShD3B4vun9tltsG3mXt4pnng1dlVm8JKT7VtrxGKASVLH4='} 2024-04-01T02:17:49.740 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi097.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-03-31_21:24:02-fs-squid-distro-default-smithi/7633248', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-01 01:36:10.380292', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPVwbYRyhjH4QnGesHGUZYOKzTOLyLuMi+GEeyKY0Kc2YplZEwScTcl3SRxWbgK3ftkTwsgEMG2VnWK1dks9f0I='} 2024-04-01T02:17:49.767 INFO:teuthology.orchestra.console.smithi050:Power off 2024-04-01T02:17:49.768 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-01T02:17:49.791 DEBUG:teuthology.orchestra.console.smithi050:power off output: Chassis Power Control: Down/Off 2024-04-01T02:17:49.792 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T02:17:49.807 INFO:teuthology.orchestra.console.smithi097:Power off 2024-04-01T02:17:49.807 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-01T02:17:49.816 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is on 2024-04-01T02:17:49.829 DEBUG:teuthology.orchestra.console.smithi097:power off output: Chassis Power Control: Down/Off 2024-04-01T02:17:49.829 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T02:17:49.851 DEBUG:teuthology.orchestra.console.smithi097:check power output: Chassis Power is on 2024-04-01T02:17:53.817 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T02:17:53.853 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T02:17:53.928 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is on 2024-04-01T02:17:53.964 DEBUG:teuthology.orchestra.console.smithi097:check power output: Chassis Power is on 2024-04-01T02:17:57.930 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T02:17:57.965 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T02:17:58.042 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is on 2024-04-01T02:17:58.076 DEBUG:teuthology.orchestra.console.smithi097:check power output: Chassis Power is off 2024-04-01T02:17:58.176 INFO:teuthology.orchestra.console.smithi097:Power off completed 2024-04-01T02:18:02.045 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T02:18:02.155 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is off 2024-04-01T02:18:02.255 INFO:teuthology.orchestra.console.smithi050:Power off completed 2024-04-01T02:18:02.361 INFO:teuthology.run:Summary data: description: fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu/{overrides ubuntu_latest}} mount/fuse objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/1 tasks/dbench validater/lockdep} duration: 1971.2405533790588 failure_reason: 'Command failed (workunit test suites/dbench.sh) on smithi050 with status 1: ''mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=384f31f3d3aee7f8ba3f60846b8844c049165583 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/dbench.sh''' flavor: default owner: scheduled_teuthology@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=f9034f4d019941c28997e75049ecefb9 status: fail success: false 2024-04-01T02:18:02.362 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T02:18:02.437 INFO:teuthology.run:FAIL